Hacked iPhone API takes AR to the next level

From ReadWriteWeb:

An international team of computer scientists has created software that lets anyone perform on-the-fly analysis of live streaming video on the iPhone. Used alongside existing methods of displaying data on top of the camera's view, this new functionality signals a fundamental change in the kinds of Augmented Reality (AR) that iPhone developers can create. Existing AR apps, like Yelp, Layar, Wikitude and others display data on top of a camera's view but don't actually analyze what the camera sees. This new development changes that.

The video is pretty amazing. I can't wait to see where this tech goes from here...


Devs Hack iPhone API for True Augmented Reality


Recent Entries

Comments

Oldest comments listed first.

Posted by: Toaste on October 17, 2009 at 1:31 PM

Impressive, but...

Very impressive demo in the video, it certainly raises the bar for what desktop AR can achieve.

But I don't see an iPhone anywhere in there. Video capture is through a webcam and processing is done on a laptop. Does the article mean they stream video to a desktop and apply AR there?

The reason I'm skeptical is that the demo shows interaction that is impressive even for AR running on a laptop, but the article claims it's for iPhone. While portable AR has awesome applications, chaining it to a desk is significantly less useful.

Any modern laptop ought to be able to push 2 GFLOPS (2 billion floating-point operations per second) and effective use of SIMD instructions can push that a bit higher. Offload some computation to the GPU with CUDA can get you tens of GFLOPS even on a laptop GPU. The ARM processor in a 3GS may be impressively power-efficient, but you just aren't going to get the same level of performance on computationally intense applications.

Like physics simulation and video processing.


Posted by: Chris on October 17, 2009 at 9:23 PM

Agree with the guy above me

I'm with you toast, I don't buy it. Someone's a wannabe, unless you can let me get my hands on it


Posted by: Gareth Branwyn on October 17, 2009 at 9:32 PM

If you click through the links, you'll see that they are offering the source code to the public, so feel free to get your hands on it.


Posted by: Anonymous on October 18, 2009 at 8:15 AM

I kept seeing that Ah-ha video...


Posted by: Tim on October 18, 2009 at 9:54 AM

So....

... has anyone thought of a useful use of AR yet? Layar is just a gimmicky map, this is a gimmicky physics simulation (the sketch analysis doesn't really have anything to do with AR), etc.

The only thing I've seen where AR vaguely adds to things was that tabletop zombie game.


Posted by: Free iPhone 3GS on October 18, 2009 at 11:02 AM

http://www.freebieshack.co.uk/

Wow, that's impressive, but I don't see how that's done on an iPhone?


Leave a comment


Subscribe to MAKE!Subscribe to MAKE Magazine!

Subscribe today, save 42% and get web access to MAKE free. MAKE Digital Edition is available only to subscribers.

$34.95 / 1 year
(4 Quarterly Issues)

Subscribe now


Void your warranty, violate a user agreement, fry a circuit, blow a fuse, poke an eye out. Make: The risk-takers, the doers, the makers of things... Welcome to Make: Online!


CRAFT Maker Shed Maker Faire MAKE television
Holiday Gift Guides from MAKE
Gifts for Dads
Science and Chemistry
Gifts Under $20
More guides: Santa Claus Machines, Geek Toys for Grown Up Girls & Boys


Check out all of the episodes of Make: television

Alex Rider Dream Gadget Contest
Make: Science Room

Connect with MAKE

Be a MAKE fan on Facebook MAKE on Facebook
Visit our Facebook page and become a fan of MAKE!
MAKE on Twitter MAKE on Twitter
Follow our MAKE tweets!
MAKE Flickr Pool MAKE on Flickr
Join our MAKE Flickr Pool!
    make_tips on Twitter




    Maker SHED

    Advertise here with FM.

    Why advertise on MAKE?
    Read what folks are saying about us!

    Click here to advertise on MAKE!



    Subscribe to MAKE Magazine!

    Make: Online authors!

    Gareth BranwynGareth Branwyn
    Senior Editor


    Phillip TorronePhillip Torrone
    Senior Editor
    | AIM | Twitter


    Becky SternBecky Stern
    Associate Editor
    | AIM | Twitter


    Marc de VinckMarc de Vinck
    Contributing Writer
    | AIM | Twitter


    John ParkJohn Park
    Contributing Writer
    | Twitter


    Sean RaganSean Ragan
    Contributing Writer
    | Twitter


    Matt MetsMatt Mets
    Contributing Writer
    | AIM | Twitter


    Dale DoughertyDale Dougherty
    Editor & Publisher
    | Twitter


    Shawn ConnallyShawn Connally
    Managing Editor
    | Twitter


    Goli MohammadiGoli Mohammadi
    Associate Managing Editor

    Kip KayKip Kay
    Weekend Projects
    | AIM | Twitter


    Collin CunninghamCollin Cunningham
    Contributing Writer
    | AIM | Twitter

    Adam FlahertyAdam Flaherty
    Contributing Writer
    | AIM | Twitter



    More contributors: Mark Frauenfelder (Editor-in-Chief, MAKE magazine), Kipp Bradford (Technical Consultant/Writer), Chris Connors (Education), Diana Eng (Guest Author), Peter Horvath (Intern), Brian Jepson (O'Reilly Media), Robert Bruce Thompson (Science Room)

    Suggest a Site!

    Current Podcast

    itunesdl.gif Weekend Project: Beetlebot Simple robot from your parts bin that avoids obstacles. Thanks go to Jerome Demers for the original article in MAKE, Volume 12. To download the Beetlebot video, click here or subscribe in iTunes. Check out the complete Beetlebot article... More...

    Get the Make: Online sent via email
    Enter your email to receive Make: Online each day:



    MAKE Fascination video series brought to you by Dow

    Make: Education
    MAKE: en EspaƱol MAKE: Japan
    Important please read


    Subscribe to MAKE Magazine!

    Recent Posts from the Craft: Blog