Wearable metadata

Patty Maes of the Fluid Interfaces Group at the MIT Media Lab introduces what may be the must have gadget in the not so far future.

The SixthSense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the user's pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user's hand gestures and physical objects using computer-vision based techniques. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tip of the user's fingers using simple computer-vision techniques. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus SixthSense also supports multi-touch and multi-user interaction.

6thSense.JPG

Thanks Lyle and Susan.

Want to give this system a try? She says it can be made from off the shelf parts for just $350. Post up your ideas in the comments, and show us your stuff in the MAKE Flickr pool.


Recent Entries

Comments

Oldest comments listed first.

Posted by: sleepybrett on March 21, 2009 at 11:16 PM

price

I'm not sure how she arrived at 350$ considering amazon lists just the projector for 300$.

http://www.amazon.com/3M-78-9236-7702-1-Professional-Projector-MPRO110/dp/B001IYDI6K/ref=pd_cp_e_1?pf_rd_p=413863501&pf_rd_s=center-41&pf_rd_t=201&pf_rd_i=B001L4L7AQ&pf_rd_m=ATVPDKIKX0DER&pf_rd_r=03WDZZS0XVM5DA0EAJX8


Posted by: Anonymous on March 22, 2009 at 5:33 AM

a few years after the internet became popular, everyone's got a website

a few years after this goes live, everyone's going to have data tags on their products so people's gadgets can pull up information about it

wonder what people will call it... Teds?, (Let my Ted look that up) hehe


Posted by: Wifigod on March 22, 2009 at 12:12 AM

Open Source?

I really hope they release the software for this under an open source license. This platform would benefit greatly if everybody was allowed to contribute. If not, I think an alternative open source project would definitely be created and end up surpassing the usability of the MIT version.


Posted by: Silverman on March 22, 2009 at 7:52 AM

We need more videos where the graduate student gets a standing ovation at his advisor's presentation.


Posted by: Monica N on March 22, 2009 at 12:54 PM

This would probably be better if they found a way to not have to use a phone. It would make it cheaper and the system would be able to stand alone.


Posted by: ted on March 23, 2009 at 1:40 AM

wow... with my name being Ted and all, this looks cool (and a bit scary all at the same time.


Posted by: Mark L on March 25, 2009 at 8:52 PM

So, let's open up the discussion again: Does technology like this make us smarter or dumber?


Leave a comment


Subscribe to MAKE!Subscribe to MAKE Magazine!

Subscribe today, save 42% and get web access to MAKE free. MAKE Digital Edition is available only to subscribers.

$34.95 / 1 year
(4 Quarterly Issues)

Subscribe now


Void your warranty, violate a user agreement, fry a circuit, blow a fuse, poke an eye out. Make: The risk-takers, the doers, the makers of things... Welcome to Make: Online!


CRAFT Maker Shed Maker Faire MAKE television
MAKE: en EspaƱol MAKE: Japan


Check out all of the episodes of Make: television

Make: Science Room

Connect with MAKE

Be a MAKE fan on Facebook MAKE on Facebook
Visit our Facebook page and become a fan of MAKE!
MAKE on Twitter MAKE on Twitter
Follow our MAKE tweets!
MAKE Flickr Pool MAKE on Flickr
Join our MAKE Flickr Pool!
    make_tips on Twitter

    MAKE's RSS feed is here.
    Add MAKE to iGoogle - GoogleGoogle.
    How to add MAKE to your RSS reader - Real simple.
    Add MAKE on FriendFeed




    Maker SHED

    Advertise here with FM.

    Why advertise on MAKE?
    Read what folks are saying about us!

    Click here to advertise on MAKE!



    Subscribe to MAKE Magazine!

    Make: Online authors!

    Gareth BranwynGareth Branwyn
    Senior Editor


    Phillip TorronePhillip Torrone
    Senior Editor
    | AIM | Twitter


    Becky SternBecky Stern
    Associate Editor
    | AIM | Twitter


    Marc de VinckMarc de Vinck
    Contributing Writer
    | AIM | Twitter


    John ParkJohn Park
    Contributing Writer
    | Twitter


    Sean RaganSean Ragan
    Contributing Writer
    | Twitter


    Matt MetsMatt Mets
    Contributing Writer
    | AIM | Twitter


    Dale DoughertyDale Dougherty
    Editor & Publisher
    | Twitter


    Shawn ConnallyShawn Connally
    Managing Editor
    | Twitter


    Goli MohammadiGoli Mohammadi
    Associate Managing Editor

    Kip KayKip Kay
    Weekend Projects
    | AIM | Twitter


    Collin CunninghamCollin Cunningham
    Contributing Writer
    | AIM | Twitter

    Adam FlahertyAdam Flaherty
    Contributing Writer
    | AIM | Twitter



    More contributors: Mark Frauenfelder (Editor-in-Chief, MAKE magazine), Kipp Bradford (Technical Consultant/Writer), Chris Connors (Education), Diana Eng (Guest Author), Peter Horvath (Intern), Brian Jepson (O'Reilly Media), Robert Bruce Thompson (Science Room)

    Suggest a Site!

    Current Podcast

    itunesdl.gif Weekend Project: Making Char Cloth Learn how to make a cheap and effective fire starter made from an old t-shirt. To download The Char Cloth video click here and subscribe in iTunes. See Char Cloth in action with the Fire Piston from William Gurstelle.... More...

    Get the Make: Online sent via email
    Enter your email to receive Make: Online each day:



    MAKE Fascination video series brought to you by Dow

    Make: Education

    Important please read


    Subscribe to MAKE Magazine!

    Recent Posts from the Craft: Blog