Nintendo controllers as musical instruments

glove_interface_guts.jpgJeff Hoefs is doing some really amazing hacks and mods with Nintendo controllers. He's made PowerPad midi keyboards, PowerGlove music controllers and Nintendo Uforce controllers to create music. All at once too! He sent this overview in of what's what he's up to, along with some great photos of the mods in action!




Nintendo controllers as musical instruments - Jeff Hoefs
I spotted a Nintendo PowerPad at a thrift store a couple of years ago and thought it would make an interesting midi keyboard. Hacking this controller was fairly simple. Inside are two 4021 8-channel parallel to serial converters. 8 pads are wired to one of the ICs and the remaining 4 pads are wired to the other. I used a microcontroller to convert the status of the shift register into midi data. My midi converter also has 2 pots - one to change octaves (including a position that will keymap to my drum machine) and another to set the midi velocity (volume). With this interface, the pad can be connected to a synthesizer, drum machine, or to a computer.

padnglove_action1.jpg

padnglove_action2.jpg


After getting the glove to work I thought it would be cool to use a PowerGlove as a musical controller as well. I purchased a used glove on eBay and found a timing diagram and some C code on the Internet that I used to write an assembly routine to access the glove's analog data (hires mode) and send it via serial to a computer. After I got the glove working I tried using it for everything from controlling filter parameters, to punching out beats, a virtual keyboard, and even a 'battle' with a DJ. Unfortunately due to the amount of time it takes to output all 12 of the glove's data packets, it is not the best controller for timing critical functions like playing notes or manipulating filter parameters.

glove_interface_guts.jpg

glove_interfaceb.jpg

nintendo_midi_interface.jpg

I was using the glove and pad simultaneously in a band. The best function of the glove was the buttons on the wrist. I created a program that allowed me to use the glove's button data to select sample banks, filter parameters, and switch between various uses for the xyz and finger data. For example, in one mode I could make a fist and dance out a simple beat on the pad, then when I opened my hand, the beat would continue as a loop, I could then add additional layers to the loop by repeating the process. By pressing another button or combination of buttons on the wrist I could then select another mode such as the virtual record-scratching mode to battle with the band's DJ.

nintendo_midi.jpg

I also found a couple of Nintendo Uforce controllers (horizontal and vertical planes of infrared sensors) so I made another midi interface that could be used to input data from both Uforces, a PowerPad, and a standard NES controller simultaneously. I even used the actual sockets from old NES consoles so I didn't have to add my own plugs to the controllers. As is, this system cannot directly used with a synthesizer, it has to work with a program that allows custom mapping of midi data (Max, PD, Supercollider, etc.). However, the code could be rewritten the code to allow direct connection - that's the beauty of the DIY world.

uforces.jpg

uforce_use.jpg


Recent Entries

Comments

Oldest comments listed first.

Posted by: SIGNALswp on April 20, 2005 at 8:37 AM

i think this is really fantastic! i find it very strange that not more than two days ago i was imagining something exactly like this... AND HERE IT IS!

i've got to get to work on some of my own


Posted by: heycomet on April 20, 2005 at 5:49 PM

very cool yes, but at what cost? i promise you this guy isn't getting any poonanny for the next 13 years. not so cool after all!


Posted by: dudical on April 21, 2005 at 8:14 AM

This is what technology should be used for. I


Posted by: j4r3d on April 21, 2005 at 6:26 PM

OMG. I LOVE Ninetendo's Powerpad. I played with it sooooo much when I was younger. I remember playing the this skateboarding game and World Class Track Meet. Ahhh, memories.


Posted by: snoiky on April 23, 2005 at 10:07 AM

you said that you can make a fist, record a loop on the pad, and then release your fist to keep the loop going.

What software do you use to make it loop in realtime? I saw Kid Beyond doing that one time and I've always wanted to myself.


Posted by: rampancy on July 27, 2005 at 6:21 PM

any diagrams to do this? is it based off of an open midi converter design?
i would love to be able to use a standard nintendo controller to control a midi device but i dare not try it on my own.

jeff hoef give us some details


Leave a comment


Subscribe to MAKE!Subscribe to MAKE Magazine!

Subscribe today, save 42% and get web access to MAKE free. MAKE Digital Edition is available only to subscribers.

$34.95 / 1 year
(4 Quarterly Issues)

Subscribe now


Void your warranty, violate a user agreement, fry a circuit, blow a fuse, poke an eye out. Make: The risk-takers, the doers, the makers of things... Welcome to Make: Online!


CRAFT Maker Shed Maker Faire MAKE television
Holiday Gift Guides from MAKE
Gifts for Dads
Science and Chemistry
Gifts Under $20
More guides: Santa Claus Machines, Geek Toys for Grown Up Girls & Boys


Check out all of the episodes of Make: television

Alex Rider Dream Gadget Contest
Make: Science Room

Connect with MAKE

Be a MAKE fan on Facebook MAKE on Facebook
Visit our Facebook page and become a fan of MAKE!
MAKE on Twitter MAKE on Twitter
Follow our MAKE tweets!
MAKE Flickr Pool MAKE on Flickr
Join our MAKE Flickr Pool!
    make_tips on Twitter




    Maker SHED

    Advertise here with FM.

    Why advertise on MAKE?
    Read what folks are saying about us!

    Click here to advertise on MAKE!



    Subscribe to MAKE Magazine!

    Make: Online authors!

    Gareth BranwynGareth Branwyn
    Senior Editor


    Phillip TorronePhillip Torrone
    Senior Editor
    | AIM | Twitter


    Becky SternBecky Stern
    Associate Editor
    | AIM | Twitter


    Marc de VinckMarc de Vinck
    Contributing Writer
    | AIM | Twitter


    John ParkJohn Park
    Contributing Writer
    | Twitter


    Sean RaganSean Ragan
    Contributing Writer
    | Twitter


    Matt MetsMatt Mets
    Contributing Writer
    | AIM | Twitter


    Dale DoughertyDale Dougherty
    Editor & Publisher
    | Twitter


    Shawn ConnallyShawn Connally
    Managing Editor
    | Twitter


    Goli MohammadiGoli Mohammadi
    Associate Managing Editor

    Kip KayKip Kay
    Weekend Projects
    | AIM | Twitter


    Collin CunninghamCollin Cunningham
    Contributing Writer
    | AIM | Twitter

    Adam FlahertyAdam Flaherty
    Contributing Writer
    | AIM | Twitter



    More contributors: Mark Frauenfelder (Editor-in-Chief, MAKE magazine), Kipp Bradford (Technical Consultant/Writer), Chris Connors (Education), Diana Eng (Guest Author), Peter Horvath (Intern), Brian Jepson (O'Reilly Media), Robert Bruce Thompson (Science Room)

    Suggest a Site!

    Current Podcast

    itunesdl.gif Weekend Project: Beetlebot Simple robot from your parts bin that avoids obstacles. Thanks go to Jerome Demers for the original article in MAKE, Volume 12. To download the Beetlebot video, click here or subscribe in iTunes. Check out the complete Beetlebot article... More...

    Get the Make: Online sent via email
    Enter your email to receive Make: Online each day:



    MAKE Fascination video series brought to you by Dow

    Make: Education
    MAKE: en EspaƱol MAKE: Japan
    Important please read


    Subscribe to MAKE Magazine!

    Recent Posts from the Craft: Blog