Tic-Tac-Toe computer learns with beans

menace_tic_tac_toe.jpg

James Bridle built this version of Donald Michie's Tic-Tac-Toe solving computer, MENACE (Matchbox Educable Noughts And Crosses Engine). Not what one would think of as a typical 'computer', the instruction to choose the next move is performed by the user. To do this, they select a bead at random from the matchbox that represents the current game state. The type of bead then represents the move that the computer makes.

At first, the machine has an equal chance of making each possible move, but this is corrected by adding or removing beans at the end of each round. The way this works is that if the computer won the round, an extra bean of the same type played is added to each box involved in that round, to make it more likely that the computer will choose the same path on the next game. Likewise, beans are removed from the path if the computer loses, to decrease the chance that it chooses that path next time. This way, the computer slowly 'learns' to play the game correctly, merely by counting beans.

James uses this algorithm to demonstrate the awesomeness of scale. This strategy should work for learning any game, however it quickly becomes infeasible to make a set of matchbooks large enough to represent anything but the simplest game. For instance, he estimates that a computer to play the game Go would be at least the size of the Crab Nebula!

If you are curious, there is a (Windows only) simulator of MENICE here. [via boingboing]


Recent Entries

Comments

Oldest comments listed first.

Posted by: Joel on November 3, 2009 at 1:59 PM

related content - see Hexapawn

Martin Gardner wrote a column in Scientific American detailing a similar computer for playing "Hexapawn," a simple chess variant. MENACE predates it

http://en.wikipedia.org/wiki/Hexapawn
http://www.chessvariants.org/small.dir/hexapawn.html

Fred Saberhagen described a similar game played by a bead driven computer in "Without a Thought."


Posted by: screaminscott on November 3, 2009 at 2:41 PM

Berserker?

I seem to remember something like this being a plot device in a short sci-fi story.

A spaceship pilot used this method to teach an animal (think of a cross between a chimpanzee and a dog) to play this game. The game was supposed to be a bit more complicated than tic-tac-toe, but it used the same method (except using colored beads instead of beans).

Aha, I found it! "Without a Thought" by Fred Saberhagen


Posted by: Matt Mets on November 6, 2009 at 7:33 AM

If you use animals, then I think it becomes biological computing! I wonder if anyone is doing this with bacteria.


Posted by: Jack on November 4, 2009 at 6:30 AM

Old school

I remember doing this when I was a kid (50+ years ago?) with my dad. We followed a process, and used colored M&M's in match boxes. As the 'machine' learned, we 'ate the mistakes'. Eventually it couldn't be beat. But it could be tied, if I remember right.


Posted by: Matt Mets on November 4, 2009 at 9:34 AM

Aha, it seems like one could use this technique to build a computer that determines the tastiest kind of candy!


Leave a comment


Subscribe to MAKE!Subscribe to MAKE Magazine!

Subscribe today, save 42% and get web access to MAKE free. MAKE Digital Edition is available only to subscribers.

$34.95 / 1 year
(4 Quarterly Issues)

Subscribe now


Void your warranty, violate a user agreement, fry a circuit, blow a fuse, poke an eye out. Make: The risk-takers, the doers, the makers of things... Welcome to Make: Online!


CRAFT Maker Shed Maker Faire MAKE television
Holiday Gift Guides from MAKE
Gifts for Dads
Science and Chemistry
Gifts Under $20
More guides: Santa Claus Machines, Geek Toys for Grown Up Girls & Boys


Check out all of the episodes of Make: television

Alex Rider Dream Gadget Contest
Make: Science Room

Connect with MAKE

Be a MAKE fan on Facebook MAKE on Facebook
Visit our Facebook page and become a fan of MAKE!
MAKE on Twitter MAKE on Twitter
Follow our MAKE tweets!
MAKE Flickr Pool MAKE on Flickr
Join our MAKE Flickr Pool!
    make_tips on Twitter




    Maker SHED

    Advertise here with FM.

    Why advertise on MAKE?
    Read what folks are saying about us!

    Click here to advertise on MAKE!



    Subscribe to MAKE Magazine!

    Make: Online authors!

    Gareth BranwynGareth Branwyn
    Senior Editor


    Phillip TorronePhillip Torrone
    Senior Editor
    | AIM | Twitter


    Becky SternBecky Stern
    Associate Editor
    | AIM | Twitter


    Marc de VinckMarc de Vinck
    Contributing Writer
    | AIM | Twitter


    John ParkJohn Park
    Contributing Writer
    | Twitter


    Sean RaganSean Ragan
    Contributing Writer
    | Twitter


    Matt MetsMatt Mets
    Contributing Writer
    | AIM | Twitter


    Dale DoughertyDale Dougherty
    Editor & Publisher
    | Twitter


    Shawn ConnallyShawn Connally
    Managing Editor
    | Twitter


    Goli MohammadiGoli Mohammadi
    Associate Managing Editor

    Kip KayKip Kay
    Weekend Projects
    | AIM | Twitter


    Collin CunninghamCollin Cunningham
    Contributing Writer
    | AIM | Twitter

    Adam FlahertyAdam Flaherty
    Contributing Writer
    | AIM | Twitter



    More contributors: Mark Frauenfelder (Editor-in-Chief, MAKE magazine), Kipp Bradford (Technical Consultant/Writer), Chris Connors (Education), Diana Eng (Guest Author), Peter Horvath (Intern), Brian Jepson (O'Reilly Media), Robert Bruce Thompson (Science Room)

    Suggest a Site!

    Current Podcast

    itunesdl.gif Weekend Project: Beetlebot Simple robot from your parts bin that avoids obstacles. Thanks go to Jerome Demers for the original article in MAKE, Volume 12. To download the Beetlebot video, click here or subscribe in iTunes. Check out the complete Beetlebot article... More...

    Get the Make: Online sent via email
    Enter your email to receive Make: Online each day:



    MAKE Fascination video series brought to you by Dow

    Make: Education
    MAKE: en EspaƱol MAKE: Japan
    Important please read


    Subscribe to MAKE Magazine!

    Recent Posts from the Craft: Blog