mscroggs.co.uk
mscroggs.co.uk

subscribe

Blog

 2017-11-14 
A few weeks ago, I took the copy of MENACE that I built to Manchester Science Festival, where it played around 300 games against the public while learning to play Noughts and Crosses. The group of us operating MENACE for the weekend included Matt Parker, who made two videos about it. Special thanks go to Matt, plus Katie Steckles, Alison Clarke, Andrew Taylor, Ashley Frankland, David Williams, Paul Taylor, Sam Headleand, Trent Burton, and Zoe Griffiths for helping to operate MENACE for the weekend.
As my original post about MENACE explains in more detail, MENACE is a machine built from 304 matchboxes that learns to play Noughts and Crosses. Each box displays a possible position that the machine can face and contains coloured beads that correspond to the moves it could make. At the end of each game, beads are added or removed depending on the outcome to teach MENACE to play better.

Saturday

On Saturday, MENACE was set up with 8 beads of each colour in the first move box; 3 of each colour in the second move boxes; 2 of each colour in third move boxes; and 1 of each colour in the fourth move boxes. I had only included one copy of moves that are the same due to symmetry.
The plot below shows the number of beads in MENACE's first box as the day progressed.

Sunday

Originally, we were planning to let MENACE learn over the course of both days, but it learned more quickly than we had expected on Saturday, so we reset is on Sunday, but set it up slightly differently. On Sunday, MENACE was set up with 4 beads of each colour in the first move box; 3 of each colour in the second move boxes; 2 of each colour in third move boxes; and 1 of each colour in the fourth move boxes. This time, we left all the beads in the boxes and didn't remove any due to symmetry.
The plot below shows the number of beads in MENACE's first box as the day progressed.

The data

You can download the full set of data that we collected over the weekend here. This includes the first two moves and outcomes of all the games over the two days, plus the number of beads in each box at the end of each day. If you do something interesting (or non-interesting) with the data, let me know!

Similar posts

MENACE
Visualising MENACE's learning
Building MENACEs for other games
MENACE in fiction

Comments

Comments in green were written by me. Comments in blue were not written by me.
WRT the comment 2017-11-17, and exactly one year later, I had the same thing happen whilst running MENACE in a 'Resign' loop for a few hours, unattended. When I returned, the orange overlay had appeared, making the screen quite difficult to read on an iPad.
g0mrb
                 Reply
On the JavaScript version, MENACE2 (a second version of MENACE which learns in the same way, to play against the original) keeps setting the 6th move as NaN, meaning it cannot function. Is there a fix for this?
Lambert
                 Reply
what would happen if you loaded the boxes slightly differently. if you started with one bead corresponding to each move in each box. if the bead caused the machine to lose you remove only that bead. if the game draws you leave the bead in play if the bead causes a win you put an extra bead in each of the boxes that led to the win. if the box becomes empty you remove the bead that lead to that result from the box before
Ian
                 Reply
Hi, I was playing with MENACE, and after a while the page redrew with a Dragon Curves design over the top. MENACE was still working alright but it was difficult to see what I was doing due to the overlay. I did a screen capture of it if you want to see it.
Russ
                 Reply
 Add a Comment 


I will only use your email address to reply to your comment (if a reply is needed).

Allowed HTML tags: <br> <a> <small> <b> <i> <s> <sup> <sub> <u> <spoiler> <ul> <ol> <li>
To prove you are not a spam bot, please type "linear" in the box below (case sensitive):

Archive

Show me a random blog post
 2020 

Jul 2020

Happy τ+e-8 Approximation Day!

May 2020

A surprising fact about quadrilaterals
Interesting tautologies

Mar 2020

Log-scaled axes

Feb 2020

PhD thesis, chapter ∞
PhD thesis, chapter 5
PhD thesis, chapter 4
PhD thesis, chapter 3
Inverting a matrix
PhD thesis, chapter 2

Jan 2020

PhD thesis, chapter 1
Gaussian elimination
Matrix multiplication
Christmas (2019) is over
 2019 
▼ show ▼
 2018 
▼ show ▼
 2017 
▼ show ▼
 2016 
▼ show ▼
 2015 
▼ show ▼
 2014 
▼ show ▼
 2013 
▼ show ▼
 2012 
▼ show ▼

Tags

machine learning london tennis trigonometry world cup noughts and crosses go reuleaux polygons error bars martin gardner ucl graphs bempp python weak imposition christmas folding paper chalkdust magazine stickers curvature pythagoras royal baby realhats games computational complexity menace cross stitch bubble bobble draughts programming final fantasy chebyshev books boundary element methods matt parker probability matrix of minors preconditioning gerry anderson sound pac-man ternary speed football golden ratio graph theory exponential growth advent calendar accuracy simultaneous equations determinants statistics geometry triangles game of life rhombicuboctahedron captain scarlet inline code countdown wave scattering coins palindromes interpolation propositional calculus map projections dates pi approximation day talking maths in public polynomials the aperiodical geogebra logs hats radio 4 asteroids video games big internet math-off european cup light game show probability sport latex manchester twitter raspberry pi misleading statistics christmas card nine men's morris matrix of cofactors chess national lottery sobolev spaces oeis plastic ratio bodmas matrices flexagons reddit hannah fry cambridge puzzles weather station dragon curves frobel people maths news binary matrix multiplication rugby royal institution wool mathsteroids hexapawn inverse matrices pizza cutting data visualisation london underground squares numerical analysis phd mathsjam quadrilaterals platonic solids mathslogicbot data electromagnetic field php golden spiral finite element method gaussian elimination sorting javascript approximation fractals arithmetic tmip dataset a gamut of games braiding manchester science festival convergence logic craft estimation folding tube maps harriss spiral pi signorini conditions

Archive

Show me a random blog post
▼ show ▼
© Matthew Scroggs 2012–2020