Exploration vs exploitation, by hand
Pull the levers
Ten machines, each paying out (a click) at a hidden rate. You get a hundred pulls. Explore too little and you may never find the best machine; explore too much and you waste pulls. Then turn on delayed feedback and feel why the coursework cared about it.
Pulls left
100 / 100
Clicks seen
0
Feedback delay
Recent pulls
Pull any lever to start. You have 100 pulls; try to find the best machine without wasting them.
This page plays bandits live. The lab evaluates them the coursework way, by replaying a logged dataset.