Imitation learning cart
Game
Game 1Your data
Games recorded 0
You caught –
Train / validation 0 / 0
Play a few games to collect data.
Training
not trainedTrain accuracy –
Validation accuracy –
Network catch rate –
train accuracy validation accuracy network catch rate
Decisions
Your key presses vs the network's choice for the current ball (blank: off the track)
you: left you: coast you: right network, for this ball cart now
Network
positive weight negative weight
data: (s, a) every 0.05 s · a = your key
p(a | s) = softmax(network(s))
loss = −log p(your action | s)
every 5th game is held out for validation