Game

Episode 1

← Left
Coast
Right →
L = mean min(ρA, clip(ρ, 1−ε, 1+ε)A) + βH(π)
ρ = π(a | s) / πold(a | s) · maximize L