Current Q-values

Episode 1
Q(s, a) being updated maxa′ Q(s′, a′): the largest value where it landed (an exit: its reward), used in the target

Q(s, a) ← Q(s, a) + α[R(s) + γ maxa′ Q(s′, a′) − Q(s, a)]