Optimization
Problem
Problem
Function
Quadratic
Ill-conditioned quadratic
Rotated ill-conditioned quadratic
Rosenbrock
Himmelblau
Beale
Rastrigin
Three-hump camel
Double well
Start x
Start y
Step limit
View
View
Surface
2D
3D
Color scale
log(1 + loss)
Loss
Contours
Plot settings…
Local model
Local model
Optimizer
None
Gradient descent
Adam
BFGS
Newton
Optimizers
Optimizers
All optimizers
Rate schedule
Constant
Step decay
Exponential
1/t
Cosine
Warmup
Gradient noise σ
Each optimizer
Gradient descent
Step size
Momentum
Nesterov
Adagrad
RMSprop
Adam
Step size
Momentum
Sq.-gradient decay
BFGS
Step size
Line search steps
Newton
Step size
Hessian damping
Line search steps
Rosenbrock
log(1 + loss)
Fit
Loading...
y: -2 … 2
x: -2 … 2
Run
Animation speed
Smooth
Instant
steps/s
Step
0
/ 2000