Compare
Leaderboard
Run Benchmark
Methodology
Compare
Leaderboard
Run Benchmark
Methodology
All
None
Top 5
Cosine
Linear
Cosine w/ Restarts
Polynomial (p=2)
Constant
Constant + Warmup
Inverse √
WSD
WSD-Long
OneCycleLR
Exponential
Lucky Pick
RLRS
GreedyLR
DLRS
AECS
REX
Exp Increasing
Scaling Law Optimal
StepLR
Cosine Annealing
Plateau Reduction
CyclicLR (Triangular2)
MNIST Example
Square Root Decay
Validation loss
Mean over seeds, per training step.
Plot
Learning rate schedule
Per-step LR (single seed).
Plot
Train loss
Mean over seeds.
Plot
Final ranking
Horizontal bars — labels never overlap.
Radio
Val loss
Val acc
AUC
Steps
Plot