Adaptive Polyak Step Sizes for Sharpness-Aware Minimization: Theory-Grounded Learning Rate Schedulers

Sharpness-Aware Minimization (SAM) has established itself as a powerful and widely adopted optimizer for training machine learning models. By explicitly minimizing the sharpness of the loss landscape, SAM often improves generalization while delivering str