Optimization

Stochastic optimization with momentum: convergence, fluctuations, and traps avoidance

Convergence and Dynamical Behavior of the ADAM Algorithm for Non-Convex Stochastic Optimization

Convergence Rates of a Momentum Algorithm with Bounded Adaptive Step Size for Non-Convex Optimization

Convergence de l'algorithme Adam du point de vue des systèmes dynamiques