0

Damped Newton Method with Near-Optimal Global Oleft(k^{-3} right) Convergence Rate

This paper investigates the global convergence of stepsized Newton methods for convex functions.

Year
2024
Venue
arXiv 2024
Authors
3
Hosting
Abstract onlyARXIV-DEFAULT

Cite

Notes

Only stored in your browser.

Attribution

Abstract & full text
arxiv.org/abs/2405.18926ARXIV-DEFAULT
TL;DR
Semantic Scholar
Attribution policy →

Abstract

This paper investigates the global convergence of stepsized Newton methods for convex functions. We propose several simple stepsize schedules with fast global convergence guarantees, up to O (k^{-3}), nearly matching lower complexity bounds Omega (k^{-3.5}) of second-order methods. For cases with multiple plausible smoothness parameterizations or an unknown smoothness constant, we introduce a stepsize backtracking procedure that ensures convergence as if the optimal smoothness parameters were known.

Authors

3