0

When Kernel Ridge Regression Meets the Hölder-Zygmund Class: Minimax Optimality and Failure of Properness

We study kernel ridge regression for nonparametric regression over the Hölder-Zygmund class. Using an RKHS equivalent to a Sobolev space of smoothness s+d/2, we prove that misspecified KRR attains the minimax L2 rate n^{-2s/(2s+d)}.

Open
Preview
Year
2026
ArXiv
arxiv.org/abs/2607.26065
Hosting
Abstract onlyARXIV-DEFAULT

Cite

Notes

Only stored in your browser.

Attribution

Abstract & full text
arxiv.org/abs/2607.26065ARXIV-DEFAULT
TL;DR
Semantic Scholar
Attribution policy →

Abstract

We study kernel ridge regression for nonparametric regression over the Hölder-Zygmund class. Using an RKHS equivalent to a Sobolev space of smoothness s+d/2, we prove that misspecified KRR attains the minimax L2 rate n^{-2s/(2s+d)}. We also show that properness fails in the Hölder-Zygmund norm: even for the zero regression function with Gaussian noise, the expected squared Hölder-Zygmund norm of the KRR noise component grows as log n.