0

Ordinal-Aware Calibration for Ordinal Classification

Deep neural networks frequently produce overconfident, miscalibrated predictions. In ordinal classification, predictions must also adhere to a unimodal and order-consistent structure, a requirement that has dominated prior work while overlooking calibration.

Year
2024
Hosting
Excerpt onlyCC-BY-NC-SA-4.0

Cite

Notes

Only stored in your browser.

Attribution

Abstract & full text
arxiv.org/abs/2410.15658CC-BY-NC-SA-4.0
TL;DR
Semantic Scholar
Attribution policy →

Abstract

Deep neural networks frequently produce overconfident, miscalibrated predictions. In ordinal classification, predictions must also adhere to a unimodal and order-consistent structure, a requirement that has dominated prior work while overlooking calibration. We formalize this joint challenge as ordinal calibration for the first time and propose the Ordinal loss for Calibration and Unimodality (ORCU). Unlike incremental modular combinations, ORCU provides a concise, principled unification of distance-aware soft encoding and an ordinal-aware log-barrier extension on adjacent logit gaps. This coupling is theoretically synergetic: soft-encoded targets pre-condition the optimization landscape by providing a finite, full-support ordinal anchor for well-posed refinement, while the log-barrier extension preserves non-vanishing adjacent-gap gradients in the unimodality-feasible interior. This enables the log-barrier to refine confidence without disrupting the ordinal geometry. ORCU requires no architectural changes or post-hoc calibration. Across four ordinal benchmarks, it achieves state-of-the-art calibration without compromising accuracy. We establish a new reliability standard by providing a reproducible benchmark over 10 specialized and general-purpose loss functions. Our code is available at https://github.com/labhai/ORCU.