0

PERL: Pinyin Enhanced Rephrasing Language Model for Chinese ASR N-best Error Correction

Chinese ASR correction is challenging because errors are often \emph{phonetic} (many characters share similar Pinyin) while the correction model must also obey a \emph{length constraint} under noisy N-best hypotheses.

Year
2024
Hosting
Full text hostedCC-BY-4.0

Cite

Notes

Only stored in your browser.

Attribution

Abstract & full text
arxiv.org/abs/2412.03230CC-BY-4.0
TL;DR
Semantic Scholar
Attribution policy →

Abstract

Chinese ASR correction is challenging because errors are often phonetic (many characters share similar Pinyin) while the correction model must also obey a length constraint under noisy N-best hypotheses. Existing approaches either exploit Pinyin only at the prompt/feature level without integrating it into model representations or rely on generative decoding that can drift in length. We propose PERL, a constrained rephrasing pipeline for Chinese N-best ASR correction that (i) predicts the target length and enforces it via mask budgeting, and (ii) fuses semantic and phonetic (Pinyin) representations through token-wise gates conditioned on sentence semantics. Experiments on Aishell-1 and our new domain N-best benchmark DoAD show that PERL consistently reduces CER (29.11% on Aishell-1 and up to \sim70% on DoAD) while maintaining low latency. We also provide analyzes of length generalization and phonetic--semantic interactions, showing when PERL relies on phonetic cues versus semantic constraints.