We propose new methods for in-domain and cross-domain Named Entity Recognition (NER) on historical data for Dutch and French. For the cross-domain case, we address domain shift by integrating unsupervised in-domain data via contextualized string embeddings; and OCR errors by injecting synthetic OCR errors into the source domain and address data centric domain adaptation. We propose a general approach to imitate OCR errors in arbitrary input data. Our cross-domain as well as our in-domain results outperform several strong baselines and establish state-of-the-art results. We publish preprocessed versions of the French and Dutch Europeana NER corpora.
Data Centric Domain Adaptation for Historical Text with OCR Errors
The paper presents novel methods for Named Entity Recognition in historical Dutch and French data, addressing domain shift and OCR errors using contextualized embeddings and synthetic error injection, achieving state-of-the-art results.
- Year
- 2021
- Venue
- arXiv 2021
- Authors
- 5
- Hosting
- Abstract onlyARXIV-DEFAULT
Cite
Notes
Only stored in your browser.
Attribution
- Abstract & full text
- arxiv.org/abs/2107.00927ARXIV-DEFAULT
- TL;DR
- Semantic Scholar