0

Data Centric Domain Adaptation for Historical Text with OCR Errors

The paper presents novel methods for Named Entity Recognition in historical Dutch and French data, addressing domain shift and OCR errors using contextualized embeddings and synthetic error injection, achieving state-of-the-art results.

Year
2021
Venue
arXiv 2021
Authors
5
Hosting
Abstract onlyARXIV-DEFAULT

Cite

Notes

Only stored in your browser.

Attribution

Abstract & full text
arxiv.org/abs/2107.00927ARXIV-DEFAULT
TL;DR
Semantic Scholar
Attribution policy →

Abstract

We propose new methods for in-domain and cross-domain Named Entity Recognition (NER) on historical data for Dutch and French. For the cross-domain case, we address domain shift by integrating unsupervised in-domain data via contextualized string embeddings; and OCR errors by injecting synthetic OCR errors into the source domain and address data centric domain adaptation. We propose a general approach to imitate OCR errors in arbitrary input data. Our cross-domain as well as our in-domain results outperform several strong baselines and establish state-of-the-art results. We publish preprocessed versions of the French and Dutch Europeana NER corpora.

Authors

5