This paper introduces PMIndiaSum, a multilingual and massively parallel summarization corpus focused on languages in India. Our corpus provides a training and testing ground for four language families, 14 languages, and the largest to date with 196 language pairs. We detail our construction workflow including data acquisition, processing, and quality assurance. Furthermore, we publish benchmarks for monolingual, cross-lingual, and multilingual summarization by fine-tuning, prompting, as well as translate-and-summarize. Experimental results confirm the crucial role of our data in aiding summarization between Indian languages. Our dataset is publicly available and can be freely modified and re-distributed.
PMIndiaSum: Multilingual and Cross-lingual Headline Summarization for Languages in India
A new multilingual and massively parallel headline summarization corpus for Indian languages, covering four language families and 196 language pairs, with benchmarks for various summarization tasks.
- Year
- 2023
- Venue
- arXiv 2023
- Authors
- 6
- Hosting
- Abstract onlyARXIV-DEFAULT
Cite
Notes
Only stored in your browser.
Attribution
- Abstract & full text
- arxiv.org/abs/2305.08828v2ARXIV-DEFAULT
- TL;DR
- Semantic Scholar