0

DefSent: Sentence Embeddings using Definition Sentences

DefSent, a sentence embedding method using definition sentences from word dictionaries, performs comparably on STS tasks and slightly better on SentEval tasks than conventional NLI dataset-based methods, offering broader language applicability.

Year
2021
Venue
ACL 2021 5
Authors
3
Hosting
Abstract onlyARXIV-DEFAULT

Cite

Notes

Only stored in your browser.

Attribution

Abstract & full text
arxiv.org/abs/2105.04339v3ARXIV-DEFAULT
TL;DR
Semantic Scholar
Attribution policy →

Abstract

Sentence embedding methods using natural language inference (NLI) datasets have been successfully applied to various tasks. However, these methods are only available for limited languages due to relying heavily on the large NLI datasets. In this paper, we propose DefSent, a sentence embedding method that uses definition sentences from a word dictionary, which performs comparably on unsupervised semantics textual similarity (STS) tasks and slightly better on SentEval tasks than conventional methods. Since dictionaries are available for many languages, DefSent is more broadly applicable than methods using NLI datasets without constructing additional datasets. We demonstrate that DefSent performs comparably on unsupervised semantics textual similarity (STS) tasks and slightly better on SentEval tasks to the methods using large NLI datasets. Our code is publicly available at https://github.com/hpprc/defsent .

Authors

3