0

MonaLog: a Lightweight System for Natural Language Inference Based on Monotonicity

MonaLog, a lightweight logic-based inference engine, demonstrates competitive performance on NLI tasks and enhances BERT's accuracy through data augmentation.

Year
2019
Venue
SCiL 2020 1
Authors
6
Hosting
Abstract onlyARXIV-DEFAULT

Cite

Notes

Only stored in your browser.

Attribution

Abstract & full text
arxiv.org/abs/1910.08772ARXIV-DEFAULT
TL;DR
Semantic Scholar
Attribution policy →

Abstract

We present a new logic-based inference engine for natural language inference (NLI) called MonaLog, which is based on natural logic and the monotonicity calculus. In contrast to existing logic-based approaches, our system is intentionally designed to be as lightweight as possible, and operates using a small set of well-known (surface-level) monotonicity facts about quantifiers, lexical items and tokenlevel polarity information. Despite its simplicity, we find our approach to be competitive with other logic-based NLI models on the SICK benchmark. We also use MonaLog in combination with the current state-of-the-art model BERT in a variety of settings, including for compositional data augmentation. We show that MonaLog is capable of generating large amounts of high-quality training data for BERT, improving its accuracy on SICK.

Authors

6