0

Active Learning for Argument Strength Estimation

Uncertainty-based active learning methods do not improve accuracy over random selection for predicting argument quality in data sets with high annotation effort.

Year
2021
Venue
EMNLP (insights) 2021 11
Authors
4
Hosting
Abstract onlyARXIV-DEFAULT

Cite

Notes

Only stored in your browser.

Attribution

Abstract & full text
arxiv.org/abs/2109.11319ARXIV-DEFAULT
TL;DR
Semantic Scholar
Attribution policy →

Abstract

High-quality arguments are an essential part of decision-making. Automatically predicting the quality of an argument is a complex task that recently got much attention in argument mining. However, the annotation effort for this task is exceptionally high. Therefore, we test uncertainty-based active learning (AL) methods on two popular argument-strength data sets to estimate whether sample-efficient learning can be enabled. Our extensive empirical evaluation shows that uncertainty-based acquisition functions can not surpass the accuracy reached with the random acquisition on these data sets.

Authors

4