Dirk Hovy

IssueBench: Millions of Realistic Prompts for Measuring Issue Bias in LLM Writing Assistance

arXiv 2025

Can Reasoning Help Large Language Models Capture Human Annotator Disagreement?

arXiv 2025

MSTS: A Multimodal Safety Test Suite for Vision-Language Models

arXiv 2025

Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models

arXiv 2024

"My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models

arXiv 2024

DADIT: A Dataset for Demographic Classification of Italian Twitter Users and a Comparison of Prediction Methods

arXiv 2024

Explaining Speech Classification Models via Word-Level Audio Segments and Paralinguistic Features

arXiv 2023

Towards Human-Level Text Coding with LLMs: The Case of Fatherhood Roles in Public Policy Documents

arXiv 2023

XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models

arXiv 2023

Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists

Findings (ACL) 2022 5

Paul Röttger

Giuseppe Attanasio

Bertie Vidgen

Donya Rooein

Elena Baralis

Hannah Rose Kirk

Lorenzo Lupo

Musashi Hinck

Valentin Hofmann

Valentina Pyatkin

research-scientist