Large language models (LLMs) have been widely applied across various domains of finance. Since their training data are largely derived from human-authored corpora, LLMs may inherit a range of human biases. Behavioral biases can lead to instability and uncertainty in decision-making, particularly when processing financial information. However, existing research on LLM bias has mainly focused on direct questioning or simplified, general-purpose settings, with limited consideration of the complex real-world financial environments and high-risk, context-sensitive, multilingual financial misinformation detection tasks (\mfmd). In this work, we propose \mfmdscen, a comprehensive benchmark for evaluating behavioral biases of LLMs in \mfmd across diverse economic scenarios. In collaboration with financial experts, we construct three types of complex financial scenarios: (i) role- and personality-based, (ii) role- and region-based, and (iii) role-based scenarios incorporating ethnicity and religious beliefs. We further develop a multilingual financial misinformation dataset covering English, Chinese, Greek, and Bengali. By integrating these scenarios with misinformation claims, \mfmdscen enables a systematic evaluation of 22 mainstream LLMs. Our findings reveal that pronounced behavioral biases persist across both commercial and open-source models. This project will be available at https://github.com/lzw108/FMD.
Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detection
A comprehensive benchmark evaluates behavioral biases in large language models for multilingual financial misinformation detection across diverse economic scenarios.
- Year
- 2026
- Venue
- arXiv 2026
- Authors
- 25
- Hosting
- Abstract onlyARXIV-DEFAULT
Cite
Notes
Only stored in your browser.
Attribution
- Abstract & full text
- arxiv.org/abs/2601.05403ARXIV-DEFAULT
- TL;DR
- Semantic Scholar
Abstract
Authors
25Ye YuanXue LiuYan WangZhiwei LiuYuechen JiangAlejandro Lopez-LiraJimin HuangZiyang XuPrayag TiwariSophia AnaniadouChen XuLingfei QianXueqing PengMohsinul KabirZhuohan XiePaul ThompsonYupen CaoPolydoros GiannourisTianlei ZhuTariquzzaman FaisalTriantafillos PapadopoulosSaeed AlmheiriAbdulrazzaq AlnajjarMingbin ChenHarry Stuart