Karthik Narasimhan

IMPersona: Evaluating Individual Level LM Impersonation

arXiv 2025

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

ICLR

τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

preprint

EnIGMA: Enhanced Interactive Generative Model Agent for CTF Challenges

arXiv 2024

Can Language Models Solve Olympiad Programming?

arXiv 2024

Tree of Thoughts: Deliberate Problem Solving with Large Language Models

tree-of-thoughts-deliberate-problem-solving

Reflexion: Language Agents with Verbal Reinforcement Learning

NeurIPS 2023 11

GEO: Generative Engine Optimization

arXiv 2023

COLLIE: Systematic Construction of Constrained Text Generation Tasks

arXiv 2023

InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedback

NeurIPS 2023 11

C-STS: Conditional Semantic Textual Similarity

arXiv 2023

MUX-PLMs: Data Multiplexing for High-throughput Language Models

arXiv 2023

SemSup-XC: Semantic Supervision for Zero and Few-shot Extreme Classification

arXiv 2023

Cognitive Architectures for Language Agents

arXiv 2023

PruMUX: Augmenting Data Multiplexing with Model Compression

arXiv 2023

WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents

arXiv 2022

DataMUX: Data Multiplexing for Neural Networks

arXiv 2022

ReAct: Synergizing Reasoning and Acting in Language Models

arXiv 2022

SILG: The Multi-environment Symbolic Interactive Language Grounding Benchmark

arXiv 2021

Learning Rewards from Linguistic Feedback

arXiv 2020

Improving Dialog Systems for Negotiation with Personality Modeling

ACL 2021 5

Shunyu Yao

researcher

Carlos E. Jimenez

Vishvak Murahari

Ameet Deshpande

John Yang

grad-student

Howard Chen

Izhak Shafran

Runzhe Yang

Thomas L. Griffiths

Yuan Cao