0

Princeton University

Private R1 university in NJ; Princeton CS, Princeton NLP, and PLI host major LLM and agent research.

Visit
Type
university lab
HQ
Princeton, NJ, USA
Founded
1746
Funding
Private non-profit; NSF, DARPA, industry partners; large endowment
Website
princeton.edu
GitHub
github.com/princeton-nlp

Cite

Notes

Only stored in your browser.

Evals
6
Tools
0
Models
0
Papers
0
Boards
0
People
2

Evals

6

SWE-bench Multimodal

Multimodal extension of SWE-bench - software-engineering tasks with visual context (screenshots, diagrams).

USACO: USA Computing Olympiad

Evaluates language model performance on difficult Olympiad programming problems across four difficulty levels.

ActiveCoding

CORE-Bench

Evaluate how well an LLM Agent is at computationally reproducing the results of a set of scientific papers.

ActiveCoding

SWE-bench Multilingual

Cross-language extension of SWE-bench Verified - real GitHub issues across multiple programming languages.

SWE-bench Lite

300-issue subset of SWE-bench focused on functional bug fixes that are easier to evaluate - used for fast iteration before full SWE-bench runs.

ActiveCode EditingDebuggingTool CallingCode

SWE-bench Verified: Resolving Real-World GitHub Issues

Evaluates AI's ability to resolve genuine software engineering issues sourced from 12 popular Python GitHub repositories, reflecting realistic coding and debugging scenarios.

ActiveCoding