0

Sophon

Catalog of AI evals, the tools that lift them, and the labs behind them.

Frontier right now

Top models on Artificial Analysis - Intelligence Index

Artificial Analysis - Intelligence IndexBar chart with 20 bars. Highest value: Claude Opus 5.5 at 57.6.
20 models

Latest

View all

Newest evals, tools, models, and papers

Model2d ago
Kimi K3.1 Pro
Kimi
1.0M$4/M58 tok/s
SciCode61
Humanity's Last Exam (HLE)53
Model3d ago
Ling 3.1 Flash 1019
InclusionAI
$0.45/M
SciCode57
Humanity's Last Exam (HLE)44
Paper3d ago
Beyond Watching and Searching: Benchmarking Agents for Video-centered Deep Research Reports

Deep research agents synthesize open-web evidence into long reports, but current benchmarks do not evaluate research centered on a source video. We introduce Video-Centered Deep Research Report Generation.

Deep Research AgentsVideo Understanding
12stars
Paper4d ago
CulturalRiddles: A Multicultural Benchmark of Riddles

As LLMs expand their language coverage, evaluating how well they understand and represent diverse cultures becomes increasingly important. However, many benchmarks remain English-centric, with limited cultural coverage and a focus on factual knowledge over its application in…

Reasoning
12stars
0.0/h
Paper4d ago
Evolving with Open Worlds: Towards Recursive Self-Improvement for Future Forecasting

Most contemporary artificial intelligence (AI) systems are released with frozen parameters and improve through external updates, whereas an ideal system would keep improving from its own experience, a capacity we call recursive self-improvement (RSI).

Agents
3stars
Paper4d ago
Retrieval Augmented Generation Compositionality

Retrieval Augmented Generation (RAG) grounds large language models in external knowledge. Modern pipelines combine embedding, chunking, retrieval, reranking, query augmentation, context compression, and agentic verification, yet these techniques are typically evaluated one at a…

Retrieval-Augmented GenerationText Reranking
17stars
0.1/h
Paper5d ago
MMEnterprise-Bench: Evaluating Enterprise Agents over Evolving Multimodal Records

Enterprise agents answer questions over workplace records that evolve through team collaboration. As information is shared, corrected, and revised across documents, chats, and figures, multiple versions of the same information accumulate in the workspace.

Question Answering
14stars
Paper5d ago
Automating ML for Science: Can Frontier Agents Climb Scientific Hills in the Wild?

Frontier coding agents are increasingly framed as end-to-end automated researchers, and ML for science offers a demanding test of that promise: improving a scientific model often requires domain insight beyond routine ML engineering.

Coding AgentsDeep Research Agents
9stars
0.0/h
Paper5d ago
RLSplat: Resource-Linear Budget Control for Feed-forward 3D Gaussian Splatting

Feed-forward 3D Gaussian Splatting (FF3DGS) reconstructs 3D scenes from images in a single forward pass, making it well-suited to applications that must operate within limited resource budgets.

3D ReconstructionNovel View Synthesis
8stars
Paper5d ago
Cache Engineering for Agents

Large Language Model (LLM) agents can handle increasingly complex tasks, navigating long trajectories of observations and actions. As these trajectories grow, key-value (KV) cache I/O and storage become the dominant cost.

AgentsSummarization
56stars
0.2/h

Leaderboards

View all

Current standings across rating systems

What lifts scores most

View all

Tools with the most known eval-lift evidence

Browse by capability

View all

Pick a capability to rank the tools that train toward it

Closest to saturation

View all

Benchmarks where the top score approaches the ceiling