0

Sophon

Catalog of AI evals, the tools that lift them, and the labs behind them.

Frontier right now

Top models on Artificial Analysis - Intelligence Index

Artificial Analysis - Intelligence IndexBar chart with 20 bars. Highest value: Gemini 4 Carbon (High) at 60.
20 models

Latest

View all

Newest evals, tools, models, and papers

Model2d ago
Inkling 2 Small
Thinking Machines
$0.47/M139 tok/s
SAGE89
Vibe Code Bench v1.182
Vals Index56
Paper3d ago
Turns Matter: Advancing Streaming Video RL via Turn-Level Credit

Streaming video understanding requires models to repeatedly decide whether to respond or continue observing. Recently, Group Relative Policy Optimization (GRPO) has been applied to this setting, with existing approaches emphasizing reward design while retaining a single…

Reinforcement LearningStreaming Video UnderstandingVideo Understanding
64stars
0.0/h
Paper3d ago
What Does Multi-Turn Reinforcement Learning Really Improve in LLM Agents?

While multi-turn agentic reinforcement learning (RL) excels on long-horizon tasks, its performance gains remain highly sensitive to interaction constraints. Evaluating across sampling breadth $K$ and interaction depth $T$ via $Pass@(K,T)$, we show that trajectory-level RL…

AgentsLong-Horizon AgentsReinforcement Learning
17stars
0.0/h
Model4d ago
Tencent Hy4
Tencent
$1.25/M94 tok/s
Paper4d ago
VisSearch-Bench: Evaluating Long Horizon Visual Search in Multimodal Agents

Multimodal agents use web and image tools to answer questions beyond their internal knowledge. Some search tasks use images mainly to identify an initial entity, then rely on text retrieval.

Retrieval
57stars
4.2/h
Paper4d ago
Kierston & KierstonBench: Simulation of Allentown, PA and Evaluation of Language Models in Crime Investigation and Surveillance Tasks

Large language models are candidates for collecting and analyzing records in criminal investigations and mass surveillance. Their capability and accuracy in this work cannot currently be measured.

Entity ResolutionQuestion AnsweringReasoning
1stars
Paper4d ago
Human-to-Robot Transfer via Bridging Representation and Action Space in VLAs

Pretrained Vision-Language-Action (VLA) policies provide a strong starting point for deployment, but adapting them to a target robot and environment still requires costly embodiment-specific demonstrations.

Robotics
4stars
0.1/h
Paper4d ago
Axion 1.0: Open Agent Foundation Models, Simplified

We introduce Axion 1.0, a fully open agent foundation model that combines strong and broad agentic capabilities with a remarkably simple training recipe. Axion 1.0 is trained in only three stages: two lightweight supervised fine-tuning stages followed by reinforcement learning,…

AgentsLong-Horizon AgentsReinforcement LearningScientific Reasoning
60stars
0.2/h
Paper4d ago
Harness-S: Learning from Sibling Harnesses for Generalizable Agent Training

Harness evolution from a common base exhibits Locality, Complementarity, and Nonstationarity: variants repair different failures, and their utility changes as the policy learns.

AgentsCoding AgentsContinuous ControlLong-Horizon Agents
53stars
3.1/h
Paper4d ago
LoopVQ: Sub 1-bit KV Cache Quantization for Looped Transformers

Looped transformers are a parameter-efficient alternative to standard transformers for language modeling. By reapplying the same layers across multiple loop steps, recent looped language models match the performance of non-looped models several times their size.

Language ModelingLong ContextRetrieval
3stars

Leaderboards

View all

Current standings across rating systems

What lifts scores most

View all

Tools with the most known eval-lift evidence

Browse by capability

View all

Pick a capability to rank the tools that train toward it

Closest to saturation

View all

Benchmarks where the top score approaches the ceiling