0

Sophon

Catalog of AI evals, the tools that lift them, and the labs behind them.

Frontier right now

Top models on Artificial Analysis - Intelligence Index

Artificial Analysis - Intelligence IndexBar chart with 20 bars. Highest value: Claude Fable 5.2 at 64.6.
20 models

Latest

View all

Newest evals, tools, models, and papers

Model20h ago
Gemini 4 Hydrogen
Google (Alphabet Inc.)
1.0M$3/M198 tok/s
Vibe Code Bench v1.188
Vals Index68
Paper2d ago
TorchCurves: Differentiable Parametric Curves

We present TorchCurves, a PyTorch library that treats vector-valued parametric curves as learnable primitives. Its central operation maps batches of scalar inputs to points on curves represented in B-spline or Legendre polynomial bases, with differentiation through both inputs…

72stars
0.0/h
Paper2d ago
MMDM: Measuring Massive Multitask Decision Making

System-1 Decision Models directly make structured probabilistic decisions over query-specified options given a state in a single forward pass, without autoregressively generating reasoning trajectories or textual responses.

Decision MakingLong ContextReasoning
10stars
0.1/h
Paper2d ago
Are Causal Neuron Circuits Unique and Transferable?

Interpretability demonstrations often show that intervening on a group of neurons changes a model's answer. A recent example removes an 18-neuron group in Qwen3-32B and the model answers "Simba" instead of "Scar" to a two-hop Lion King riddle.

Explainable AI
0stars
Paper2d ago
Are Dense Rewards Worth Their Tokens in GRPO?

RLVR trains language models to reason by rewarding correct final answers. A widely used algorithm, group-relative policy optimization (GRPO), gives every token of a solution the same credit, so dense process rewards have been proposed to credit intermediate steps, for example…

ReasoningReinforcement Learning
0stars
Model3d ago
Claude Fable 5.2
Anthropic

Point upgrade to Claude Fable 5.1 from Anthropic, with gains in coding, reasoning, and vision. Same 1M context, at a lower rack rate than Fable 5.1.

1M$16/M98 tok/sClosed
ProofBench100
GPQA Diamond94
Vibe Code Bench v1.194
Model3d ago
Muse Ember
Meta Platforms
1.0M$0.2/M451 tok/s
Vibe Code Bench v1.184
Vals Index60
Paper3d ago
GTAGym: Real AAA Game Tasks Environment for Evaluation and Reinforcement Learning

AAA games offer a rich testbed for evaluating agent perception, reasoning, and control. However, evaluating whether agents can complete tasks in AAA games is challenging and often human-annotated because task outcomes are often difficult to verify automatically, let alone…

Computer Use AgentsReinforcement Learning
10stars
0.6/h
Paper3d ago
PCBRouteAgent: How Close Are LLM Agents to Becoming PCB Routing Engineers?

Automating printed circuit board (PCB) routing requires coordinating board-level connectivity decisions with geometric execution under strict design rules. Although recent agents can interact with native routing tools, reliable routing on complex boards remains challenging.

Agents
57stars
0.2/h
Paper3d ago
Blind Variation, Selective Retention: Improving Creative Idea Generation in AI Scientists

Scientific discovery requires ideas that are original, useful, and non-obvious. Yet AI scientists are typically given as much task information as possible during idea generation, which can anchor generation toward familiar approaches.

Auto-Research
9stars
0.0/h

Leaderboards

View all

Current standings across rating systems

What lifts scores most

View all

Tools with the most known eval-lift evidence

Browse by capability

View all

Pick a capability to rank the tools that train toward it

Closest to saturation

View all

Benchmarks where the top score approaches the ceiling