0

Grok Beta

Grok Beta is an AI model from xAI.

Publisher
xAI
Family
Grok
Context
131K
Input
Output
Released
13 Aug 2024

Cite

Notes

Only stored in your browser.

Attribution

Benchmark scores
AAEvalPlusLiveBench
Attribution policy →
Context
131K
Input
$0
/1M tok
Output
$0
/1M tok
Blended
$0
#1/ 499/1M · 3:1
Speed
0
#103/ 498tok/s

Price & speed via Artificial Analysis · ranked across tracked models

Reported on 15 evals across 5 domains - best 88.4% on HumanEval · #3 of 17

Reported eval scores

15
HumanEval+80.5
LiveBench - Instruction Following70.5
MBPP+65.6
LiveBench - Language47
LiveBench - Coding44.5
HumanEval88.4
Mostly Basic Python Problems (MBPP)86
LiveCodeBench24.1
MMLU-Pro70.3
LiveBench54
Humanity's Last Exam (HLE)4.4
MATH-50073.7
AIME 2024: Problems from the American Invitational Mathematics Examination10.3
SciCode29.5
GPQA Diamond47.1