0

Greg Kamradt

This is actually a person, not an organization. See person entry for Greg Kamradt.

Type
aggregator
HQ
USA

Cite

Notes

Only stored in your browser.

Evals
2
Tools
0
Models
0
Papers
0
Boards
0
People
0

Evals

2

Needle in a Haystack (NIAH)

Long-context retrieval pressure test - insert a random fact ("needle") at a random depth inside a long document ("haystack") and ask the model to retrieve it verbatim.

SaturatedFactual RecallLong Context

Needle in a Haystack (NIAH): In-Context Retrieval Benchmark for Long Context LLMs

NIAH evaluates in-context retrieval ability of long context LLMs by testing a model's ability to extract factual information from long-context inputs.

ActiveReasoning