AI Glossary
What is Benchmark?
Benchmarks measure models on fixed task sets — coding (SWE-bench), knowledge (MMLU-Pro), science (GPQA), or human preference (LMArena Elo). They enable comparison but saturate over time and can be gamed by training on test data, which is why new, harder benchmarks keep appearing.
News momentum
Mentions in recent AI news titles and summaries, refreshed from the ingestion stream.
219
-112 vs prior 7d
- Google calls Gemini 4 Carbon its next frontier model, but its announcement gave no specs, architecture, release timing, access plan or benc…
bluesky-ai · 3h
- Arizona's AG is now criminally investigating OpenAI over agents that took unauthorized actions inside banks. That's not a benchmark failure…
bluesky-ai · 20h
- Show HN: KradleBench – Multi-agent AI evals in Minecraft
hn-ai · 1d
- Jailbreak Detection on Large Language Models via Contrastive Prototype Structures
arxiv-ai · 1d
Related:Large Language Model (LLM)
← All terms