ARC-Challenge (EN)
Observations
- rozumowanie EN ↗
- metryka: accuracy MCQ (accuracy) ↗
- rola: regresja ↗
- typ zadania: rozumowanie ↗
- licencja: CC-BY-SA ↗
- rozmiar: 1172 ↗
- kategoria: en-regression ↗
- dodano: 2026-06-11 ↗
- dodał: slayer ↗
- status: verified ↗
- źródło: https://huggingface.co/datasets/allenai/ai2_arc ↗
- 2026-06-04 mean across 4 runs: {“Qwen3.5-9B”:94.1} ↗
- 2026-06-04 Qwen3.5-9B: 94.1 (accuracy (MCQ, exact letter) [EN regresja]) ↗
Referenced by
- MCQ (mentions)
- ARC-Challenge (EN) (mentions)
- ARC-Challenge (EN) (defined-by)
- EVAL (mentions)
- ARC (mentions)
- ARC (defined-by)
- regresja (mentions)
- ARC-Challenge (mentions)
- ARC-Challenge (defined-by)
- rozumowanie (mentions)
- V4 Faza 0 — pomiar (likelihood) + kalibracja λ (cal-l030) (uses-benchmark)
- Suita generatywna (ollama, Q4) (uses-benchmark)
- ARC-Challenge (uses-benchmark)
Local graph
ARC-Challenge (EN)
- ← mentions MCQ
- ← mentions ARC-Challenge (EN)
- ← defined-by ARC-Challenge (EN)
- ← mentions EVAL
- ← mentions ARC
- ← defined-by ARC
- ← mentions regresja
- ← mentions ARC-Challenge
- ← defined-by ARC-Challenge
- ← mentions rozumowanie
- ← uses-benchmark V4 Faza 0 — pomiar (likelihood) + kalibracja λ (cal-l030)
- ← uses-benchmark Suita generatywna (ollama, Q4)
- ← uses-benchmark ARC-Challenge