BenchMIRT: What are LLM benchmarks actually measuring?

TL;DR - BenchMIRT examines what LLM benchmarks actually measure. Because only the title and source are provided, its methods and findings cannot be summarized reliably.

• The work focuses on interpreting the capabilities or constructs captured by LLM benchmarks.
• Its framing questions whether benchmark scores reflect the abilities they are commonly assumed to measure.
• No specific datasets, methodology, experiments, or results are available in the provided content.