ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis
Merged summary
TL;DR - ExpertVerse is a benchmark for evaluating knowledge-intensive reasoning in image generation and editing. It exposes reasoning gaps in current models while providing training data and an RL-based vision-language reasoning system.
- Includes 1,611 expert-annotated tasks spanning 9 cognitive capabilities, 8 disciplines, and 58 sub-disciplines.
- Covers single-image editing, multi-image composition, and text-to-image generation.
- ExpertVerse-100K adds automatically generated reasoning traces and knowledge-grounded rationales.
- KnowThinker uses BPPO, an RL method designed to address cross-modal reward misalignment and conflicting optimization objectives.
Sources (1)
ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis
TL;DR - ExpertVerse is a benchmark for evaluating knowledge-intensive reasoning in image generation and editing. It exposes reasoning gaps in current models while providing training data and an RL-based vision-language reasoning system.
- Includes 1,611 expert-annotated tasks spanning 9 cognitive capabilities, 8 disciplines, and 58 sub-disciplines.
- Covers single-image editing, multi-image composition, and text-to-image generation.
- ExpertVerse-100K adds automatically generated reasoning traces and knowledge-grounded rationales.
- KnowThinker uses BPPO, an RL method designed to address cross-modal reward misalignment and conflicting optimization objectives.