ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis

TL;DR - ExpertVerse is a benchmark for evaluating knowledge-intensive reasoning in image generation and editing. It exposes reasoning gaps in current models while providing training data and an RL-based vision-language reasoning system.

• Includes 1,611 expert-annotated tasks spanning 9 cognitive capabilities, 8 disciplines, and 58 sub-disciplines.
• Covers single-image editing, multi-image composition, and text-to-image generation.
• ExpertVerse-100K adds automatically generated reasoning traces and knowledge-grounded rationales.
• KnowThinker uses BPPO, an RL method designed to address cross-modal reward misalignment and conflicting optimization objectives.