Knowledge-Centric Agents for Workflow Generation
TL;DR - A knowledge-centric framework for generating modular visual-creation workflows (e.g., ComfyUI), treating workflow synthesis as reasoning over structured knowledge rather than direct text-to-JSON generation. It matters because it improves the reliability and design quality of agentic workflow generation.
- Knowledge inversion: distills hierarchical representations (full pseudo-code, skeletons, high-level strategies) from large collections of real-world workflows.
- Knowledge injection: uses supervised fine-tuning to teach the model to reason from task descriptions → strategies → executable structures.
- Inference: performs reversible reasoning plus self-refinement to synthesize structurally coherent, executable workflows.
- Reported results: richer node diversity, more coherent structure, and higher execution success rates than existing systems (specific metrics not provided in the abstract).