🛰️ Daily AI Frontier
‹ back to 2026-08-19

PerFact: Perception-Derived Fact Prompting for 3D Brain MRI Report Generation

Research Medical/Healthcare AI

Ranking

Overall 77
Content 95
Popularity 37

Observed public metrics from 1 member.

Representative image for PerFact: Perception-Derived Fact Prompting for 3D Brain MRI Report Generation

Merged summary

TL;DR - PerFact generates reports from 3D multi-sequence brain MRI by prompting a LoRA-adapted vision-language model with structured facts produced by upstream segmentation and classification models. The study finds that grounding quality, rather than backbone choice or scale, is the main controllable factor in report quality.

  • Five identically fine-tuned backbones spanning three model families and an order of magnitude in scale performed only marginally differently.
  • Perception-derived facts outperformed retrieved prior reports, and retrieval became redundant when those facts were included.
  • Predicted facts remained effective without ground-truth annotations at inference; the gap to oracle facts was attributed primarily to fact granularity.
  • Adding closed-ended visual question answering caused no measurable reduction in report quality.

Sources (1)

PerFact: Perception-Derived Fact Prompting for 3D Brain MRI Report Generation

arXiv cs.CV Jianyu Sun, Zhenxuan Zhang, Guang Yang, Peter J. Lally 2026-08-18 arXiv:2608.17926
Public signals Semantic Scholar citations 0 · Semantic Scholar influential citations 0
Providers: Hugging Face · N/A OpenAlex · N/A Publisher · N/A Semantic Scholar · Citations 0 · Influential citations 0 X · N/A Fetched 2026-09-10 14:26:44.105629 UTC

TL;DR - PerFact generates reports from 3D multi-sequence brain MRI by prompting a LoRA-adapted vision-language model with structured facts produced by upstream segmentation and classification models. The study finds that grounding quality, rather than backbone choice or scale, is the main controllable factor in report quality.

  • Five identically fine-tuned backbones spanning three model families and an order of magnitude in scale performed only marginally differently.
  • Perception-derived facts outperformed retrieved prior reports, and retrieval became redundant when those facts were included.
  • Predicted facts remained effective without ground-truth annotations at inference; the gap to oracle facts was attributed primarily to fact granularity.
  • Adding closed-ended visual question answering caused no measurable reduction in report quality.
item →