Synthetic Hospital: An Open, Verifiable, Physician-Validated Longitudinal EHR Benchmark
Ranking
Overall
85
Content
100
Popularity
N/A
No observed public metrics; popularity remains neutral/archived.
Merged summary
TL;DR - Synthetic Hospital is an open, fully synthetic benchmark for evaluating language models on realistic longitudinal electronic health records without exposing protected health information. Its verifiable ground truth and simulated EHR infrastructure enable reproducible testing of clinical AI systems.
- Includes 1,268 synthetic patients and 5,602 encounters grounded in public medical-education sources and standard clinical ontologies.
- Provides complete provenance plus interoperability APIs, role-based access, and a function-calling interface modeled on real hospital systems.
- Physicians distinguished synthetic from real charts at only 53% accuracy in a blinded review.
- The best of 10 evaluated models achieved 0.73 severity-weighted F1 on longitudinal problem-list reconstruction and missed roughly half of clinically relevant findings in chart summaries.
Sources (1)
Synthetic Hospital: An Open, Verifiable, Physician-Validated Longitudinal EHR Benchmark
Public signals
N/A
TL;DR - Synthetic Hospital is an open, fully synthetic benchmark for evaluating language models on realistic longitudinal electronic health records without exposing protected health information. Its verifiable ground truth and simulated EHR infrastructure enable reproducible testing of clinical AI systems.
- Includes 1,268 synthetic patients and 5,602 encounters grounded in public medical-education sources and standard clinical ontologies.
- Provides complete provenance plus interoperability APIs, role-based access, and a function-calling interface modeled on real hospital systems.
- Physicians distinguished synthetic from real charts at only 53% accuracy in a blinded review.
- The best of 10 evaluated models achieved 0.73 severity-weighted F1 on longitudinal problem-list reconstruction and missed roughly half of clinically relevant findings in chart summaries.