[R01] Automated PET Report Generation with Visual Grounding
Ente: National Institute of Biomedical Imaging and Bioengineering
Scadenza: 2030-05-31
Importo max: $595,791
Paese: US
Descrizione
Project Summary
The increasing use of positron emission tomography (PET) imaging, particularly with the rise of
theranostics, is creating a significant challenge for the nuclear medicine field. While PET scan volumes are
growing by ~10% annually, the workforce of trained physicians is not keeping pace. This growing disparity
places immense pressure on physicians, potentially compromising the quality of care and leading to
delayed diagnoses. Much of a physician’s time is spent on tasks ancillary to the overall interpretative task,
and solutions that can improve physician efficiency by automating these tasks are needed.
This project will develop an innovative end-to-end framework to solve this. First, we will use federated
learning to develop nuclear medicine's first multi-center vision-language foundation model, overcoming the
problem of data scarcity. Second, we will build a novel, longitudinally-aware "detect-and-describe" pipeline
(PETAR) that identifies all findings, assesses interval change, and generates a visually-grounded,
structured list of findings. Finally, an LLM synthesis module will complete the full report by generating a
Background section from the electronic medical record, consolidating the Findings, and creating a final
Impression in the reading physician’s own style. Together, this framework will relieve physicians of time-
consuming tasks, allowing them to focus on their core expertise.
This project will establish a new paradigm for multimodal AI in low-volume imaging. The public release of
our open-source foundation models and the first large-scale, labeled multimodal PET dataset will be a major
contribution to the field. This will catalyze a new wave of research, providing the entire community with the
open-science tools needed to solve this critical challenge in nuclear medicine.
Istituzione: UNIVERSITY OF WISCONSIN-MADISON
PI: Tyler J Bradshaw
Progetto: 1R01EB038264-01A1
Settori: National Institute of Biomedical Imaging and Bioengineering
Vai al bando originale
Registrati gratis su Bandolo per trovare bandi compatibili con la tua azienda.