Abstract
Multi-sequence MRI is valuable in clinical settings for reliable diagnosis and treatment prognosis, but some sequences may be unusable or missing for various reasons. To address this issue, MRI synthesis is a potential solution. Recent deep learning-based methods have achieved good performance in combining multiple available sequences for missing sequence synthesis. Despite their success, these methods lack the ability to quantify the contributions of different input sequences and estimate region-specific quality in generated images, making it hard to be practical. Hence, we propose an explainable task-specific synthesis network, which adapts weights automatically for specific sequence generation tasks and provides interpretability and reliability from two sides: (1) visualize and quantify the contribution of each input sequence in the fusion stage by a trainable task-specific weighted average module; (2) highlight the area the network tried to refine during synthesizing by a task-specific attention module. We conduct experiments on the BraTS2021 dataset of 1251 subjects, and results on arbitrary sequence synthesis indicate that the proposed method achieves better performance than the state-of-the-art methods. Our code is available at https://github.com/fiy2W/mri_seq2seq.
Original language | English |
---|---|
Title of host publication | Medical Image Computing and Computer Assisted Intervention |
Subtitle of host publication | MICCAI 2023 - 26th International Conference, Proceedings |
Editors | Hayit Greenspan, Anant Madabhushi, Parvin Mousavi, Septimiu Salcudean, James Duncan, Tanveer Syeda-Mahmood, Russell Taylor |
Publisher | Springer Verlag |
Pages | 45-55 |
Number of pages | 11 |
Volume | 14229 |
Edition | 10 |
ISBN (Electronic) | 978-3-031-43999-5 |
ISBN (Print) | 9783031439988 |
DOIs | |
Publication status | Published - 1 Jan 2023 |
Event | 26th International Conference on Medical Image Computing and Computer Assisted Intervention - Vancouver, Canada Duration: 8 Oct 2023 → 12 Oct 2023 Conference number: 26 https://conferences.miccai.org/2023/en/ |
Publication series
Series | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
---|---|
Volume | 14229 LNCS |
ISSN | 0302-9743 |
Conference
Conference | 26th International Conference on Medical Image Computing and Computer Assisted Intervention |
---|---|
Abbreviated title | MICCAI 2023 |
Country/Territory | Canada |
City | Vancouver |
Period | 8/10/23 → 12/10/23 |
Internet address |
Keywords
- Explainable Synthesis
- Missing-Sequence MRI Synthesis
- Multi-Sequence Fusion
- Task-Specific Attention