Browsing by Subject "Multi-stream"

Now showing 1 - 2 of 2

Open Access
Deep learning for multi-contrast MRI synthesis
(2021-07) Yurt, Mahmut
Magnetic resonance imaging (MRI) possesses the unique versatility to acquire images under a diverse array of distinct tissue contrasts. Multi-contrast images, in turn, better delineate tissues, accumulate diagnostic information, and enhance radiological analyses. Yet, prolonged, costly exams native to multi-contrast pro-tocols often impair the diversity, resulting in missing images from some contrasts. A promising remedy against this limitation arises as image synthesis that recovers missing target contrast images from available source contrast images. Learning-based models demonstrated remarkable success in this source-to-target mapping due to their prowess in solving even the most demanding inverse problems. Main-stream approaches proposed for synthetic MRI were typically subjected to a model training to perform either one-to-one or many-to-one mapping. One-to-one models manifest elevated sensitivity to detailed features of the given source, but they perform suboptimally when source-target images are poorly linked. Meanwhile, many-to-one counterparts pool information from multiple sources, yet this comes at the expense of losing detailed features uniquely present in cer-tain sources. Furthermore, regardless of the mapping, they both innately demand large training sets of high-quality source and target images Fourier-reconstructed from Nyquist-sampled acquisitions. However, time and cost considerations put signiﬁcant challenges in compiling such datasets. To address these limitations, here we ﬁrst propose a novel multi-stream model that task-adaptively fuses unique and shared image features from a hybrid of multiple one-to-one streams and a single many-to-one stream. We then introduce a novel semi-supervised learning framework based on selective tensor loss functions to learn high-quality image synthesis directly from a training dataset of undersampled acquisitions, bypass-ing the undesirable data requirements of deep learning. Demonstrations on brain MRI images from healthy subjects and glioma patients indicate the superiority of the proposed approaches against state-of-the-art baselines.
Open Access
mustGAN: multi-stream generative adversarial networks for MR image synthesis
(Elsevier BV, 2021-05) Yurt, Mahmut; Dar, Salman Uh; Erdem, A.; Erdem, E.; Oğuz, Kader K.; Çukur, Tolga
Multi-contrast MRI protocols increase the level of morphological information available for diagnosis. Yet, the number and quality of contrasts are limited in practice by various factors including scan time and patient motion. Synthesis of missing or corrupted contrasts from other high-quality ones can alleviate this limitation. When a single target contrast is of interest, common approaches for multi-contrast MRI involve either one-to-one or many-to-one synthesis methods depending on their input. One-to-one methods take as input a single source contrast, and they learn a latent representation sensitive to unique features of the source. Meanwhile, many-to-one methods receive multiple distinct sources, and they learn a shared latent representation more sensitive to common features across sources. For enhanced image synthesis, we propose a multi-stream approach that aggregates information across multiple source images via a mixture of multiple one-to-one streams and a joint many-to-one stream. The complementary feature maps generated in the one-to-one streams and the shared feature maps generated in the many-to-one stream are combined with a fusion block. The location of the fusion block is adaptively modified to maximize task-specific performance. Quantitative and radiological assessments on T1,- T2-, PD-weighted, and FLAIR images clearly demonstrate the superior performance of the proposed method compared to previous state-of-the-art one-to-one and many-to-one methods.