Electrical Engineering and Systems Science > Image and Video Processing
[Submitted on 13 May 2022 (v1), revised 15 Nov 2022 (this version, v2), latest version 24 Apr 2024 (v5)]
Title:Unsupervised Representation Learning for 3D MRI Super Resolution with Degradation Adaptation
View PDFAbstract:High-resolution (HR) MRI is critical in assisting the doctor's diagnosis and image-guided treatment but is highly time-consuming and costly to acquire. Therefore, deep learning-based super-resolution reconstruction (SRR) has been investigated to generate super-resolution images from low-resolution (LR) images. Training such neural networks requires authentic HR and LR image pairs, which are difficult to acquire due to patient movement during and between the acquisitions of LR and HR images. Rigid movements of hard tissues can be corrected with image registration. In contrast, the alignment of deformed soft tissues is challenging, making it impractical to train neural networks with authentic HR and LR image pairs. Existing studies in the literature focused on SRR using authentic HR images and down-sampled synthetic LR images. Yet, the difference in degradation representations between synthetic and authentic LR images suppresses the quality of SRR from authentic LR images. In this work, we propose a novel Unsupervised Degradation Adaptation Network (UDEAN) to mitigate this problem. Our network consists of the degradation learning network and the SRR network. The degradation learning network down-samples the HR images by addressing the degradation representation of the misaligned or unpaired LR images. The SRR network learns the mapping from the down-sampled HR images to the original ones. Experimental results show that our method outperforms state-of-the-art networks and can potentially be applied in real clinical settings.
Submission history
From: Hao Li [view email][v1] Fri, 13 May 2022 21:07:26 UTC (2,436 KB)
[v2] Tue, 15 Nov 2022 23:42:09 UTC (2,984 KB)
[v3] Thu, 26 Jan 2023 21:46:41 UTC (2,984 KB)
[v4] Mon, 27 Mar 2023 23:39:54 UTC (4,180 KB)
[v5] Wed, 24 Apr 2024 21:13:11 UTC (6,157 KB)
Current browse context:
eess.IV
Change to browse by:
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.