Abstract
Metal artifacts in oral and maxillofacial computed tomography (CT) images affect the imaging quality, interfere with doctors’ judgment of anatomical structure and may pose a threat to patients’ lives. Although many metal artifact reduction (MAR) methods have been proposed, there is still no complete and ideal solution. We aimed to construct and validate a generative adversarial network (GAN) based model, which was called MAR-GAN, to reduce the artifacts and improve the image quality. We created a large CT images dataset containing 600 pairs of simulated images and 5203 clinical images, where five kinds of metal artifacts were involved. The 600 pairs of simulated images were divided into training and test groups (4:1) and tested using a 5-fold cross-validation schema. Each pair contained an original artifact-free image and a manually simulated artifact-affected image. The inputs were artifact-affected images, and the outputs were artifact-reduced images that were compared with the corresponding artifact-free images. The effectiveness of the proposed MAR-GAN was tested on the simulated dataset and the clinical dataset. The root mean square error and structural similarity values of MAR-GAN were 0.0170 ± 0.0049 and 0.9831 ± 0.0073, respectively, on the simulated dataset. MAR-GAN had significant advantages over two state-of-the-art methods on the clinical dataset, good performance was obtained and the results were all clinically acceptable. Experimental results demonstrated the superior capability of MAR-GAN, which provided improved performance and high reconstruction quality, including preservation of anatomical structures near metal implants and recovery of detailed structural information from low-quality images.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
Code is available at https://github.com/LeiXuSCU/MAR-GAN.git.
References
Lars G, Bruno De M, Yannan J, Harald P, Ge W (2016) Metal Artifact Reduction in CT: Where are we after four decades? IEEE access PP:1–1
Suk PH, Min LS, Pyung KH, Keun SJ (2017) CT sinogram-consistency learning for metal-induced beam hardening correction
Lars G, Qingsong Y, Yan X, Ye Z, Junping Z, Ge W (2017) Deep learning methods to guide CT image reconstruction and reduce metal artifacts. Medical Imaging 2017: Physics of Medical Imaging 10132:101322W
Haofu L, An LW, Kevin ZS, Jiebo L (2019) ADN: Artifact disentanglement network for unsupervised metal artifact reduction. IEEE Transactions on Medical Imaging
Jianing, Wang, Yiyuan, Zhao, Jack, H, Noble, Benoit, M, Dawant (2018) Conditional Generative Adversarial Networks for Metal Artifact Reduction in CT Images of the Ear., Medical image computing and computer-assisted intervention. MICCAI.. International Conference on medical image computing and Computer-Assisted intervention
Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial networks. Advances in Neural Information Processing Systems. 2672–2680
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. IEEE conference on computer vision and pattern recognition
Batch N (2015) Accelerating Deep Network Training by Reducing Internal Covariate Shift JMLR.org
Pathak D, Krahenbuhl P, Donahue J, Darrell T, Efros A (2016) A context encoders: Feature learning by inpainting
Kingma D, Ba J (2014) Adam: A method for stochastic optimization computer science
Paszke A, Gross S, Chintala S, Chanan G, Yang E, DeVito Z, Lin Z, Desmaison A, Antiga L, Lerer A (2017) Automatic differentiation in pytorch
Rubio J (2009) SOFMLS: Online Self-Organizing Fuzzy Modified Least-Squares Network: IEEE Transactions on Fuzzy Systems
Alberto MCJ (2018) On the estimation and control of nonlinear systems with parametric uncertainties and noisy outputs. Graphical Abstract: IEEE Access
Rubio JJD (2021) Stability Analysis of the Modified Levenberg-Marquardt Algorithm for the Artificial Neural Network Training. IEEE Transactions on Neural Networks and Learning Systems
Aquino G, Rubio JDJ, Pacheco J, Gutierrez GJ, Ochoa G, Balcazar R, Cruz DR, Garcia E, Novoa JF, Zacarias A (2020) Novel nonlinear hypothesis for the delta parallel robot modeling. IEEE Access 8:46324–46334
Chiang HS, Chen MY, Huang YJ (2019) Wavelet-Based EEG Processing for Epilepsy Detection Using Fuzzy Entropy and Associative Petri Net. IEEE Access 1-1:99
Hernández G, Zamora E, Sossa H, Téllez G, Furlán F (2019) Hybrid neural networks for big data classification, Neurocomputing, 390
Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13:4
Luo X, Chen R, Xie Y, Qu Y, Li Cuihua (2019) Bi-GANs-ST for Perceptual Image Super-resolution
Michelini PN, Dan Z, Liu H (2018) Multi-Scale recursive and Perception-Distortion controllable image. Super-Resolution
Turkoglu M (2020) COVIDetectioNet: COVID-19 diagnosis system based on X-ray images using features selected from pre-learned deep features ensemble. Applied Intelligence, 1–14
Acharya UR, Fujita H, Oh SL, Hagiwara Y, Tan JH, Adam M, Tan RS (2018) Deep convolutional neural network for the automated diagnosis of congestive heart failure using ECG signals applied intelligence
Yuan Y, Chao M, Lo YC (2017) Automatic Skin Lesion Segmentation Using Deep Fully Convolutional Networks With Jaccard Distance. IEEE Trans med imaging PP:1–1
Ibragimov B, Xing L (2017) Segmentation of organs-at-risks in head and neck CT images using convolutional neural networks. Med Phys 44:547
Sa R, Owens W, Wiegand R, Studin M, Capoferri D, Barooha K, Greaux A, Rattray R, Hutton A, Cintineo J (2017) Intervertebral disc detection in X-ray images using faster r-CNN. 564–567
Arik S, Ibragimov B, Xing L (2017) Fully automated quantitative cephalometry using convolutional neural networks. Journal of Medical Imaging 4:014501
Yi X, Babyn P (2018) Sharpness-Aware Low-Dose CT Denoising using conditional generative adversarial network. J Digit Imaging 31:5
Zhang Z, Yang L, Zheng Y (2018) Translating and segmenting multimodal medical volumes with cycle- and Shape-Consistency generative adversarial network. 2018 IEEE/CVF conference on computer vision and pattern recognition (CVPR)
Acknowledgements
This work was supported by the National Key Research and Development Program of China under Grant 2018AAA0100201 and the Regional Innovation Cooperation Project of Sichuan Province under Grant 2020YFQ0012. We also thank Richard Lipkin, PhD, from Liwen Bianji, Edanz Group China (www.liwenbianji.cn/ac), for editing the English text of a draft of this manuscript. L. Xu, J.X. Guo. and Z. Yi designed the study, developed algorithms, conducted the experiments and wrote the manuscript. S.L Zhou, W.D. Tian and W. Tang collected and processed the data, evaluated and scored the experimental results on the clinical dataset. All authors read and approved the final version of the manuscript.
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of Interests
The authors declare that they have no conflict of interest.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Xu, L., Zhou, S., Guo, J. et al. Metal artifact reduction for oral and maxillofacial computed tomography images by a generative adversarial network. Appl Intell 52, 13184–13194 (2022). https://doi.org/10.1007/s10489-021-02905-2
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-021-02905-2