Abstract
Point-based 3D intracranial aneurysm segmentation is fundamental for automatic aneurysm diagnosis. Though impressive performances, existing point-based 3D segmentation frameworks still perform poorly around the edge between vessels and aneurysms, which is extremely harmful for the clipping surgery process. To address the issue, we propose an Edge-oriented Point-cloud Transformer Network (EPT-Net) to produce precise segmentation predictions. The framework consists of three paradigms, i.e., dual stream transformer (DST), outer-edge context dissimilation (OCD) and inner-edge hard-sample excavation (IHE). In DST, a dual stream transformer is proposed to jointly optimize the semantics stream and the edge stream, where the latter imposes more supervision around the edge and help the semantics stream produce sharper boundaries. In OCD, aiming to refine features outside the edge, an edge-separation graph is constructed where connections across the edge are prohibited, thereby dissimilating contexts of points belonging to different categories. Upon that, graph convolution is performed to refine the confusing features via information exchange with dissimilated contexts. In IHE, to further refine features inside the edge, triplets (i.e. anchor, positive and negative) are built up around the edge, and contrastive learning is employed. Differently from previous contrastive methods of point clouds, we only select points nearby the edge as hard-negatives, providing informative clues for discriminative feature learning. Extensive experiments on the 3D intracranial aneurysm dataset IntrA demonstrate the superiority of our EPT-Net compared with state-of-the-art methods. Code is available at https://github.com/CityU-AIM-Group/EPT.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alaraj, A., et al.: Virtual reality cerebral aneurysm clipping simulation with real-time haptic feedback. Oper. Neurosur. 11(1), 52–58 (2015)
Dosovitskiy, A., et al.: An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)
Frösen, J., et al.: Saccular intracranial aneurysm: pathology and mechanisms. Acta Neuropathol. 123(6), 773–786 (2012)
Hu, Q., et al.: Randla-net: Efficient semantic segmentation of large-scale point clouds. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 11108–11117 (2020)
Jiang, L., et al.: Guided point contrastive learning for semi-supervised point cloud semantic segmentation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 6423–6432 (2021)
Lareyre, F., Adam, C., Carrier, M., Dommerc, C., Mialhe, C., Raffort, J.: A fully automated pipeline for mining abdominal aortic aneurysm using image segmentation. Sci. Rep. 9(1), 1–14 (2019)
Li, J., Chen, B.M., Lee, G.H.: So-net: Self-organizing network for point cloud analysis. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 9397–9406 (2018)
López-Linares, K., García, I., García-Familiar, A., Macía, I., Ballester, M.A.G.: 3D convolutional neural network for abdominal aortic aneurysm segmentation. arXiv preprint arXiv:1903.00879 (2019)
Nieuwkamp, D.J., Setz, L.E., Algra, A., Linn, F.H., de Rooij, N.K., Rinkel, G.J.: Changes in case fatality of aneurysmal subarachnoid haemorrhage over time, according to age, sex, and region: a meta-analysis. Lancet Neurol. 8(7), 635–642 (2009)
Oord, A.v.d., Li, Y., Vinyals, O.: Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748 (2018)
Paszke, A., et al.: Pytorch: an imperative style, high-performance deep learning library. Adv. Neural Inf. Process. Syst. 32, 8026–8037 (2019)
Qi, C.R., Su, H., Mo, K., Guibas, L.J.: Pointnet: Deep learning on point sets for 3d classification and segmentation. In: Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pp. 652–660 (2017)
Qi, C.R., Yi, L., Su, H., Guibas, L.J.: Pointnet++: Deep hierarchical feature learning on point sets in a metric space. Adv. Neural Inf. Process. Syst. 30 (2017)
Sichtermann, T., Faron, A., Sijben, R., Teichert, N., Freiherr, J., Wiesmann, M.: Deep learning-based detection of intracranial aneurysms in 3D TOF-MRA. Am. J. Neuroradiol. 40(1), 25–32 (2019)
Wu, W., Qi, Z., Fuxin, L.: Pointconv: Deep convolutional networks on 3d point clouds. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 9621–9630 (2019)
Xie, S., Gu, J., Guo, D., Qi, C.R., Guibas, L., Litany, O.: PointContrast: unsupervised pre-training for 3d point cloud understanding. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12348, pp. 574–591. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58580-8_34
Yang, X., Xia, D., Kin, T., Igarashi, T.: Intra: 3D intracranial aneurysm dataset for deep learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2656–2666 (2020)
Yu, J., et al.: 3D medical point transformer: introducing convolution to attention networks for medical point cloud analysis. arXiv preprint arXiv:2112.04863 (2021)
Zhao, H., Jiang, L., Jia, J., Torr, P.H., Koltun, V.: Point transformer. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 16259–16268 (2021)
Acknowledgements
This work is supported by the Hong Kong Innovation and Technology Commission (InnoHK Project CIMDA).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Liu, Y., Liu, J., Yuan, Y. (2022). Edge-Oriented Point-Cloud Transformer for 3D Intracranial Aneurysm Segmentation. In: Wang, L., Dou, Q., Fletcher, P.T., Speidel, S., Li, S. (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. Lecture Notes in Computer Science, vol 13435. Springer, Cham. https://doi.org/10.1007/978-3-031-16443-9_10
Download citation
DOI: https://doi.org/10.1007/978-3-031-16443-9_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16442-2
Online ISBN: 978-3-031-16443-9
eBook Packages: Computer ScienceComputer Science (R0)
