Evaluation of stenoses using AI video models applied to coronary angiography (2024)

1. Élodie Labrecque Langlais
2. Denis Corbin
3. Olivier Tastet
4. Ahmad Hayek
5. Gemina Doolub
6. Sebastián Mrad
7. Jean-Claude Tardif
8. Jean-François Tanguay
9. Guillaume Marquis-Gravel
10. Geoffrey H. Tison
11. Samuel Kadoury
12. William Le
13. Richard Gallo
14. Frederic Lesage
15. Robert Avram

1. Langlais-Labrecque, É. et al. Novel artificial intelligence applications in cardiology: current landscape, limitations, and the road to real-world applications. J. Cardiovasc. Transl. Res. 16, 513–525 (2023).
   https://doi.org/10.1007/s12265-022-10260-x
2. Jungiewicz, M. et al. Vision Transformer in stenosis detection of coronary arteries. Expert Syst. Appl. 228, 120234 (2023).
   https://doi.org/10.1016/j.eswa.2023.120234
3. Zhou, C. et al. Automated deep learning analysis of angiography video sequences for coronary artery disease. Preprint at https://arxiv.org/abs/2101.12505 (2021).
4. Grech, E. Pathophysiology and investigation of coronary artery disease. In ABC of Interventional Cardiology. 2nd edn (BMJ Books, Oxford, 2011).
5. Avram, R. et al. CathAI: fully automated coronary angiography interpretation and stenosis estimation. NPJ Digital Med. 6, 142 (2023).
   https://doi.org/10.1038/s41746-023-00880-1
6. Scanlon, P. J. et al. ACC/AHA guidelines for coronary angiography: executive summary and recommendations: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Committee on Coronary Angiography) developed in collaboration with the Society for Cardiac Angiography and Interventions. Circulation 99, 2345–2357 (1999).
   https://doi.org/10.1161/01.CIR.99.17.2345
7. Algarni, M., Al-Rezqi, A., Saeed, F., Alsaeedi, A. & Ghabban, F. Multi-constraints based deep learning model for automated segmentation and diagnosis of coronary artery disease in X-ray angiographic images. PeerJ Comput. Sci. 8, e993 (2022).
   https://doi.org/10.7717/peerj-cs.993
8. Çimen, S., Gooya, A., Grass, M. & Frangi, A. F. Reconstruction of coronary arteries from X-ray angiography: A review. Med Image Anal. 32, 46–68 (2016).
   https://doi.org/10.1016/j.media.2016.02.007
9. Leape, L. L. et al. Effect of variability in the interpretation of coronary angiograms on the appropriateness of use of coronary revascularization procedures. Am. Heart J. 139, 106–113 (2000).
   https://doi.org/10.1016/S0002-8703(00)90316-8
10. Alizadehsani, R. et al. Coronary artery disease detection using artificial intelligence techniques: A survey of trends, geographical differences and diagnostic features 1991–2020. Comput. Biol. Med. 128, 104095 (2021).
    https://doi.org/10.1016/j.compbiomed.2020.104095
11. Nallamothu, B. K. et al. Comparison of clinical interpretation with visual assessment and quantitative coronary angiography in patients undergoing percutaneous coronary intervention in contemporary practice: the Assessing Angiography (A2) project. Circulation 127, 1793–1800 (2013).
    https://doi.org/10.1161/CIRCULATIONAHA.113.001952
12. Patel, M. R. et al. ACC/AATS/AHA/ASE/ASNC/SCAI/SCCT/STS 2017 appropriate use criteria for coronary revascularization in patients with stable ischemic heart disease: a report of the American College of Cardiology appropriate use criteria task force, American Association for Thoracic Surgery, American Heart Association, American Society of Echocardiography, American Society of Nuclear Cardiology, Society for Cardiovascular Angiography and Interventions, Society of Cardiovascular Computed Tomography, and Society of Thoracic Surgeons. J. Am. Coll. Cardiol. 69, 2212–2241 (2017).
    https://doi.org/10.1016/j.jacc.2017.02.001
13. GN, L. 2011 ACCF/AHA/SCAI Guideline for Percutaneous Coronary Intervention: Executive summary: A report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines and the Society for Cardiovascular Angiography and Interventions. Circulation 124, 2574–2609 (2011).
    https://doi.org/10.1161/CIR.0b013e31823a5596
14. Au, B. et al. Automated characterization of stenosis in invasive coronary angiography images with convolutional neural networks. Preprint at https://arxiv.org/abs/1807.10597 (2018).
15. Anderson, R. D. & Pepine, C. J. Coronary angiography: is it time to reassess?. Circulation 127, 1760–1762 (2013).
    https://doi.org/10.1161/CIRCULATIONAHA.113.002566
16. Avram, R. et al. CathAI: Fully Automated Interpretation of Coronary Angiograms Using Neural Networks. Preprint at https://arxiv.org/abs/2106.07708 (2021).
17. Elbaz-Greener, G., Masih, S., Fang, J., Roifman, I. & Wijeysundera, H. C. Temporal trends in fractional flow reserve use in patients undergoing coronary angiography: a population-based study. CJC Open 1, 10–18 (2019).
    https://doi.org/10.1016/j.cjco.2018.11.004
18. Elgendy, I. Y. et al. Temporal trends in inpatient use of intravascular imaging among patients undergoing percutaneous coronary intervention in the United States. JACC Cardiovasc. Interv. 11, 913–915 (2018).
    https://doi.org/10.1016/j.jcin.2018.01.254
19. Parikh, R. V. et al. Utilization and outcomes of measuring fractional flow reserve in patients with stable ischemic heart disease. J. Am. Coll. Cardiol. 75, 409–419 (2020).
    https://doi.org/10.1016/j.jacc.2019.10.060
20. Ieroncig, F. et al. Novel approaches to define outcomes in coronary revascularization. Can. J. Cardiol. 35, 967–982 (2019).
    https://doi.org/10.1016/j.cjca.2018.12.016
21. Zhao, C. et al. Automatic extraction and stenosis evaluation of coronary arteries in invasive coronary angiograms. Comput. Biol. Med. 136, 104667 (2021).
    https://doi.org/10.1016/j.compbiomed.2021.104667
22. Moon, J. H. et al. Automatic stenosis recognition from coronary angiography using convolutional neural networks. Comput. Methods Prog. Biomed. 198, 105819 (2021).
    https://doi.org/10.1016/j.cmpb.2020.105819
23. Maxim Popov, A. A., et al. ARCADE: Automatic Region-based Coronary Artery Disease diagnostics using x-ray angiography imagEs Dataset Phase 1. ed Zenodo (2023).
    https://doi.org/10.1038/s41597-023-02871-z
24. Chollet, F. Xception: Deep learning with depthwise separable convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1251–1258 (2017).
    https://doi.org/10.1109/CVPR.2017.195
25. Lin, T.-Y., Goyal, P., Girshick, R., He, K. & Dollár, P. Focal loss for dense object detection. In Proceedings of the IEEE international conference on computer vision. 2980–2988 (2017).
    https://doi.org/10.1109/ICCV.2017.324
26. OpenCV. cv:Tracker Class Reference. https://docs.opencv.org/3.4/d0/d0a/classcv_1_1Tracker.html (accessed 13 November 2023).
27. Liu, Z. et al. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 3202–3211 (2021).
    https://doi.org/10.1109/ICCV48922.2021.00986
28. Zhang, H. et al. Comparison of physician visual assessment with quantitative coronary angiography in assessment of stenosis severity in China. JAMA Intern. Med. 178, 239–247 (2018).
    https://doi.org/10.1001/jamainternmed.2017.7821
29. Ouyang, D. et al. Video-based AI for beat-to-beat assessment of cardiac function. Nature 580, 252–256 (2020).
    https://doi.org/10.1038/s41586-020-2145-8
30. Shah, R. et al. Comparison of visual assessment of coronary stenosis with independent quantitative coronary angiography: Findings from the Prospective Multicenter Imaging Study for Evaluation of Chest Pain (PROMISE) trial. Am. heart J. 184, 1–9 (2017).
    https://doi.org/10.1016/j.ahj.2016.10.014
31. Jun, T. J. et al. Automated detection of vulnerable plaque in intravascular ultrasound images. Med. Biol. Eng. Comput. 57, 863–876 (2019).
    https://doi.org/10.1007/s11517-018-1925-x
32. Tu, S. et al. Diagnostic accuracy of quantitative flow ratio for assessment of coronary stenosis significance from a single angiographic view: A novel method based on bifurcation fractal law. Catheterization Cardiovasc. Interv. 97, 1040–1047 (2021).
    https://doi.org/10.1002/ccd.29592
33. Piccirillo, F. et al. Changes of the coronary arteries and cardiac microvasculature with aging: Implications for translational research and clinical practice. Mech. ageing Dev. 184, 111161 (2019).
    https://doi.org/10.1016/j.mad.2019.111161
34. Du, T. et al. Training and validation of a deep learning architecture for the automatic analysis of coronary angiography. EuroIntervention 17, 32–40 (2021).
    https://doi.org/10.4244/EIJ-D-20-00570
35. Völz, S. et al. Survival of patients with angina pectoris undergoing percutaneous coronary intervention with intracoronary pressure wire guidance. J. Am. Coll. Cardiol. 75, 2785–2799 (2020).
    https://doi.org/10.1016/j.jacc.2020.04.018
36. Popov, M. et al. Dataset for Automatic Region-based Coronary Artery Disease Diagnostics Using X-Ray Angiography Images. Sci. Data 11, 20 (2024).
    https://doi.org/10.1038/s41597-023-02871-z
37. Lukezic, A., Vojir, T., ˇCehovin Zajc, L., Matas, J. & Kristan, M. Discriminative correlation filter with channel and spatial reliability. In Proceedings of the IEEE conference on computer vision and pattern recognition. 6309–6318 (2017).
    https://doi.org/10.1109/CVPR.2017.515
38. Serruys, P. W. et al. Assessment of the SYNTAX score in the Syntax study. EuroIntervention 5, 50–56 (2009).
    https://doi.org/10.4244/EIJV5I1A9
39. Ronneberger, O., Fischer, P. & Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18. 234-241 (Springer, 2015).
    https://doi.org/10.1007/978-3-319-24574-4_28
40. Zhou, Z., Rahman Siddiquee, M. M., Tajbakhsh, N. & Liang, J. UNet++: A Nested U-Net Architecture for Medical ImageSegmentation. In Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 20, 2018, Proceedings 4. 3-11 https://pubmed.ncbi.nlm.nih.gov/32613207/ (Springer, 2018).
    https://doi.org/10.1007/978-3-030-00889-5_1
41. Fan, T., Wang, G., Li, Y. & Wang, H. Ma-net: A multi-scale attention network for liver and tumor segmentation. IEEE Access 8, 179656–179665 (2020).
    https://doi.org/10.1109/ACCESS.2020.3025372
42. Chaurasia, A. & Culurciello, E. LinkNet: Exploiting encoder representations for efficient semantic segmentation. In 2017 IEEE visual communications and image processing (VCIP). 1–4 (IEEE, 2017).
    https://doi.org/10.1109/VCIP.2017.8305148
43. Kirillov, A., He, K., Girshick, R. & Dollár, P. A Unified Architecture for Instance and Semantic Segmentation. In Computer Vision and Pattern Recognition Conference. (2017).
44. Zhao, H., Shi, J., Qi, X., Wang, X. & Jia, J. Pyramid scene parsing network. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2881–2890 (2021).
45. Chen, L.-C., Papandreou, G., Schroff, F. & Adam, H. Rethinking atrous convolution for semantic image segmentation. Priprint at https://arxiv.org/abs/1706.05587 (2017).
46. Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F. & Adam, H. Rethinking atrous convolution for semantic image segmentation. In Proceedings of the European conference on computer vision (ECCV). 801–818 (2017).
47. Li, H., Xiong, P., An, J. & Wang, L. Pyramid attention network for semantic segmentation. Preprint at https://arxiv.org/abs/1805.10180 (2018).
48. Sianos, G. et al. The SYNTAX Score: an angiographic tool grading the complexity of coronary artery disease. EuroIntervention 1, 219–227 (2005).
49. Kay, W. et al. The kinetics human action video dataset. Preprint at https://arxiv.org/abs/1705.06950 (2017).
50. Ridnik, T., Ben-Baruch, E., Noy, A. & Zelnik-Manor, L. Imagenet-21k pretraining for the masses. Preprint at https://arxiv.org/abs/2104.10972 (2021).
51. Liu, L. et al. On the variance of the adaptive learning rate and beyond. Preprint at https://arxiv.org/abs/1908.03265 (2019).
52. Tardif, J.-C. et al. Effects of reconstituted high-density lipoprotein infusions on coronary atherosclerosis: a randomized controlled trial. JAMA 297, 1675–1682 (2007).
    https://doi.org/10.1001/jama.297.15.jpc70004
53. Garrone, P. et al. Quantitative coronary angiography in the current era: principles and applications. J. Interv. Cardiol. 22, 527–536 (2009).
    https://doi.org/10.1111/j.1540-8183.2009.00491.x
54. Avram, R., Olgin, J. E. & Tison, G. H. The rise of open-sourced machine learning in small and imbalanced datasets: Predicting in-stent restenosis. Can. J. Cardiol. 36, 1574–1576 (2020).
    https://doi.org/10.1016/j.cjca.2020.02.002
55. DeLong, E. R., DeLong, D. M. & Clarke-Pearson, D. L. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics, 44, 837–845 (1988).
    https://doi.org/10.2307/2531595

About this publication