Neural Transformers for Intraductal Papillary Mucosal Neoplasms (IPMN) Classification in MRI images

F. Proietto Salanitri, G. Bellitto, S. Palazzo, I. Irmakci, M. Wallace, C. Bolan, M. Engels, S. Hoogenboom, M. Aldinucci, U. Bagci, D. Giordano, C. Spampinato

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations

Abstract

Early detection of precancerous cysts or neoplasms, i.e., Intraductal Papillary Mucosal Neoplasms (IPMN), in pancreas is a challenging and complex task, and it may lead to a more favourable outcome. Once detected, grading IPMNs accurately is also necessary, since low-risk IPMNs can be under surveillance program, while high-risk IPMNs have to be surgically resected before they turn into cancer. Current standards (Fukuoka and others) for IPMN classification show significant intra- and inter-operator variability, beside being error-prone, making a proper diagnosis unreliable. The established progress in artificial intelligence, through the deep learning paradigm, may provide a key tool for an effective support to medical decision for pancreatic cancer. In this work, we follow this trend, by proposing a novel AI-based IPMN classifier that leverages the recent success of transformer networks in generalizing across a wide variety of tasks, including vision ones. We specifically show that our transformer-based model exploits pre-training better than standard convolutional neural networks, thus supporting the sought architectural universalism of transformers in vision, including the medical image domain and it allows for a better interpretation of the obtained results.

Original languageEnglish (US)
Title of host publication44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages475-479
Number of pages5
ISBN (Electronic)9781728127828
DOIs
StatePublished - 2022
Event44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2022 - Glasgow, United Kingdom
Duration: Jul 11 2022Jul 15 2022

Publication series

NameProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Volume2022-July
ISSN (Print)1557-170X

Conference

Conference44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2022
Country/TerritoryUnited Kingdom
CityGlasgow
Period7/11/227/15/22

ASJC Scopus subject areas

  • Signal Processing
  • Health Informatics
  • Computer Vision and Pattern Recognition
  • Biomedical Engineering

Fingerprint

Dive into the research topics of 'Neural Transformers for Intraductal Papillary Mucosal Neoplasms (IPMN) Classification in MRI images'. Together they form a unique fingerprint.

Cite this