Abstract
The convolutional neural network (CNN) has become a powerful tool for various biomedical image analysis tasks, but there is a lack of visual explanation for the machinery of CNNs. In this paper, we present a novel algorithm, Respond-weighted Class Activation Mapping (Respond-CAM), for making CNN-based models interpretable by visualizing input regions that are important for predictions, especially for biomedical 3D imaging data inputs. Our method uses the gradients of any target concept (e.g. the score of target class) that flow into a convolutional layer. The weighted feature maps are combined to produce a heatmap that highlights the important regions in the image for predicting the target concept. We prove a preferable sum-to-score property of the Respond-CAM and verify its significant improvement on 3D images from the current state-of-the-art approach. Our tests on Cellular Electron Cryo-Tomography 3D images show that Respond-CAM achieves superior performance on visualizing the CNNs with 3D biomedical image inputs, and is able to get reasonably good results on visualizing the CNNs with natural image inputs. The Respond-CAM is an efficient and reliable approach for visualizing the CNN machinery, and is applicable to a wide variety of CNN model families and image analysis tasks. Our code is available at: https://github.com/xulabs/projects/tree/master/respond_cam.
Original language | English (US) |
---|---|
Title of host publication | Medical Image Computing and Computer Assisted Intervention – MICCAI 2018 - 21st International Conference, 2018, Proceedings |
Editors | Julia A. Schnabel, Christos Davatzikos, Carlos Alberola-López, Gabor Fichtinger, Alejandro F. Frangi |
Publisher | Springer Verlag |
Pages | 485-492 |
Number of pages | 8 |
ISBN (Print) | 9783030009274 |
DOIs | |
State | Published - 2018 |
Event | 21st International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2018 - Granada, Spain Duration: Sep 16 2018 → Sep 20 2018 |
Publication series
Name | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
---|---|
Volume | 11070 LNCS |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
Other
Other | 21st International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2018 |
---|---|
Country/Territory | Spain |
City | Granada |
Period | 9/16/18 → 9/20/18 |
Funding
We thank Dr. Xiaodan Liang for suggestions. This work was supported in part by U.S. National Institutes of Health grant P41 GM103712. Min Xu acknowledges support from Samuel and Emma Winters Foundation. Rui Jiang is a RONG professor at the Institute for Data Science, Tsinghua University. Acknowledgements. We thank Dr. Xiaodan Liang for suggestions. This work was supported in part by U.S. National Institutes of Health grant P41 GM103712. Min Xu acknowledges support from Samuel and Emma Winters Foundation. Rui Jiang is a RONG professor at the Institute for Data Science, Tsinghua University.
ASJC Scopus subject areas
- Theoretical Computer Science
- General Computer Science