Breast cancer risk estimation with artificial neural networks revisited: Discrimination and calibration

Turgay Ayer, Oguzhan Alagoz, Jagpreet Chhatwal, Jude W. Shavlik, Charles E. Kahn, Elizabeth S. Burnside

Research output: Contribution to journalArticle

51 Scopus citations

Abstract

BACKGROUND: Discriminating malignant breast lesions from benign ones and accurately predicting the risk of breast cancer for individual patients are crucial to successful clinical decisions. In the past, several artificial neural network (ANN) models have been developed for breast cancer-risk prediction. All studies have reported discrimination performance, but not one has assessed calibration, which is an equivalently important measure for accurate risk prediction. In this study, the authors have evaluated whether an artificial neural network (ANN) trained on a large prospectively collected dataset of consecutive mammography findings can discriminate between benign and malignant disease and accurately predict the probability of breast cancer for individual patients. METHODS: Our dataset consisted of 62,219 consecutively collected mammography findings matched with the Wisconsin State Cancer Reporting System. The authors built a 3-layer feedforward ANN with 1000 hidden-layer nodes. The authors trained and tested their ANN by using 10-fold cross-validation to predict the risk of breast cancer. The authors used area the under the receiver-operating characteristic curve (AUC), sensitivity, and specificity to evaluate discriminative performance of the radiologists and their ANN. The authors assessed the accuracy of risk prediction (ie, calibration) of their ANN by using the Hosmer-Lemeshow (H-L) goodness-of-fit test. RESULTS: Their ANN demonstrated superior discrimination (AUC, 0.965) compared with the radiologists (AUC, 0.939; P < .001). The authors' ANN was also well calibrated as shown by an H-L goodness of fit P-value of .13. CONCLUSIONS: The authors' ANN can effectively discriminate malignant abnormalities from benign ones and accurately predict the risk of breast cancer for individual abnormalities.

Original languageEnglish (US)
Pages (from-to)3310-3321
Number of pages12
JournalCancer
Volume116
Issue number14
DOIs
StatePublished - Jul 15 2010

Keywords

  • Breast cancer
  • Calibration
  • Computer-assisted decisions
  • Computer-assisted diagnosis
  • Computer-assisted radiographic image interpretation
  • Discrimination
  • Neural networks
  • Risk assessment

ASJC Scopus subject areas

  • Oncology
  • Cancer Research

Fingerprint Dive into the research topics of 'Breast cancer risk estimation with artificial neural networks revisited: Discrimination and calibration'. Together they form a unique fingerprint.

  • Cite this