Lung cancer survival prediction using ensemble data mining on SEER data

Ankit Agrawal*, Sanchit Misra, Ramanathan Narayanan, Lalith Polepeddi, Alok Nidhi Choudhary

*Corresponding author for this work

Research output: Contribution to journalArticle

27 Scopus citations

Abstract

We analyze the lung cancer data available from the SEER program with the aim of developing accurate survival prediction models for lung cancer. Carefully designed preprocessing steps resulted in removal/modification/splitting of several attributes, and 2 of the 11 derived attributes were found to have significant predictive power. Several supervised classification methods were used on the preprocessed data along with various data mining optimizations and validations. In our experiments, ensemble voting of five decision tree based classifiers and meta-classifiers was found to result in the best prediction performance in terms of accuracy and area under the ROC curve. We have developed an on-line lung cancer outcome calculator for estimating the risk of mortality after 6 months, 9 months, 1 year, 2 year and 5 years of diagnosis, for which a smaller non-redundant subset of 13 attributes was carefully selected using attribute selection techniques, while trying to retain the predictive power of the original set of attributes. Further, ensemble voting models were also created for predicting conditional survival outcome for lung cancer (estimating risk of mortality after 5 years of diagnosis, given that the patient has already survived for a period of time), and included in the calculator. The on-line lung cancer outcome calculator developed as a result of this study is available at http://info.eecs.northwestern.edu:8080/LungCancerOutcomeCalculator/.

Original languageEnglish (US)
Pages (from-to)29-42
Number of pages14
JournalScientific Programming
Volume20
Issue number1
DOIs
StatePublished - Jan 1 2012

Keywords

  • Ensemble data mining
  • lung cancer
  • outcome calculator
  • predictive modeling

ASJC Scopus subject areas

  • Software
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Lung cancer survival prediction using ensemble data mining on SEER data'. Together they form a unique fingerprint.

  • Cite this