A lung cancer outcome calculator using ensemble data mining on SEER data

Ankit Agrawal*, Sanchit Misra, Ramanathan Narayanan, Lalith Polepeddi, Alok Nidhi Choudhary

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

21 Scopus citations

Abstract

We analyze the lung cancer data available from the SEER program with the aim of developing accurate survival prediction models for lung cancer using data mining techniques. Carefully designed preprocessing steps resulted in removal/ modification/splitting of several attributes, and 2 of the 11 derived attributes were found to have significant predictive power. Several data mining classification techniques were used on the preprocessed data along with various data mining optimizations and validations. In our experiments, ensemble voting of five decision tree based classifiers and meta-classifiers was found to result in the best prediction performance in terms of accuracy and area under the ROC curve. Further, we have developed an on-line lung cancer outcome calculator for estimating risk of mortality after 6 months, 9 months, 1 year, 2 year, and 5 years of diagnosis, for which a smaller non-redundant subset of 13 attributes was carefully selected using attribute selection techniques, while trying to retain the predictive power of the original set of attributes. The on-line lung cancer outcome calculator developed as a result of this study is available at http://info.eecs.northwestern.edu:8080/LungCancerOutcome-Calculator/.

Original languageEnglish (US)
Title of host publication10th International Workshop on Data Mining in Bioinformatics, BIOKDD 2011 - Held in Conjunction with SIGKDD Conference, the 17th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD-2011
DOIs
StatePublished - Aug 19 2011
Event10th International Workshop on Data Mining in Bioinformatics, BIOKDD 2011 - Held in Conjunction with the 17th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD-2011 - San Diego, CA, United States
Duration: Aug 21 2011Aug 24 2011

Publication series

NameProceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Other

Other10th International Workshop on Data Mining in Bioinformatics, BIOKDD 2011 - Held in Conjunction with the 17th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD-2011
CountryUnited States
CitySan Diego, CA
Period8/21/118/24/11

Keywords

  • Ensemble data mining
  • Lung cancer
  • Outcome calculator
  • Predictive modeling

ASJC Scopus subject areas

  • Software
  • Information Systems

Fingerprint Dive into the research topics of 'A lung cancer outcome calculator using ensemble data mining on SEER data'. Together they form a unique fingerprint.

Cite this