Automatic Extraction of Skeletal Maturity from Whole Body Pediatric Scoliosis X-rays Using Regional Proposal and Compound Scaling Convolutional Neural Networks

Audrey Ha, John Vorhies, Andrew Campion, Charles Fang, Michael Fadell, Steve Dou, Safwan Halabi, David Larson, Emily Wang, Yong Jin Lee, Joanna Langner, Japsimran Kaur, Bao Do

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Skeletal maturity assessment plays an important role in the management of pediatric orthopedic conditions such as scoliosis, slipped capital femoral epiphysis (SCFE), and pectus. The most common methods to estimate bone age are the use of hand, shoulder, and pelvis x-rays; however, integrating multi-site data adds cost and ionizing radiation exposure. Whole body pediatric scoliosis x-rays, performed for measuring curvature of the spine, include in the field of view multiple development landmarks such as ossifications of the shoulder, pelvis, and proximal femurs in a single exam, potentially providing a comprehensive survey of skeletal maturity that can assist in surgical planning. Therefore, we propose a system to automatically extract multiple skeletal maturity classifications from a single whole body scoliosis x-ray exam. Since these anatomic regions of significance are as small as 2% of the image, we first apply a multi-class region proposal network to extract the humeral head and five pelvic regions based on the modified Oxford Bone Score. We then apply multiple compound scaling convolutional neural networks (EfficientNet) in parallel to clinically stage each region. Our regional detection achieved an F1-score of 0.99, and our staging models achieved an overall accuracy of 89% and intraclass correlation coefficient of 0.84. Our work holds promise for a skeletal maturity assessment system that uses a single image of the entire axial skeleton. This may enable more data points for surgical planning of orthopedic diseases in pediatric patients while minimizing exposure to harmful radiation.

Original languageEnglish (US)
Title of host publicationProceedings - 2020 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2020
EditorsTaesung Park, Young-Rae Cho, Xiaohua Tony Hu, Illhoi Yoo, Hyun Goo Woo, Jianxin Wang, Julio Facelli, Seungyoon Nam, Mingon Kang
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages996-1000
Number of pages5
ISBN (Electronic)9781728162157
DOIs
StatePublished - Dec 16 2020
Event2020 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2020 - Virtual, Seoul, Korea, Republic of
Duration: Dec 16 2020Dec 19 2020

Publication series

NameProceedings - 2020 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2020

Conference

Conference2020 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2020
Country/TerritoryKorea, Republic of
CityVirtual, Seoul
Period12/16/2012/19/20

Keywords

  • convolutional neural networks
  • machine learning
  • modified Oxford Bone Score
  • scoliosis
  • skeletal maturity

ASJC Scopus subject areas

  • Computer Science Applications
  • Information Systems and Management
  • Medicine (miscellaneous)
  • Health Informatics

Fingerprint

Dive into the research topics of 'Automatic Extraction of Skeletal Maturity from Whole Body Pediatric Scoliosis X-rays Using Regional Proposal and Compound Scaling Convolutional Neural Networks'. Together they form a unique fingerprint.

Cite this