ARSteth: Enabling Home Self-Screening with AR-Assisted Intelligent Stethoscopes

Kaiyuan Hou, Stephen Xia, Emily Bejerano, Junyi Wu, Xiaofan Jiang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The stethoscope is one of the most important diagnostic tools used by healthcare professionals, through a process called auscultation, to screen patients for abnormalities of the heart and lungs. While there are digital stethoscopes on the market which ease this process, it still takes years of training to properly use these devices to listen for abnormal sounds within the body. We present ARSteth, an intelligent stethoscope platform that improves the accessibility of stethoscopes for the general population, allowing anyone to perform auscultation in the comfort of their own homes. Our platform utilizes a combination of augmented reality (AR), acoustic intelligence, and human-machine interaction to dynamically guide users on where to place the stethoscope on different parts of the body (auscultation points), through visual and audio cues. Through user studies, we show that ARSteth, on average, can guide users within 13.2 mm from optimal auscultation points marked by licensed physicians in 13.09 seconds for each auscultation point. By guiding users towards more effective auscultation points, make preventative health screening more accessible and effective for everyone we are able to achieve higher confidence on classifying heart murmurs.

Original languageEnglish (US)
Title of host publicationIPSN 2023 - Proceedings of the 2023 22nd International Conference on Information Processing in Sensor Networks
PublisherAssociation for Computing Machinery, Inc
Pages205-218
Number of pages14
ISBN (Electronic)9798400701184
DOIs
StatePublished - May 9 2023
Event22nd ACM/IEEE International Conference on Information Processing in Sensor Networks, IPSN 2023 - San Antonio, United States
Duration: May 9 2023May 12 2023

Publication series

NameIPSN 2023 - Proceedings of the 2023 22nd International Conference on Information Processing in Sensor Networks

Conference

Conference22nd ACM/IEEE International Conference on Information Processing in Sensor Networks, IPSN 2023
Country/TerritoryUnited States
CitySan Antonio
Period5/9/235/12/23

Keywords

  • digital stethoscope
  • human computer interaction
  • smart home

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Information Systems
  • Information Systems and Management

Fingerprint

Dive into the research topics of 'ARSteth: Enabling Home Self-Screening with AR-Assisted Intelligent Stethoscopes'. Together they form a unique fingerprint.

Cite this