Designing audio-enhanced paper photos for older adult emotional wellbeing in communication therapy

Anne Marie Piper*, Nadir Weibel, James D. Hollan

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

22 Scopus citations


This article introduces audio-enhanced paper photos enabled by digital pen technology as an interaction paradigm for supporting and understanding emotional wellbeing in late adulthood, particularly in the context of communication therapy activities and related social interactions. We describe the development of a multimodal pen-based system that enables creation of audio-enhanced paper photos and the application of this technology to two domains: older adults with aphasia working to regain expressive and receptive language after a stroke, and older adults wanting to interact with a family member of advanced age with memory loss. Our pen-based authoring software enables caregivers, both therapists and family members, to create audio-enhanced paper photos to encourage meaningful and emotionally appropriate interaction with the older adults they support. We examine the ways in which emotional information is embedded in audio-enhanced photos and how this approach addresses various aspects of emotional wellbeing in late adulthood.

Original languageEnglish (US)
Pages (from-to)629-639
Number of pages11
JournalInternational Journal of Human Computer Studies
Issue number8-9
StatePublished - 2014


  • Audio
  • Communication
  • Digital pen
  • Emotional wellbeing
  • Older adults
  • Therapy

ASJC Scopus subject areas

  • Software
  • Human Factors and Ergonomics
  • Education
  • Engineering(all)
  • Human-Computer Interaction
  • Hardware and Architecture


Dive into the research topics of 'Designing audio-enhanced paper photos for older adult emotional wellbeing in communication therapy'. Together they form a unique fingerprint.

Cite this