PlateMate: Crowdsourcing nutrition analysis from food photographs

Jon Noronha*, Eric Hysen, Haoqi Zhang, Krzysztof Z. Gajos

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

156 Scopus citations

Abstract

We introduce PlateMate, a system that allows users to take photos of their meals and receive estimates of food intake and composition. Accurate awareness of this information can help people monitor their progress towards dieting goals, but current methods for food logging via self-reporting, expert observation, or algorithmic analysis are time-consuming, expensive, or inaccurate. PlateMate crowdsources nutritional analysis from photographs using Amazon Mechanical Turk, automatically coordinating untrained workers to estimate a meal's calories, fat, carbohydrates, and protein. We present the Management framework for crowdsourcing complex tasks, which supports PlateMate's nutrition analysis workflow. Results of our evaluations show that PlateMate is nearly as accurate as a trained dietitian and easier to use for most users than traditional self-reporting.

Original languageEnglish (US)
Title of host publicationUIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology
Pages1-11
Number of pages11
DOIs
StatePublished - Nov 14 2011
Event24th Annual ACM Symposium on User Interface Software and Technology, UIST'11 - Santa Barbara, CA, United States
Duration: Oct 16 2011Oct 19 2011

Publication series

NameUIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology

Other

Other24th Annual ACM Symposium on User Interface Software and Technology, UIST'11
CountryUnited States
CitySanta Barbara, CA
Period10/16/1110/19/11

Keywords

  • Crowdsourcing
  • Human computation
  • Mechanical Turk
  • Nutrition
  • Remote food photography

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Software

Fingerprint Dive into the research topics of 'PlateMate: Crowdsourcing nutrition analysis from food photographs'. Together they form a unique fingerprint.

  • Cite this

    Noronha, J., Hysen, E., Zhang, H., & Gajos, K. Z. (2011). PlateMate: Crowdsourcing nutrition analysis from food photographs. In UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (pp. 1-11). (UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology). https://doi.org/10.1145/2047196.2047198