Adaptive user interfaces for relating high-level concepts to low-level photographic parameters

Edward Scott, Pubudu Madhawa Silva, Bryan A Pardo, Thrasyvoulos N Pappas

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Common controls for photographic editing can be difficult to use and have a significant learning curve. Often, a user does not know a direct mapping from a high-level concept (such as "soft") to the available parameters or controls. In addition, many concepts are subjective in nature, and the appropriate mapping may vary from user to user. To overcome these problems, we propose a system that can quickly learn a mapping from a high-level subjective concept onto low- level image controls using machine learning techniques. To learn such a concept, the system shows the user a series of training images that are generated by modifying a seed image along different dimensions (e.g., color, sharpness), and collects the user ratings of how well each training image matches the concept. Since it is known precisely how each modified example is different from the original, the system can determine the correlation between the user ratings and the image parameters to generate a controller tailored to the concept for the given user. The end result - a personalized image controller - is applicable to a variety of concepts. We have demonstrated the utility of this approach to relate low-level parameters, such as color balance and sharpness, to simple concepts, such as "lightness" and "crispness," as well as more complex and subjective concepts, such as "pleasantness." We have also applied the proposed approach to relate subband statistics (variance) to perceived roughness of visual textures (from the CUReT database).

Original languageEnglish (US)
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - Human Vision and Electronic Imaging XVI
DOIs
StatePublished - Apr 11 2011
EventHuman Vision and Electronic Imaging XVI - San Francisco, CA, United States
Duration: Jan 24 2011Jan 27 2011

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume7865
ISSN (Print)0277-786X

Other

OtherHuman Vision and Electronic Imaging XVI
CountryUnited States
CitySan Francisco, CA
Period1/24/111/27/11

Keywords

  • Machine learning
  • image concept
  • perceived roughness
  • support vector regression

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Adaptive user interfaces for relating high-level concepts to low-level photographic parameters'. Together they form a unique fingerprint.

Cite this