The garden of forking paths in visualization: A design space for reliable exploratory visual analytics : sition paper

Xiaoying Pu, Matthew Kay

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Scopus citations

Abstract

Tukey emphasized decades ago that taking exploratory findings as confirmatory is 'destructively foolish'. We reframe recent conversations about the reliability of results from exploratory visual analytics-such as the multiple comparisons problem-in terms of Gelman and Loken's garden of forking paths to lay out a design space for addressing the forking paths problem in visual analytics. This design space encompasses existing approaches to address the forking paths problem (multiple comparison correction) as well as solutions that have not been applied to exploratory visual analytics (regularization). We also discuss how perceptual bias correction techniques may be used to correct biases induced in analysts' understanding of their data due to the forking paths problem, and outline how this problem can be cast as a threat to validity within Munzner's Nested Model of visualization design. Finally, we suggest paper review guidelines to encourage reviewers to consider the forking paths problem when evaluating future designs of visual analytics tools.

Original languageEnglish (US)
Title of host publicationProceedings - 7th Biennial Workshop Evaluation and Beyond
Subtitle of host publicationMethodological Approaches for Visualization, BELIV 2018
EditorsMichael Sedlmair, Petra Isenberg, Tobias Isenberg, Miriah Meyer
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages37-45
Number of pages9
ISBN (Electronic)9781538668849
DOIs
StatePublished - Feb 4 2019
Externally publishedYes
Event7th Biennial Workshop Evaluation and Beyond: Methodological Approaches for Visualization, BELIV 2018 - Berlin, Germany
Duration: Oct 21 2018 → …

Publication series

NameProceedings - 7th Biennial Workshop Evaluation and Beyond: Methodological Approaches for Visualization, BELIV 2018

Conference

Conference7th Biennial Workshop Evaluation and Beyond: Methodological Approaches for Visualization, BELIV 2018
CountryGermany
CityBerlin
Period10/21/18 → …

Keywords

  • Human-centered computing
  • Visualization
  • Visualization design and evaluation methods

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Software

Fingerprint Dive into the research topics of 'The garden of forking paths in visualization: A design space for reliable exploratory visual analytics : sition paper'. Together they form a unique fingerprint.

Cite this