A User-Centered Evaluation of a COVID-19 Intelligent Query System (COVID-IQS)

Danny T.Y. Wu; Fangyu Zhou; Wu Chen Su; Hoang Vu; Piyush Sahu; Brett Harnett; Tseng Ping Chiu; Craig Vogel; James J. Lee

doi:10.3233/SHTI220194

A User-Centered Evaluation of a COVID-19 Intelligent Query System (COVID-IQS)

Danny T.Y. Wu^*, Fangyu Zhou, Wu Chen Su, Hoang Vu, Piyush Sahu, Brett Harnett, Tseng Ping Chiu, Craig Vogel, James J. Lee

^*Corresponding author for this work

Library Administration

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

As the fight against COVID-19 continues, it is critical to discover and accumulate knowledge in scientific literature to combat the pandemic. In this work, we shared the experience in developing an intelligent query system on COVID-19 literature. We conducted a user-centered evaluation with 12 researchers in our institution and identified usability issues in four categories: distinct user needs, functionality errors, suboptimal information display, and implementation errors. Furthermore, we shared two lessons for building such a COVID-19 literature search engine. We will deploy the system and continue refining it through multiple phases of evaluation to aid in redesigning the system to accommodate different user roles as well as enhancing repository features to support collaborative information seeking. The successful implementation of the COVID-IQS can support knowledge discovery and hypothesis generation in our institution and can be shared with other institutions to make a broader impact.

Original language	English (US)
Title of host publication	MEDINFO 2021
Subtitle of host publication	One World, One Health - Global Partnership for Digital Innovation - Proceedings of the 18th World Congress on Medical and Health Informatics
Editors	Paula Otero, Philip Scott, Susan Z. Martin, Elaine Huesing
Publisher	IOS Press BV
Pages	824-828
Number of pages	5
ISBN (Electronic)	9781643682648
DOIs	https://doi.org/10.3233/SHTI220194
State	Published - Jun 6 2022
Event	18th World Congress on Medical and Health Informatics: One World, One Health - Global Partnership for Digital Innovation, MEDINFO 2021 - Virtual, Online Duration: Oct 2 2021 → Oct 4 2021

Publication series

Name	Studies in Health Technology and Informatics
Volume	290
ISSN (Print)	0926-9630
ISSN (Electronic)	1879-8365

Conference

Conference	18th World Congress on Medical and Health Informatics: One World, One Health - Global Partnership for Digital Innovation, MEDINFO 2021
City	Virtual, Online
Period	10/2/21 → 10/4/21

Funding

This research was funded by the COVID-19 Research Pilot Award co-sponsored by the College of Medicine and the Office of Research at the University of Cincinnati (PI: Wu, April 2020 to April 2021). We thank Ms. Chen Xin and Ms. Tianran (Vicky) Chen for their effort on interface design and heuristic evaluation. We also thank Ms. Anunita Nattam and Mr. Ruthvik Abbu for manuscript proofreading.

Keywords

COVID-19
Information Storage and Retrieval
User-Centered Design

ASJC Scopus subject areas

Health Information Management
Health Informatics
Biomedical Engineering

Access to Document

10.3233/SHTI220194

Cite this

Wu, D. T. Y., Zhou, F., Su, W. C., Vu, H., Sahu, P., Harnett, B., Chiu, T. P., Vogel, C., & Lee, J. J. (2022). A User-Centered Evaluation of a COVID-19 Intelligent Query System (COVID-IQS). In P. Otero, P. Scott, S. Z. Martin, & E. Huesing (Eds.), MEDINFO 2021: One World, One Health - Global Partnership for Digital Innovation - Proceedings of the 18th World Congress on Medical and Health Informatics (pp. 824-828). (Studies in Health Technology and Informatics; Vol. 290). IOS Press BV. https://doi.org/10.3233/SHTI220194

Wu, Danny T.Y. ; Zhou, Fangyu ; Su, Wu Chen et al. / A User-Centered Evaluation of a COVID-19 Intelligent Query System (COVID-IQS). MEDINFO 2021: One World, One Health - Global Partnership for Digital Innovation - Proceedings of the 18th World Congress on Medical and Health Informatics. editor / Paula Otero ; Philip Scott ; Susan Z. Martin ; Elaine Huesing. IOS Press BV, 2022. pp. 824-828 (Studies in Health Technology and Informatics).

@inproceedings{471450f1fbf943fd81e304aa7aba9fc9,

title = "A User-Centered Evaluation of a COVID-19 Intelligent Query System (COVID-IQS)",

abstract = "As the fight against COVID-19 continues, it is critical to discover and accumulate knowledge in scientific literature to combat the pandemic. In this work, we shared the experience in developing an intelligent query system on COVID-19 literature. We conducted a user-centered evaluation with 12 researchers in our institution and identified usability issues in four categories: distinct user needs, functionality errors, suboptimal information display, and implementation errors. Furthermore, we shared two lessons for building such a COVID-19 literature search engine. We will deploy the system and continue refining it through multiple phases of evaluation to aid in redesigning the system to accommodate different user roles as well as enhancing repository features to support collaborative information seeking. The successful implementation of the COVID-IQS can support knowledge discovery and hypothesis generation in our institution and can be shared with other institutions to make a broader impact.",

keywords = "COVID-19, Information Storage and Retrieval, User-Centered Design",

author = "Wu, {Danny T.Y.} and Fangyu Zhou and Su, {Wu Chen} and Hoang Vu and Piyush Sahu and Brett Harnett and Chiu, {Tseng Ping} and Craig Vogel and Lee, {James J.}",

note = "Publisher Copyright: {\textcopyright} 2022 International Medical Informatics Association (IMIA) and IOS Press.; 18th World Congress on Medical and Health Informatics: One World, One Health - Global Partnership for Digital Innovation, MEDINFO 2021 ; Conference date: 02-10-2021 Through 04-10-2021",

year = "2022",

month = jun,

day = "6",

doi = "10.3233/SHTI220194",

language = "English (US)",

series = "Studies in Health Technology and Informatics",

publisher = "IOS Press BV",

pages = "824--828",

editor = "Paula Otero and Philip Scott and Martin, {Susan Z.} and Elaine Huesing",

booktitle = "MEDINFO 2021",

}

Wu, DTY, Zhou, F, Su, WC, Vu, H, Sahu, P, Harnett, B, Chiu, TP, Vogel, C & Lee, JJ 2022, A User-Centered Evaluation of a COVID-19 Intelligent Query System (COVID-IQS). in P Otero, P Scott, SZ Martin & E Huesing (eds), MEDINFO 2021: One World, One Health - Global Partnership for Digital Innovation - Proceedings of the 18th World Congress on Medical and Health Informatics. Studies in Health Technology and Informatics, vol. 290, IOS Press BV, pp. 824-828, 18th World Congress on Medical and Health Informatics: One World, One Health - Global Partnership for Digital Innovation, MEDINFO 2021, Virtual, Online, 10/2/21. https://doi.org/10.3233/SHTI220194

A User-Centered Evaluation of a COVID-19 Intelligent Query System (COVID-IQS). / Wu, Danny T.Y.; Zhou, Fangyu; Su, Wu Chen et al.
MEDINFO 2021: One World, One Health - Global Partnership for Digital Innovation - Proceedings of the 18th World Congress on Medical and Health Informatics. ed. / Paula Otero; Philip Scott; Susan Z. Martin; Elaine Huesing. IOS Press BV, 2022. p. 824-828 (Studies in Health Technology and Informatics; Vol. 290).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - A User-Centered Evaluation of a COVID-19 Intelligent Query System (COVID-IQS)

AU - Wu, Danny T.Y.

AU - Zhou, Fangyu

AU - Su, Wu Chen

AU - Vu, Hoang

AU - Sahu, Piyush

AU - Harnett, Brett

AU - Chiu, Tseng Ping

AU - Vogel, Craig

AU - Lee, James J.

PY - 2022/6/6

Y1 - 2022/6/6

N2 - As the fight against COVID-19 continues, it is critical to discover and accumulate knowledge in scientific literature to combat the pandemic. In this work, we shared the experience in developing an intelligent query system on COVID-19 literature. We conducted a user-centered evaluation with 12 researchers in our institution and identified usability issues in four categories: distinct user needs, functionality errors, suboptimal information display, and implementation errors. Furthermore, we shared two lessons for building such a COVID-19 literature search engine. We will deploy the system and continue refining it through multiple phases of evaluation to aid in redesigning the system to accommodate different user roles as well as enhancing repository features to support collaborative information seeking. The successful implementation of the COVID-IQS can support knowledge discovery and hypothesis generation in our institution and can be shared with other institutions to make a broader impact.

AB - As the fight against COVID-19 continues, it is critical to discover and accumulate knowledge in scientific literature to combat the pandemic. In this work, we shared the experience in developing an intelligent query system on COVID-19 literature. We conducted a user-centered evaluation with 12 researchers in our institution and identified usability issues in four categories: distinct user needs, functionality errors, suboptimal information display, and implementation errors. Furthermore, we shared two lessons for building such a COVID-19 literature search engine. We will deploy the system and continue refining it through multiple phases of evaluation to aid in redesigning the system to accommodate different user roles as well as enhancing repository features to support collaborative information seeking. The successful implementation of the COVID-IQS can support knowledge discovery and hypothesis generation in our institution and can be shared with other institutions to make a broader impact.

KW - COVID-19

KW - Information Storage and Retrieval

KW - User-Centered Design

UR - http://www.scopus.com/inward/record.url?scp=85131491727&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85131491727&partnerID=8YFLogxK

U2 - 10.3233/SHTI220194

DO - 10.3233/SHTI220194

M3 - Conference contribution

C2 - 35673133

AN - SCOPUS:85131491727

T3 - Studies in Health Technology and Informatics

SP - 824

EP - 828

BT - MEDINFO 2021

A2 - Otero, Paula

A2 - Scott, Philip

A2 - Martin, Susan Z.

A2 - Huesing, Elaine

PB - IOS Press BV

T2 - 18th World Congress on Medical and Health Informatics: One World, One Health - Global Partnership for Digital Innovation, MEDINFO 2021

Y2 - 2 October 2021 through 4 October 2021

ER -

Wu DTY, Zhou F, Su WC, Vu H, Sahu P, Harnett B et al. A User-Centered Evaluation of a COVID-19 Intelligent Query System (COVID-IQS). In Otero P, Scott P, Martin SZ, Huesing E, editors, MEDINFO 2021: One World, One Health - Global Partnership for Digital Innovation - Proceedings of the 18th World Congress on Medical and Health Informatics. IOS Press BV. 2022. p. 824-828. (Studies in Health Technology and Informatics). doi: 10.3233/SHTI220194

A User-Centered Evaluation of a COVID-19 Intelligent Query System (COVID-IQS)

Abstract

Publication series

Conference

Funding

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this