TY - GEN
T1 - The user in experimental computer systems research
AU - Dinda, Peter A
AU - Memik, Gokhan
AU - Dick, Robert P.
AU - Lin, Bin
AU - Mallik, Arindam
AU - Gupta, Ashish
AU - Rossoff, Samuel
PY - 2007
Y1 - 2007
N2 - Experimental computer systems research typically ignores the end-user, modeling him, if at all, in overly simple ways. We argue that this (1) results in inadequate performance evaluation of the systems, and (2) ignores opportunities. We summarize our experiences with (a) directly evaluating user satisfaction and (b) incorporating user feedback in different areas of client/server computing, and use our experiences to motivate principles for that domain. Specifically, we report on user studies to measure user satisfaction with resource borrowing and with different clock frequencies in desktop computing, the development and evaluation of user interfaces to integrate user feedback into scheduling and clock frequency decisions in this context, and results in predicting user action and system response in a remote display system. We also present initial results on extending our work to user control of scheduling and mapping of virtual machines in a virtualization-based distributed computing environment. We then generalize (a) and (b) as recommendations for incorporating the user into experimental computer systems research.
AB - Experimental computer systems research typically ignores the end-user, modeling him, if at all, in overly simple ways. We argue that this (1) results in inadequate performance evaluation of the systems, and (2) ignores opportunities. We summarize our experiences with (a) directly evaluating user satisfaction and (b) incorporating user feedback in different areas of client/server computing, and use our experiences to motivate principles for that domain. Specifically, we report on user studies to measure user satisfaction with resource borrowing and with different clock frequencies in desktop computing, the development and evaluation of user interfaces to integrate user feedback into scheduling and clock frequency decisions in this context, and results in predicting user action and system response in a remote display system. We also present initial results on extending our work to user control of scheduling and mapping of virtual machines in a virtualization-based distributed computing environment. We then generalize (a) and (b) as recommendations for incorporating the user into experimental computer systems research.
KW - Autonomic systems
KW - Human directed adaptation
KW - Speculative remote display
KW - User comfort with resource borrowing
KW - User-driven power management
KW - User-driven scheduling
UR - http://www.scopus.com/inward/record.url?scp=37849024854&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=37849024854&partnerID=8YFLogxK
U2 - 10.1145/1281700.1281710
DO - 10.1145/1281700.1281710
M3 - Conference contribution
AN - SCOPUS:37849024854
SN - 9781595937513
T3 - Proceedings of the 2007 Workshop on Experimental Computer Science
BT - Proceedings of the 2007 Workshop on Experimental Computer Science
T2 - 2007 Workshop on Experimental Computer Science
Y2 - 25 June 2007 through 26 June 2007
ER -