An evaluation of asynchronous software events on modern hardware

Kyle Hale, Peter A Dinda

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Runtimes and applications that rely heavily on asynchronous event notifications suffer when such notifications must traverse several layers of processing in software. Many of these layers necessarily exist in order to support a general-purpose, portable kernel architecture, but they introduce considerable overheads for demanding, high-performance parallel runtimes and applications. Other overheads can arise from a mismatched event programming or system call interface. Whatever the case, the average latency and variance in latency of commonly used software mechanisms for event notifications is abysmal compared to the capabilities of the hardware, which can exhibit orders of magnitude lower latency. We leverage the flexibility and freedom of the previously proposed Hybrid Runtime (HRT) model to explore the construction of low-latency, asynchronous software events uninhibited by interfaces and execution models commonly imposed by general-purpose OSes. We propose several mechanisms in a system we call Nemo which employs kernel mode-only features to accelerate event notifications by up to 4,000 times and we provide a detailed evaluation of our implementation using extensive microbenchmarks. We carry out our evaluation both on a modern x64 server and the Intel Xeon Phi. Finally, we propose a small addition to existing interrupt controllers (APICs) that could push the limit of asynchronous events closer to the latency of the hardware cache coherence network.

Original languageEnglish (US)
Title of host publicationProceedings - 26th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages355-368
Number of pages14
ISBN (Electronic)9781538668863
DOIs
StatePublished - Nov 7 2018
Event26th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS 2018 - Milwaukee, United States
Duration: Sep 25 2018Sep 28 2018

Other

Other26th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS 2018
CountryUnited States
CityMilwaukee
Period9/25/189/28/18

Fingerprint

Latency
Hardware
Software
Evaluation
Servers
Controllers
Processing
kernel
Cache Coherence
Leverage
Accelerate
Server
Programming
High Performance
Flexibility
Controller
Model

Keywords

  • Hybrid runtimes
  • Operating systems
  • Software events

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Modeling and Simulation

Cite this

Hale, K., & Dinda, P. A. (2018). An evaluation of asynchronous software events on modern hardware. In Proceedings - 26th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS 2018 (pp. 355-368). [8526899] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/MASCOTS.2018.00041
Hale, Kyle ; Dinda, Peter A. / An evaluation of asynchronous software events on modern hardware. Proceedings - 26th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS 2018. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 355-368
@inproceedings{0d85a3eaff7b4f72998ddd9f9ea0371b,
title = "An evaluation of asynchronous software events on modern hardware",
abstract = "Runtimes and applications that rely heavily on asynchronous event notifications suffer when such notifications must traverse several layers of processing in software. Many of these layers necessarily exist in order to support a general-purpose, portable kernel architecture, but they introduce considerable overheads for demanding, high-performance parallel runtimes and applications. Other overheads can arise from a mismatched event programming or system call interface. Whatever the case, the average latency and variance in latency of commonly used software mechanisms for event notifications is abysmal compared to the capabilities of the hardware, which can exhibit orders of magnitude lower latency. We leverage the flexibility and freedom of the previously proposed Hybrid Runtime (HRT) model to explore the construction of low-latency, asynchronous software events uninhibited by interfaces and execution models commonly imposed by general-purpose OSes. We propose several mechanisms in a system we call Nemo which employs kernel mode-only features to accelerate event notifications by up to 4,000 times and we provide a detailed evaluation of our implementation using extensive microbenchmarks. We carry out our evaluation both on a modern x64 server and the Intel Xeon Phi. Finally, we propose a small addition to existing interrupt controllers (APICs) that could push the limit of asynchronous events closer to the latency of the hardware cache coherence network.",
keywords = "Hybrid runtimes, Operating systems, Software events",
author = "Kyle Hale and Dinda, {Peter A}",
year = "2018",
month = "11",
day = "7",
doi = "10.1109/MASCOTS.2018.00041",
language = "English (US)",
pages = "355--368",
booktitle = "Proceedings - 26th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

Hale, K & Dinda, PA 2018, An evaluation of asynchronous software events on modern hardware. in Proceedings - 26th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS 2018., 8526899, Institute of Electrical and Electronics Engineers Inc., pp. 355-368, 26th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS 2018, Milwaukee, United States, 9/25/18. https://doi.org/10.1109/MASCOTS.2018.00041

An evaluation of asynchronous software events on modern hardware. / Hale, Kyle; Dinda, Peter A.

Proceedings - 26th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS 2018. Institute of Electrical and Electronics Engineers Inc., 2018. p. 355-368 8526899.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - An evaluation of asynchronous software events on modern hardware

AU - Hale, Kyle

AU - Dinda, Peter A

PY - 2018/11/7

Y1 - 2018/11/7

N2 - Runtimes and applications that rely heavily on asynchronous event notifications suffer when such notifications must traverse several layers of processing in software. Many of these layers necessarily exist in order to support a general-purpose, portable kernel architecture, but they introduce considerable overheads for demanding, high-performance parallel runtimes and applications. Other overheads can arise from a mismatched event programming or system call interface. Whatever the case, the average latency and variance in latency of commonly used software mechanisms for event notifications is abysmal compared to the capabilities of the hardware, which can exhibit orders of magnitude lower latency. We leverage the flexibility and freedom of the previously proposed Hybrid Runtime (HRT) model to explore the construction of low-latency, asynchronous software events uninhibited by interfaces and execution models commonly imposed by general-purpose OSes. We propose several mechanisms in a system we call Nemo which employs kernel mode-only features to accelerate event notifications by up to 4,000 times and we provide a detailed evaluation of our implementation using extensive microbenchmarks. We carry out our evaluation both on a modern x64 server and the Intel Xeon Phi. Finally, we propose a small addition to existing interrupt controllers (APICs) that could push the limit of asynchronous events closer to the latency of the hardware cache coherence network.

AB - Runtimes and applications that rely heavily on asynchronous event notifications suffer when such notifications must traverse several layers of processing in software. Many of these layers necessarily exist in order to support a general-purpose, portable kernel architecture, but they introduce considerable overheads for demanding, high-performance parallel runtimes and applications. Other overheads can arise from a mismatched event programming or system call interface. Whatever the case, the average latency and variance in latency of commonly used software mechanisms for event notifications is abysmal compared to the capabilities of the hardware, which can exhibit orders of magnitude lower latency. We leverage the flexibility and freedom of the previously proposed Hybrid Runtime (HRT) model to explore the construction of low-latency, asynchronous software events uninhibited by interfaces and execution models commonly imposed by general-purpose OSes. We propose several mechanisms in a system we call Nemo which employs kernel mode-only features to accelerate event notifications by up to 4,000 times and we provide a detailed evaluation of our implementation using extensive microbenchmarks. We carry out our evaluation both on a modern x64 server and the Intel Xeon Phi. Finally, we propose a small addition to existing interrupt controllers (APICs) that could push the limit of asynchronous events closer to the latency of the hardware cache coherence network.

KW - Hybrid runtimes

KW - Operating systems

KW - Software events

UR - http://www.scopus.com/inward/record.url?scp=85058293966&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85058293966&partnerID=8YFLogxK

U2 - 10.1109/MASCOTS.2018.00041

DO - 10.1109/MASCOTS.2018.00041

M3 - Conference contribution

AN - SCOPUS:85058293966

SP - 355

EP - 368

BT - Proceedings - 26th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Hale K, Dinda PA. An evaluation of asynchronous software events on modern hardware. In Proceedings - 26th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 355-368. 8526899 https://doi.org/10.1109/MASCOTS.2018.00041