VNET/P: Bridging the cloud and high performance computing through fast overlay networking

Lei Xia*, Yuan Tang, Zheng Cui, Peter Dinda, John Lange, Patrick Bridges

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

17 Scopus citations

Abstract

It is now possible to allow VMs hosting HPC applications to seamlessly bridge distributed cloud resources and tightly-coupled supercomputing and cluster resources. However, to achieve the application performance that the tightly-coupled resources are capable of, it is important that the overlay network not introduce significant overhead relative to the native hardware, which is not the case for current user-level tools, including our own existing VNET/U system. In response, we describe the design, implementation, and evaluation of a layer 2 virtual networking system that has negligible latency and bandwidth overheads in 1-10 Gbps networks. Our system, VNET/P, is directly embedded into our publicly available Palacios virtual machine monitor (VMM). VNET/P achieves native performance on 1 Gbps Ethernet networks and very high performance on 10 Gbps Ethernet networks and InfiniBand. The NAS benchmarks generally achieve over 95% of their native performance on both 1 and 10 Gbps. These results suggest it is feasible to extend a software-based overlay network designed for computing at wide-area scales into tightly-coupled environments.

Original languageEnglish (US)
Title of host publicationHPDC '12 - Proceedings of the 21st ACM Symposium on High-Performance Parallel and Distributed Computing
Pages259-270
Number of pages12
DOIs
StatePublished - Jul 23 2012
Event21st ACM Symposium on High-Performance Parallel and Distributed Computing, HPDC '12 - Delft, Netherlands
Duration: Jun 18 2012Jun 22 2012

Publication series

NameHPDC '12 - Proceedings of the 21st ACM Symposium on High-Performance Parallel and Distributed Computing

Other

Other21st ACM Symposium on High-Performance Parallel and Distributed Computing, HPDC '12
CountryNetherlands
CityDelft
Period6/18/126/22/12

Keywords

  • HPC
  • Overlay Networks
  • Scalability
  • Virtualization

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'VNET/P: Bridging the cloud and high performance computing through fast overlay networking'. Together they form a unique fingerprint.

  • Cite this

    Xia, L., Tang, Y., Cui, Z., Dinda, P., Lange, J., & Bridges, P. (2012). VNET/P: Bridging the cloud and high performance computing through fast overlay networking. In HPDC '12 - Proceedings of the 21st ACM Symposium on High-Performance Parallel and Distributed Computing (pp. 259-270). (HPDC '12 - Proceedings of the 21st ACM Symposium on High-Performance Parallel and Distributed Computing). https://doi.org/10.1145/2287076.2287116