VM-based shared memory on low-latency, remote-memory-access networks

Leonidas Kontothanassis*, Galen Hunt, Robert Stets, Nikolaos Hardavellas, Michal Cierniak, Srinivasan Parthasarathy, Wagner Meira, Sandhya Dwarkadas, Michael Scott

*Corresponding author for this work

Research output: Contribution to journalConference article

31 Citations (Scopus)

Abstract

Recent technological advances have produced network interfaces that provide users with very low-latency access to the memory of remote machines. We examine the impact of such networks on the implementation and performance of software DSM. Specifically, we compare two DSM systems - Cashmere and TreadMarks - on a 32-processor DEC Alpha cluster connected by a Memory Channel network. Both Cashmere and TreadMarks use virtual memory to maintain coherence on pages, and both use lazy, multi-writer release consistency. The systems differ dramatically, however, in the mechanisms used to track sharing information and to collect and merge concurrent updates to a page, with the result that Cashmere communicates much more frequently, and at a much finer grain. Our principal conclusion is that low-latency networks make DSM based on fine-grain communication competitive with more coarse-grain approaches, but that further hardware improvements will be needed before such systems can provide consistently superior performance. In our experiments, Cashmere scales slightly better than TreadMarks for applications with false sharing. At the same time, it is severely constrained by limitations of the current Memory Channel hardware. In general, performance is better for TreadMarks.

Original languageEnglish (US)
Pages (from-to)157-169
Number of pages13
JournalConference Proceedings - Annual International Symposium on Computer Architecture, ISCA
StatePublished - Jan 1 1997
EventProceedings of the 1997 24th Annual International Symposium on Computer Architecture - Denver, CO, USA
Duration: Jun 2 1997Jun 4 1997

Fingerprint

Computer networks
Data storage equipment
Computer hardware
Interfaces (computer)
Hardware
Communication
Experiments

ASJC Scopus subject areas

  • Hardware and Architecture

Cite this

Kontothanassis, Leonidas ; Hunt, Galen ; Stets, Robert ; Hardavellas, Nikolaos ; Cierniak, Michal ; Parthasarathy, Srinivasan ; Meira, Wagner ; Dwarkadas, Sandhya ; Scott, Michael. / VM-based shared memory on low-latency, remote-memory-access networks. In: Conference Proceedings - Annual International Symposium on Computer Architecture, ISCA. 1997 ; pp. 157-169.
@article{12200c41e08f4b4eb6b9a600e8dbd90e,
title = "VM-based shared memory on low-latency, remote-memory-access networks",
abstract = "Recent technological advances have produced network interfaces that provide users with very low-latency access to the memory of remote machines. We examine the impact of such networks on the implementation and performance of software DSM. Specifically, we compare two DSM systems - Cashmere and TreadMarks - on a 32-processor DEC Alpha cluster connected by a Memory Channel network. Both Cashmere and TreadMarks use virtual memory to maintain coherence on pages, and both use lazy, multi-writer release consistency. The systems differ dramatically, however, in the mechanisms used to track sharing information and to collect and merge concurrent updates to a page, with the result that Cashmere communicates much more frequently, and at a much finer grain. Our principal conclusion is that low-latency networks make DSM based on fine-grain communication competitive with more coarse-grain approaches, but that further hardware improvements will be needed before such systems can provide consistently superior performance. In our experiments, Cashmere scales slightly better than TreadMarks for applications with false sharing. At the same time, it is severely constrained by limitations of the current Memory Channel hardware. In general, performance is better for TreadMarks.",
author = "Leonidas Kontothanassis and Galen Hunt and Robert Stets and Nikolaos Hardavellas and Michal Cierniak and Srinivasan Parthasarathy and Wagner Meira and Sandhya Dwarkadas and Michael Scott",
year = "1997",
month = "1",
day = "1",
language = "English (US)",
pages = "157--169",
journal = "Conference Proceedings - Annual International Symposium on Computer Architecture, ISCA",
issn = "0884-7495",

}

Kontothanassis, L, Hunt, G, Stets, R, Hardavellas, N, Cierniak, M, Parthasarathy, S, Meira, W, Dwarkadas, S & Scott, M 1997, 'VM-based shared memory on low-latency, remote-memory-access networks', Conference Proceedings - Annual International Symposium on Computer Architecture, ISCA, pp. 157-169.

VM-based shared memory on low-latency, remote-memory-access networks. / Kontothanassis, Leonidas; Hunt, Galen; Stets, Robert; Hardavellas, Nikolaos; Cierniak, Michal; Parthasarathy, Srinivasan; Meira, Wagner; Dwarkadas, Sandhya; Scott, Michael.

In: Conference Proceedings - Annual International Symposium on Computer Architecture, ISCA, 01.01.1997, p. 157-169.

Research output: Contribution to journalConference article

TY - JOUR

T1 - VM-based shared memory on low-latency, remote-memory-access networks

AU - Kontothanassis, Leonidas

AU - Hunt, Galen

AU - Stets, Robert

AU - Hardavellas, Nikolaos

AU - Cierniak, Michal

AU - Parthasarathy, Srinivasan

AU - Meira, Wagner

AU - Dwarkadas, Sandhya

AU - Scott, Michael

PY - 1997/1/1

Y1 - 1997/1/1

N2 - Recent technological advances have produced network interfaces that provide users with very low-latency access to the memory of remote machines. We examine the impact of such networks on the implementation and performance of software DSM. Specifically, we compare two DSM systems - Cashmere and TreadMarks - on a 32-processor DEC Alpha cluster connected by a Memory Channel network. Both Cashmere and TreadMarks use virtual memory to maintain coherence on pages, and both use lazy, multi-writer release consistency. The systems differ dramatically, however, in the mechanisms used to track sharing information and to collect and merge concurrent updates to a page, with the result that Cashmere communicates much more frequently, and at a much finer grain. Our principal conclusion is that low-latency networks make DSM based on fine-grain communication competitive with more coarse-grain approaches, but that further hardware improvements will be needed before such systems can provide consistently superior performance. In our experiments, Cashmere scales slightly better than TreadMarks for applications with false sharing. At the same time, it is severely constrained by limitations of the current Memory Channel hardware. In general, performance is better for TreadMarks.

AB - Recent technological advances have produced network interfaces that provide users with very low-latency access to the memory of remote machines. We examine the impact of such networks on the implementation and performance of software DSM. Specifically, we compare two DSM systems - Cashmere and TreadMarks - on a 32-processor DEC Alpha cluster connected by a Memory Channel network. Both Cashmere and TreadMarks use virtual memory to maintain coherence on pages, and both use lazy, multi-writer release consistency. The systems differ dramatically, however, in the mechanisms used to track sharing information and to collect and merge concurrent updates to a page, with the result that Cashmere communicates much more frequently, and at a much finer grain. Our principal conclusion is that low-latency networks make DSM based on fine-grain communication competitive with more coarse-grain approaches, but that further hardware improvements will be needed before such systems can provide consistently superior performance. In our experiments, Cashmere scales slightly better than TreadMarks for applications with false sharing. At the same time, it is severely constrained by limitations of the current Memory Channel hardware. In general, performance is better for TreadMarks.

UR - http://www.scopus.com/inward/record.url?scp=0030686646&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0030686646&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:0030686646

SP - 157

EP - 169

JO - Conference Proceedings - Annual International Symposium on Computer Architecture, ISCA

JF - Conference Proceedings - Annual International Symposium on Computer Architecture, ISCA

SN - 0884-7495

ER -