Subordination: Providing Resilience to Simultaneous Failure of Multiple Cluster Nodes

In this paper we describe a new framework for creating distributed programmes which are resilient to cluster node failures. Our main goal is to create a simple and reliable model, that ensures continuous execution of parallel programmes without creation of checkpoints, memory dumps and other I/O intensive activities. To achieve this we introduce multi-layered system architecture, each layer of which consists of unified entities organised into hierarchies, and then show how this system handles different node failure scenarios. We benchmark our system on the example of real-world HPC application on both physical and virtual clusters. The results of the experiments show that our approach has low overhead and scales to a large number of cluster nodes.

• Git
• Preprint
• Published version

@inproceedings{gankevich2017subord,
  title={Subordination: Providing Resilience to Simultaneous Failure of Multiple Cluster Nodes},
  author={I. Gankevich and Y. Tipikin and V. Korkhov},
  publisher={IEEE},
  booktitle={Proceedings of HPCS'17},
  year={2017},
  month={07},
  nrefs={11},
  isbn={978-1-5386-3250-5},
  doi={10.1109/HPCS.2017.126},
  address={NJ, USA},
  pages={832--838},
  type={inproceedings}
}