Ítem
Solo Metadatos
Evaluating the effectiveness of replication for tail-tolerance
Título de la revista
Autores
Qiu, Zhan
Pérez, Juan F.
Fecha
2015-05
Directores
ISSN de la revista
Título del volumen
Editor
IEEE
Citations
Métricas alternativas
Resumen
Abstract
Computing clusters (CC) are a cost-effective high-performance platform for computation-intensive scientific and engineering applications. A key challenge in managing CCs is to consistently achieve low response times. In particular, tail-tolerant methods aim to keep the tail of the response-time distribution short. In this paper we explore concurrent replication with canceling, a tail-tolerant approach that involves processing requests and their replicas concurrently, retrieving the result from the first replica that completes, and canceling all other replicas. We propose a stochastic model that considers any number of replicas, general processing and inter-arrival times, and computes the response time distribution. We show that replication can be very effective in keeping the response-time tail short, but these benefits highly depend on the processing-time distribution, as well as on the CC utilization and the statistical characteristics of the arrival process. We also exploit the model to support the selection of the optimal number of replicas, and a resource provisioning strategy that meets service-level objectives on the response-time percentiles.
Palabras clave
Keywords
Computing clusters , Concurrent replication , Computer system
