A self-managed Mesos cluster for data analytics with QoS guarantees

Sergio López-Huguet, Alfonso Pérez, Amanda Calatrava, Carlos de Alfonso, Miguel Caballer, Germán Moltó, and Ignacio Blanquer. A self-managed Mesos cluster for data analytics with QoS guarantees. Future Generation Computer Systems, 96:449–461, 7 2019.

Download

[666.9kB pdf]  [HTML] 

Abstract

This article describes the development of an automated configuration of a software platform for Data Analytics that supports horizontal and vertical elasticity to guarantee meeting a specific deadline. It specifies all the components, software dependencies and configurations required to build up the cluster, and analyses the deployment times of different instances, as well as the horizontal and vertical elasticity. The approach followed builds up self-managed hybrid clusters that can deal with different workloads and net- work requirements. The article describes the structure of the recipes, points out to public repositories where the code is available and discusses the limitations of the approach as well as the results of several experiments.

BibTeX Entry

@article{Lopez-Huguet2019,
   abstract = {This article describes the development of an automated configuration of a software platform for Data Analytics that supports horizontal and vertical elasticity to guarantee meeting a specific deadline. It specifies all the components, software dependencies and configurations required to build up the cluster, and analyses the deployment times of different instances, as well as the horizontal and vertical elasticity. The approach followed builds up self-managed hybrid clusters that can deal with different workloads and net- work requirements. The article describes the structure of the recipes, points out to public repositories where the code is available and discusses the limitations of the approach as well as the results of several experiments.},
   author = {Sergio López-Huguet and Alfonso Pérez and Amanda Calatrava and Carlos de Alfonso and Miguel Caballer and Germán Moltó and Ignacio Blanquer},
   doi = {10.1016/j.future.2019.02.047},
   issn = {0167739X},
   issue = {96},
   journal = {Future Generation Computer Systems},
   keywords = {Cloud Orchestration,Data Analytics,Elasticity,Hybrid Clusters,Quality of Service},
   month = {7},
   pages = {449-461},
   title = {A self-managed Mesos cluster for data analytics with QoS guarantees},
   volume = {96},
   url = {https://linkinghub.elsevier.com/retrieve/pii/S0167739X18311087},
   year = {2019}
}