A programming model and middleware for high throughput serverless computing applications

Alfonso Pérez, Germán Moltó, Miguel Caballer, and Amanda Calatrava. A programming model and middleware for high throughput serverless computing applications. In Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing, pp. 106–113, ACM, 4 2019.

Download

[843.2kB pdf]  [HTML] 

Abstract

Serverless computing has introduced unprecedented levels of scalability and parallelism for the execution of High Throughput Computing tasks. This represents a challenge and an opportunity for different scientific workloads to be adapted to upcoming programming models that simplify the usage of such platforms. In this paper we introduce a serverless model for highly-parallel file-processing applications. We also describe a middleware implementation that supports the execution of customized execution environments based on Docker images on AWS Lambda, the leading serverless computing platform. Moreover, this middleware offers tools to manage the input/output of the serverless infrastructure and the creation of HTTP endpoints in a transparent way to the user. To test the programming model proposed and the middleware, this paper describes two case studies. The first one analyzes medical images with a high degree of parallelism. The second one presents an architecture to analyze video keyframes. The results from both case studies are analyzed and a cost analysis of the medical image architecture comparing different cloud options is carried out. The results show that the combination of a high-level programming model with the scalable capabilities of AWS Lambda makes it easy for end users to efficiently exploit serverless computing for the optimized and cost-effective execution of loosely-coupled tasks.

BibTeX Entry

@inproceedings{Molto2019pmm,
   abstract = {Serverless computing has introduced unprecedented levels of scalability and parallelism for the execution of High Throughput Computing tasks. This represents a challenge and an opportunity for different scientific workloads to be adapted to upcoming programming models that simplify the usage of such platforms. In this paper we introduce a serverless model for highly-parallel file-processing applications. We also describe a middleware implementation that supports the execution of customized execution environments based on Docker images on AWS Lambda, the leading serverless computing platform. Moreover, this middleware offers tools to manage the input/output of the serverless infrastructure and the creation of HTTP endpoints in a transparent way to the user. To test the programming model proposed and the middleware, this paper describes two case studies. The first one analyzes medical images with a high degree of parallelism. The second one presents an architecture to analyze video keyframes. The results from both case studies are analyzed and a cost analysis of the medical image architecture comparing different cloud options is carried out. The results show that the combination of a high-level programming model with the scalable capabilities of AWS Lambda makes it easy for end users to efficiently exploit serverless computing for the optimized and cost-effective execution of loosely-coupled tasks.},
   author = {Alfonso Pérez and Germán Moltó and Miguel Caballer and Amanda Calatrava},
   city = {New York, NY, USA},
   doi = {10.1145/3297280.3297292},
   isbn = {9781450359337},
   booktitle = {Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing},
   keywords = {cloud computing,programming model,serverless computing},
   month = {4},
   pages = {106-113},
   publisher = {ACM},
   title = {A programming model and middleware for high throughput serverless computing applications},
   url = {https://dl.acm.org/doi/10.1145/3297280.3297292},
   year = {2019}
}