#Heapcon #AWS #cloudPatterns #DataLake #ETL #SERVERLESS

Heapcon 2019

2019 Belgrade, Serbia
Designing data intensive applications in serverless architecture
"Serverless patterns and best practices for data intensive applications"
I'll tell how to design serverless architecture for data intensive application in order to process a Data Lake or data streams. I'll tell how we did it using AWS cloud functions on Node.js running on thousands functions in parallel that process terabytes of data in ETL pipeline. Step by step we will build a serverless architecture for processing pipeline, consider the choice of services, queues, streams, databases and dive into the tuning of cloud functions to build a reliable massively scalable cloud computing platform. We will talk about the advantages of such an architecture and platform, their possible limitations and how to get around them.
Video in RU
56 minutes. You can watch it on youtube
Slides in EN
46 slides. You can download presentation in PDF