Running Amazon EMR at low cost with Amazon EC2 Spot Instances and Amazon Managed Workflows for Apach

April 18, 2021
Many AWS customers are using EC2 Spot Instances in Amazon EMR to achieve significant cost savings. Developers and data engineers use Apache Airflow to programmatically execute their extract-transform-load (ETL) jobs on Amazon EMR. In this session, learn the best practices for running Amazon EMR on Amazon EC2 Spot Instances with a sample Airflow DAG and explore the features that Amazon EMR offers to reduce the cost of operating big data analytics workloads using Spot Instances. Gain insights from a demo on how to create Amazon Managed Workflows for Apache Airflow environment and create a workflow which can launch EMR cluster with Spot best practices, as well as submit Spark jobs to EMR cluster and terminate EMR cluster at the end of the workflow. AWS Speaker: Jagdeep Phoolkumar, Sr, EC2 Spot Specialist SA, AWS
Previous Video
Simplifying LoRaWAN Deployment with AWS IoT Core for LoRaWAN [L300]
Simplifying LoRaWAN Deployment with AWS IoT Core for LoRaWAN [L300]

AWS IoT Core for LoRaWAN is a fully-managed feature that allows enterprises to rapidly deploy private LoRaW...

Next Video
Powering telecommunications architecture evolution beyond 5G/Edge [L200]
Powering telecommunications architecture evolution beyond 5G/Edge [L200]

Join this session to understand how AWS, in conjunction with its telecom ecosystem partners, have worked ho...