AWS has announced the general availability of Amazon Managed Workflows for Apache Airflow (MWAA). The new managed service makes it easy for data engineers to execute data processing workflows in the cloud.
Apache Airflow is an open-source tool that helps customers author, schedule, and monitor workflows. Amazon MWAA scales workflow execution capacity based on customer needs, and integrates with AWS security services to provide secure access to customers’ data. There are no up-front investments required to use Amazon MWAA and customers only pay for what they use.
Amazon MWAA makes it easy for customers to build and execute Apache Airflow workflows in AWS. Amazon MWAA manages the provisioning and ongoing maintenance of Apache Airflow so customers no longer need to worry about patching, scaling, or securing self-managed Apache Airflow implementations.
With Amazon MWAA, compute resources that execute tasks are scaled on demand.
Further, Amazon MWAA makes it easy for customers to combine data using any of Apache Airflow’s integrations to automate data processing, machine learning pipelines, and software development and operations.
Customers can launch a new Amazon MWAA environment from the AWS Management Console, CLI, AWS CloudFormation, or AWS SDK, and start running in minutes.
Amazon MWAA is now available in US East (Northern Virginia), US West (Oregon), US East (Ohio), Asia Pacific (Singapore), Asia Pacific (Tokyo), Asia Pacific (Sydney), Europe (Ireland), Europe (Frankfurt), and Europe (Stockholm), with more regions to come.