Harness over 40 enterprise-class cloud services to drive business efficiency

 ✕

Home  »  Products  »  Amazon MWAA

Amazon MWAA

Secure and highly available managed workflow orchestration for Apache Airflow

Home  »  Products  »  Amazon MWAA

Amazon MWAA

Secure and highly available managed workflow orchestration for Apache Airflow

Features

Deploy Apache Airflow at scale without the operational burden of managing underlying infrastructure.
Run Apache Airflow workloads in your own isolated and secure cloud environment.
Monitor environments through Amazon CloudWatch integration to reduce operating costs and engineering overhead.
Connect to cloud or on-premises resources through Apache Airflow providers or custom plugins.

Features

Deploy Apache Airflow at scale without the operational burden of managing underlying infrastructure.

Run Apache Airflow workloads in your own isolated and secure cloud environment.

Monitor environments through Amazon CloudWatch integration to reduce operating costs and engineering overhead.

Connect to cloud or on-premises resources through Apache Airflow providers or custom plugins.

How It Works

Amazon Managed Workflows for Apache Airflow (MWAA) orchestrates your workflows using Directed Acyclic Graphs (DAGs) written in Python. You provide MWAA an Amazon Simple Storage Service (S3) bucket where your DAGs, plugins, and Python requirements reside. Then run and monitor your DAGs from the Management Console, a command line interface (CLI), a software development kit (SDK), or the Apache Airflow user interface (UI).

How It Works

Amazon Managed Workflows for Apache Airflow (MWAA) orchestrates your workflows using Directed Acyclic Graphs (DAGs) written in Python. You provide MWAA an Amazon Simple Storage Service (S3) bucket where your DAGs, plugins, and Python requirements reside. Then run and monitor your DAGs from the Management Console, a command line interface (CLI), a software development kit (SDK), or the Apache Airflow user interface (UI).

Use Cases

Support Complex Workflows
Create scheduled or on-demand workflows that prepare and process complicated data from big data providers.
Coordinate Extract, Transform, and Load (ETL) Jobs
Orchestrate multiple ETL processes that use diverse technologies within a complex ETL workflow.
Prepare ML Data
Automate your pipeline to help machine learning (ML) modeling systems ingest and then train on data.

Use Cases

Support Complex Workflows

Create scheduled or on-demand workflows that prepare and process complicated data from big data providers.

Coordinate Extract, Transform, and Load (ETL) Jobs

Orchestrate multiple ETL processes that use diverse technologies within a complex ETL workflow.

Prepare ML Data

Automate your pipeline to help machine learning (ML) modeling systems ingest and then train on data.