Data Transfer Hub

The Amazon CloudFormation template automatically deploys and configures a serverless architecture with services like Amazon AppSync, Amazon DynamoDB, Amazon ECS Fargate, Amazon Lambda, Amazon Step Functions and etc. The solution comes with a web portal hosted on Amazon Simple Storage Service (Amazon S3), and made available through Amazon CloudFront. You can authenticate against Amazon Cognito User Pool or OpenID Connect (OIDC) provider. If you deploy this solution in Amazon Web Services (Beijing) Region operated by Sinnet or Amazon Web Services (Ningxia) Region operated by NWCD, you are required to file for ICP Recordal or ICP License before you can access the web frontend, please refer to deployment guide for more details.

The web portal serves as a centralized place to create and manage the data transfer jobs. Each data type (e.g., Amazon S3) is a plugin for Data Transfer Hub, and packaged as an Amazon CloudFormation template hosted in a centralized S3 Bucket. When the you create a transfer task, a Lambda will trigger CloudFormation to start rolling, and all the state of tasks is stored in DynamoDB tables. According to this design, you can run each plugin independently.  Moreover, Developer can easily contribute CloudFormation packaged transfer plugin to Data Transfer Hub.