Posted On: Nov 7, 2024
Today, we add job queuing for Amazon Glue jobs. This new capability enables you to submit Amazon Glue job runs without needing to manage account level quotas and limits.
Amazon Glue job queuing monitors your account level quotas and limits. If quotas or limits are insufficient to start a Glue job run, Amazon Glue will automatically queue the job and wait for limits to free up. Once limits become available, Amazon Glue will retry the job run. Glue jobs will queue for limits like max concurrent job runs per account, max concurrent Data Processing Units (DPU), and resource unavailable due to IP address exhaustion in your Amazon Virtual Private Cloud (Amazon VPC). Amazon Glue job queuing can be enabled on your jobs via the Amazon Web Services Management console or Amazon API/CLI.
Amazon Glue job queuing is available in Amazon Web Services China (Beijing) Region, operated by Sinnet, and Amazon Web Services China (Ningxia) Region, operated by NWCD. To learn more, visit the Amazon Glue product page and our documentation.