Posted On: Nov 13, 2024
Amazon Kinesis Data Streams released Kinesis Client Library (KCL) 3.0. KCL 3.0 introduces an enhanced load balancing algorithm that continuously monitors resource utilization of the stream processing workers and automatically redistributes the load from over-utilized worker to other underutilized workers. This ensures even CPU utilization across workers and removes the need to over-provision the stream processing compute workers, reducing compute costs by up to 33%. Additionally, KCL 3.0 is built with the Amazon SDK for Java 2.x for improved performance and security features, fully removing the dependency on the Amazon SDK for Java 1.x.
KCL is an open-source library that simplifies the development of stream processing applications with Amazon Kinesis Data Streams. It manages complex tasks associated with distributed computing such as load balancing, fault tolerance, and service coordination, allowing you to solely focus on your core business logic. You can upgrade your stream processing application running on KCL 2.x by simply replacing the current library using KCL 3.0, without any changes in your application code. KCL 3.0 supports stream processing applications running on Amazon EC2 instances or containers such as Amazon ECS, Amazon EKS, or Amazon Fargate.
KCL 3.0 is available in Amazon Web Services China (Beijing) Region, operated by Sinnet and Amazon Web Services China (Ningxia) Region, operated by NWCD. To learn more, see the Amazon Kinesis Data Streams developer guide.