Posted On: Apr 27, 2020
Amazon Kinesis Data Firehose can now deliver streaming data to an Amazon Elasticsearch Service domain in an Amazon VPC. You can now easily ingest, transform, and reliably deliver streaming data in to an Amazon Elasticsearch Service domain running in a VPC without building and managing your own data ingestion and delivery infrastructure.
Amazon Kinesis Data Firehose is the easiest way to reliably load streaming data into data lakes, data stores and analytics tools. It can capture, transform, and load streaming data into Amazon S3, Amazon Redshift, Amazon Elasticsearch Service, and Splunk, enabling near real-time analytics with existing business intelligence tools and dashboards you are already using today. It is a fully managed service that automatically scales to match the throughput of your data and requires no ongoing administration. It can also batch, compress, convert, and encrypt the data before loading it, minimizing the amount of storage used at the destination and increasing security.
Amazon Elasticsearch Service makes it easy for you to deploy, secure, and run Elasticsearch cost effectively at scale. You can build, monitor, and troubleshoot your applications using the tools you love, at the scale you need. The service provides support for open source Elasticsearch APIs, managed Kibana, integration with Logstash and other Amazon Web Services services, and built-in alerting and SQL querying. With Amazon Elasticsearch Service, you get the ELK stack you need, without the operational overhead.
Placing an Amazon Elasticsearch Service domain within a VPC enables secure communication between Amazon Elasticsearch Service and other services within the VPC without the need for an internet gateway, NAT device, or VPN connection. Because of their logical isolation, domains that reside within a VPC have an extra layer of security when compared to domains that use public endpoints.
You can create a delivery stream in the Amazon Kinesis Console. To learn more, explore the Amazon Kinesis Data Firehose developer guide.
Amazon Kinesis Data Firehose and Amazon Elasticsearch Service are both available in the Amazon Web Services China (Beijing) Region, operated by Sinnet, and Amazon Web Services China (Ningxia) Region, operated by NWCD.