Amazon Kinesis Firehose

Amazon Kinesis Firehose Source Plugin

Amazon Kinesis Firehose is a fully managed service provided by Amazon Web Services (AWS) that enables the collection, transformation, and delivery of streaming data to various data stores and analytics services. It is designed to provide a scalable and cost-effective way to process and analyze large volumes of data in real time.

Kinesis Firehose can automatically capture streaming data from various sources, such as IoT devices, mobile applications, social media, and clickstreams making it an ideal candidate for your telemetry data.

You can use the Amazon Kinesis Firehose Source Plugin to configure your calyptia core pipeline to collect data from your Amazon Kinesis Firehose instances.

Configuration Parameters

The following are configuration Parameters for Amazon Kinesis Firehose Source Plugin.

KeyDescription

Port

The port to listen for incoming Kinesis Firehose messages

The following are Advanced configuration Parameters for Amazon Kinesis Firehose Source Plugin.

KeyDescription

Tag Key

Specify the key name to overwrite a tag. If set, the tag will be overwritten by a value of the key.

Buffer Max Size

Specify the maximum buffer size in KB to receive a JSON message.

Buffer Chunk Size

This sets the chunk size for incoming incoming JSON messages. These chunks are then stored/managed in the space available by buffer_max_size.

Successful Response Code

It allows to set successful response codes. 200, 201 and 204 are supported.

The following are Security and TLS configuration Parameters for Amazon Kinesis Firehose Source Plugin.

KeyDescription

TLS

Enable or Disable TLS/SSL support

TLS Certificate Validation

Turn TLS/SSL certificate validation on / off, TLS must be on for this setting to be enabled.

TLS Debug Level

Set TLS debug verbosity level. It accepts the following values: 0 (No debug), 1 (Error), 2 (State change), 3 (Informational), and 4 Verbose

CA Certificate File Path

Absolute path to CA certificate file

Certificate File Path

Absolute path to Certificate file

Private key File Path

Absolute path to private Key file

Private Key Path Password

Optional password for tls.key_file file

TLS SNI Hostname Extension

Hostname to be used for TLS SNI Extension

Last updated