Amazon Kinesis Firehose

Amazon Kinesis Firehose Source Plugin

Amazon Kinesis Firehose is a fully managed service provided by Amazon Web Services (AWS) that enables the collection, transformation, and delivery of streaming data to various data stores and analytics services. It is designed to provide a scalable and cost-effective way to process and analyze large volumes of data in real time.
Kinesis Firehose can automatically capture streaming data from various sources, such as IoT devices, mobile applications, social media, and clickstreams making it an ideal candidate for your telemetry data.
You can use the Amazon Kinesis Firehose Source Plugin to configure your calyptia core pipeline to collect data from your Amazon Kinesis Firehose instances.
Configuration Parameters
The following are configuration Parameters for Amazon Kinesis Firehose Source Plugin.
Key
Description
Port
The port to listen for incoming Kinesis Firehose messages
The following are Advanced configuration Parameters for Amazon Kinesis Firehose Source Plugin.
Key
Description
Tag Key
Specify the key name to overwrite a tag. If set, the tag will be overwritten by a value of the key.
Buffer Max Size
Specify the maximum buffer size in KB to receive a JSON message.
Buffer Chunk Size
This sets the chunk size for incoming incoming JSON messages. These chunks are then stored/managed in the space available by buffer_max_size.
Successful Response Code
It allows to set successful response codes. 200, 201 and 204 are supported.
The following are Security and TLS configuration Parameters for Amazon Kinesis Firehose Source Plugin.
Key
Description
TLS
Enable or Disable TLS/SSL support
TLS Certificate Validation
Turn TLS/SSL certificate validation on / off, TLS must be on for this setting to be enabled.
TLS Debug Level
Set TLS debug verbosity level. It accepts the following values: 0 (No debug), 1 (Error), 2 (State change), 3 (Informational), and 4 Verbose
CA Certificate File Path
Absolute path to CA certificate file
Certificate File Path
Absolute path to Certificate file
Private key File Path
Absolute path to private Key file
Private Key Path Password
Optional password for tls.key_file file
TLS SNI Hostname Extension
Hostname to be used for TLS SNI Extension

Key	Description
Port	The port to listen for incoming Kinesis Firehose messages

Key	Description
Tag Key	Specify the key name to overwrite a tag. If set, the tag will be overwritten by a value of the key.
Buffer Max Size	Specify the maximum buffer size in KB to receive a JSON message.
Buffer Chunk Size	This sets the chunk size for incoming incoming JSON messages. These chunks are then stored/managed in the space available by buffer_max_size.
Successful Response Code	It allows to set successful response codes. 200, 201 and 204 are supported.

Key	Description
TLS	Enable or Disable TLS/SSL support
TLS Certificate Validation	Turn TLS/SSL certificate validation on / off, TLS must be on for this setting to be enabled.
TLS Debug Level	Set TLS debug verbosity level. It accepts the following values: 0 (No debug), 1 (Error), 2 (State change), 3 (Informational), and 4 Verbose
CA Certificate File Path	Absolute path to CA certificate file
Certificate File Path	Absolute path to Certificate file
Private key File Path	Absolute path to private Key file
Private Key Path Password	Optional password for tls.key_file file
TLS SNI Hostname Extension	Hostname to be used for TLS SNI Extension

S3 Input

Azure Event Hub

Last modified 2mo ago