Azure EventHub

Azure EventHub Destination Plugin

Azure Event Hubs is a cloud-based data streaming platform that enables you to ingest and process large volumes of event data from various sources in real-time. It allows you to collect, store, and analyze data from millions of events generated by your applications and services, and enables you to take real-time actions based on that data.
Azure Event Hubs provides a highly scalable and reliable platform for event streaming. Use the Azure Event Hubs destination plugin to easily configure your Calyptia Core pipeline to stream your logs and metrics data directly to Azure Event Hubs.
Configuration Parameters
The following are configuration Parameters for Azure EventHub Destination Plugin.
Key
Description
Event Hub Namespace
The EventHub Namespace that can be found within the configuration settings
Event Hub Topic
The Event Hub Topic to write information to
Connection String Key
The Event Hub Connection String from within the Connection Access Policy set for the source
The following are Advanced configuration Parameters for Azure EventHub Destination Plugin.
Key
Description
Message Key
Optional Key to store the message
Message Key Field
If set, the value of Message_Key_Field in the record will indicate the message key. If not set nor found in the record, Message_Key will be used (if set).
Timestamp Key
Set the key to store the record timestamp
Timestamp Format
Set the format to iso8601 or double
Body Key
Specify the key which contains the body
Queue Full Retries
Fluent Bit queues data into rdkafka library, if for some reason the underlying library cannot flush the records the queue might fills up blocking new addition of records. The queue_full_retries option set the number of local retries to enqueue the data. The default value is 10 times, the interval between each retry is 1 second. Setting the queue_full_retries value to 0 sets an unlimited number of retries.
SASL Username
SASL username
Security Protocol
This is the security protocol for Azure Event Hub. If you require OAuth or OpenID please open a support ticket prior to changing this setting
SASL Mechanism
This is the transport mechansim for the SASL connection
​
​

Key	Description
Event Hub Namespace	The EventHub Namespace that can be found within the configuration settings
Event Hub Topic	The Event Hub Topic to write information to
Connection String Key	The Event Hub Connection String from within the Connection Access Policy set for the source

Key	Description
Message Key	Optional Key to store the message
Message Key Field	If set, the value of Message_Key_Field in the record will indicate the message key. If not set nor found in the record, Message_Key will be used (if set).
Timestamp Key	Set the key to store the record timestamp
Timestamp Format	Set the format to iso8601 or double
Body Key	Specify the key which contains the body
Queue Full Retries	Fluent Bit queues data into rdkafka library, if for some reason the underlying library cannot flush the records the queue might fills up blocking new addition of records. The queue_full_retries option set the number of local retries to enqueue the data. The default value is 10 times, the interval between each retry is 1 second. Setting the queue_full_retries value to 0 sets an unlimited number of retries.
SASL Username	SASL username
Security Protocol	This is the security protocol for Azure Event Hub. If you require OAuth or OpenID please open a support ticket prior to changing this setting
SASL Mechanism	This is the transport mechansim for the SASL connection

Azure Data Explorer (Kusto)

Prometheus Remote Write

Last modified 2mo ago