Azure EventHub

Azure Event Hubs destination plugin

Azure Event Hubs is a cloud-based data streaming platform that enables you to ingest and process large volumes of event data from various sources in real-time. It lets you collect, store, and analyze data from millions of events generated by your applications and services, and enables you to take real-time actions based on that data.

Azure Event Hubs provides a highly scalable and reliable platform for event streaming. Use the Azure Event Hubs destination plugin to configure your Calyptia Core pipeline to stream your logs and metrics data directly to Azure Event Hubs.

Configuration parameters

The Azure Event Hubs destination plugin provides these configuration parameters.

General

Key	Description
Event Hub Namespace	The EventHub Namespace that can be found within the configuration settings.
Event Hub Topic	The Event Hub Topic to write information to.
Connection String Key	The Event Hub Connection String from within the Connection Access Policy set for the source.

Advanced

Key	Description
Message Key	Optional Key to store the message.
Message Key Field	If set, the value of Message_Key_Field in the record will indicate the message key. If not set nor found in the record, Message_Key will be used (if set).
Timestamp Key	Set the key to store the record timestamp.
Timestamp Format	Set the format to iso8601 or double.
Body Key	Specify the key which contains the body.
Queue Full Retries	Fluent Bit queues data into rdkafka library, if for some reason the underlying library cannot flush the records the queue might fills up blocking new addition of records. The queue_full_retries option set the number of local retries to enqueue the data. The default value is 10 times, the interval between each retry is 1 second. Setting the queue_full_retries value to 0 sets an unlimited number of retries.
SASL Username	SASL username.
Security Protocol	This is the security protocol for Azure Event Hub. If you require OAuth or OpenID, open a support ticket prior to changing this setting.
SASL Mechanism	This is the transport mechanism for the SASL connection.