Azure Event Hubs is a cloud-based data streaming platform that enables you to ingest and process large volumes of event data from various sources in real-time. It lets you collect, store, and analyze data from millions of events generated by your applications and services, and enables you to take real-time actions based on that data.
Azure Event Hubs provides a highly scalable and reliable platform for event streaming. Use the Azure Event Hubs destination plugin to configure your Calyptia Core pipeline to stream your logs and metrics data directly to Azure Event Hubs.
The Azure Event Hubs destination plugin provides these configuration parameters.
Event Hub Namespace
The EventHub Namespace that can be found within the configuration settings.
Event Hub Topic
The Event Hub Topic to write information to.
Connection String Key
The Event Hub Connection String from within the Connection Access Policy set for the source.
Optional Key to store the message.
Message Key Field
If set, the value of Message_Key_Field in the record will indicate the message key. If not set nor found in the record, Message_Key will be used (if set).
Set the key to store the record timestamp.
Set the format to iso8601 or double.
Specify the key which contains the body.
Queue Full Retries
Fluent Bit queues data into rdkafka library, if for some reason the underlying library cannot flush the records the queue might fills up blocking new addition of records. The queue_full_retries option set the number of local retries to enqueue the data. The default value is 10 times, the interval between each retry is 1 second. Setting the queue_full_retries value to 0 sets an unlimited number of retries.
This is the security protocol for Azure Event Hub. If you require OAuth or OpenID, open a support ticket prior to changing this setting.
This is the transport mechanism for the SASL connection.