Azure Blob Storage

Azure Blob Storage destination plugin

Azure Blob Storage is a cloud-based object storage solution offered by Microsoft Azure. It provides highly scalable and durable storage for unstructured data such as text, images, and videos. With the Azure Blob Storage destination plugin, you can configure your Calyptia Core pipeline to store your logs, metrics, and other data types directly in your Azure Blob Storage account. This lets you store and manage large amounts of data, while also providing a high level of security and reliability for your data.

Configuration parameters

The Azure Blob Storage destination plugin provides these configuration parameters.

General

Key	Description
Azure Storage Account Name	Azure Storage account name.
Azure Storage Shared Key	Specify the Azure Storage Shared Key to authenticate against the service.
Container Name	Name of the container that will contain the blobs.
Path	Optional path to store your blobs. If your blob name is myblob, you can specify sub-directories where to store it using path. Setting a path to /logs/kubernetes will store your blob in /logs/kubernetes/myblob.
Blob Type	Specify the desired blob type. Fluent Bit supports Append and Block blobs.
Auto Create Container	If container_name does not exist in the remote service, enabling this option will handle the exception and auto-create the container.

Security and TLS

Key	Description
TLS	Enable or disable TLS/SSL support.
TLS Certificate Validation	Turn TLS/SSL certificate validation on or off. TLS must be on for this setting to be enabled.
TLS Debug Level	Set TLS debug verbosity level. Accepts these values: 0 (No debug), 1 (Error), 2 (State change), 3 (Informational), 4 (Verbose).
CA Certificate File Path	Absolute path to CA certificate file.
Certificate File Path	Absolute path to certificate file.
Private key File Path	Absolute path to private key file.
Private Key Path Password	Optional password for tls.key_file file.
TLS SNI Hostname Extension	Hostname to be used for TLS SNI extension.

The following are Advanced Networking configuration Parameters for Azure Blob Storage Destination Plugin.

Key	Description
DNS Mode	Select the primary DNS connection type (TCP or UDP).
DNS Resolver	Select the primary DNS connection type (TCP or UDP).
Prefer IPv4	Prioritize IPv4 DNS results when trying to establish a connection.
Keepalive	Enable or disable Keepalive support.
Keepalive Idle Timeout	Set maximum time allowed for an idle Keepalive connection.
Max Connect Timeout	Set maximum time allowed to establish a connection, this time includes the TLS handshake
Max Connect Timeout Log Error	On connection timeout, specify if it should log an error. When disabled, the timeout is logged as a debug message.
Max Keepalive Recycle	Set maximum number of times a keepalive connection can be used before it is retired.
Source Address	Specify network address to bind for data traffic.