Azure Blob Storage

Azure Blob Storage Destination Plugin

Azure Blob Storage is a cloud-based object storage solution offered by Microsoft Azure. It provides highly scalable and durable storage for unstructured data such as text, images, and videos. With the Azure Blob Storage Destination plugin, you can easily configure your Calyptia Core pipeline to store your logs, metrics, and other data types directly in your Azure Blob Storage account. This allows you to store and manage large amounts of data with ease, while also providing a high level of security and reliability for your data.
Configuration Parameters
The following are configuration Parameters for Azure Blob Storage Destination Plugin.
Key
Description
Azure Storage Account Name
Azure Storage account name.
Azure Storage Shared Key
Specify the Azure Storage Shared Key to authenticate against the service.
Container Name
Name of the container that will contain the blobs.
Path
Optional path to store your blobs. If your blob name is myblob, you can specify sub-directories where to store it using path, so setting path to /logs/kubernetes will store your blob in /logs/kubernetes/myblob.
Blob Type
Specify the desired blob type. Fluent Bit supports appendblob and blockblob.
Auto Create Container
If container_name does not exist in the remote service, enabling this option will handle the exception and auto-create the container
The following are Security and TLS configuration Parameters for Azure Blob Storage Destination Plugin.
Key
Description
TLS
Enable or Disable TLS/SSL support
TLS Certificate Validation
Turn TLS/SSL certificate validation on / off, TLS must be on for this setting to be enabled.
TLS Debug Level
Set TLS debug verbosity level. It accepts the following values: 0 (No debug), 1 (Error), 2 (State change), 3 (Informational), and 4 Verbose
CA Certificate File Path
Absolute path to CA certificate file
Certificate File Path
Absolute path to Certificate file
Private key File Path
Absolute path to private Key file
Private Key Path Password
Optional password for tls.key_file file
TLS SNI Hostname Extension
Hostname to be used for TLS SNI Extension
The following are Advanced Networking configuration Parameters for Azure Blob Storage Destination Plugin.
Key
Description
DNS Mode
Select the primary DNS connection type (TCP or UDP)
DNS Resolver
Select the primary DNS connection type (TCP or UDP)
Prefer IPv4
Prioritize IPv4 DNS results when trying to establish a connection
Keepalive
Enable or disable Keepalive support
Keepalive Idle Timeout
Set maximum time allowed for an idle Keepalive connection
Max Connect Timeout
Set maximum time allowed to establish a connection, this time includes the TLS handshake
Max Connect Timeout Log Error
On connection timeout, specify if it should log an error. When disabled, the timeout is logged as a debug message
Max Keepalive Recycle
Set maximum number of times a keepalive connection can be used before it is retired.
Source Address
Specify network address to bind for data traffic

Key	Description
Azure Storage Account Name	Azure Storage account name.
Azure Storage Shared Key	Specify the Azure Storage Shared Key to authenticate against the service.
Container Name	Name of the container that will contain the blobs.
Path	Optional path to store your blobs. If your blob name is myblob, you can specify sub-directories where to store it using path, so setting path to /logs/kubernetes will store your blob in /logs/kubernetes/myblob.
Blob Type	Specify the desired blob type. Fluent Bit supports appendblob and blockblob.
Auto Create Container	If container_name does not exist in the remote service, enabling this option will handle the exception and auto-create the container

Key	Description
TLS	Enable or Disable TLS/SSL support
TLS Certificate Validation	Turn TLS/SSL certificate validation on / off, TLS must be on for this setting to be enabled.
TLS Debug Level	Set TLS debug verbosity level. It accepts the following values: 0 (No debug), 1 (Error), 2 (State change), 3 (Informational), and 4 Verbose
CA Certificate File Path	Absolute path to CA certificate file
Certificate File Path	Absolute path to Certificate file
Private key File Path	Absolute path to private Key file
Private Key Path Password	Optional password for tls.key_file file
TLS SNI Hostname Extension	Hostname to be used for TLS SNI Extension

Key	Description
DNS Mode	Select the primary DNS connection type (TCP or UDP)
DNS Resolver	Select the primary DNS connection type (TCP or UDP)
Prefer IPv4	Prioritize IPv4 DNS results when trying to establish a connection
Keepalive	Enable or disable Keepalive support
Keepalive Idle Timeout	Set maximum time allowed for an idle Keepalive connection
Max Connect Timeout	Set maximum time allowed to establish a connection, this time includes the TLS handshake
Max Connect Timeout Log Error	On connection timeout, specify if it should log an error. When disabled, the timeout is logged as a debug message
Max Keepalive Recycle	Set maximum number of times a keepalive connection can be used before it is retired.
Source Address	Specify network address to bind for data traffic

GCP Big Query

Azure Monitor Logs

Last modified 2mo ago