Buffer

Data processing with reliability

Previously defined in the Buffering concept section, the buffer phase in the pipeline aims to provide a unified and persistent mechanism to store your data, either using the primary in-memory model or using the filesystem based mode.

The buffer phase already contains the data in an immutable state, meaning, no other filter can be applied.

Buffered data is not raw text, it's in the Calyptia Core Agent internal binary representation.

Calyptia Core Agent offers a buffering mechanism in the file system that acts as a backup system to avoid data loss in case of system failures.