Buffer
Data processing with reliability
Previously defined in the Buffering concept section, the buffer
phase in the pipeline aims to provide a unified and persistent mechanism to store your data, either using the primary in-memory model or using the filesystem based mode.
The buffer
phase already contains the data in an immutable state, meaning, no other filter can be applied.
![](https://docs.fluentbit.io/~gitbook/image?url=https%3A%2F%2F4005883584-files.gitbook.io%2F%7E%2Ffiles%2Fv0%2Fb%2Fgitbook-x-prod.appspot.com%2Fo%2Fspaces%252F1NBbcZmdFBruUw1adUIg%252Fuploads%252Fgit-blob-ba80a23b4f579320e29e8e7faf0de64d0f74f894%252Flogging_pipeline_buffer%2520%281%29%2520%281%29%2520%282%29%2520%282%29%2520%282%29%2520%282%29%2520%282%29%2520%282%29%2520%282%29%2520%281%29.png%3Falt%3Dmedia&width=768&dpr=4&quality=100&sign=1eb0f39c&sv=1)
Note that buffered data is not raw text, it's in Fluent Bit's internal binary representation.
Fluent Bit offers a buffering mechanism in the file system that acts as a backup system to avoid data loss in case of system failures.
Last updated