1.9
Installation
Administration
Data Pipeline
Stream Processing
Changelog
Upon new versions of Fluent Bit, the Stream Processor engine gets new improvements. In the following section you will find the details of the new additions in the major release versions.
Fluent Bit v1.2
Release date: June 27, 2019
Sub-key selection and conditionals support
It's pretty common that records contains nested maps or sub-keys. Now we provide the ability to use sub-keys to perform conditionals and keys selection. Consider the following record:
1
{
2
"key1": 123,
3
"key2": 456,
4
"key3": {
5
"sub1": {
6
"sub2": 789
7
}
8
}
9
}
Copied!
Now you can perform queries like:
1
SELECT key3['sub1']['sub2'] FROM STREAM:test WHERE key3['sub1']['sub2'] = 789;
Copied!
New @record functions
On conditionals we have introduced the new @record functions:
Function
Description
@record.time()
returns the record timestamp
@record.contains(key)
returns true or false if key exists in the record
IS NULL, IS NOT NULL
We currently support different data types such as strings, integers, floats, maps and null. In Fluent Bit, a null value is totally valid and is not related to the absence of a value as in normal databases. To compare if an existing key in the record have a null value or not, we have introduced IS NULL and IS NOT NULL statements, e.g:
1
SELECT * FROM STREAM:test WHERE key3['sub1'] IS NOT NULL;
Copied!
Fluent Bit v1.1
Release date: May 09, 2019
This is the initial version of the Stream Processor into Fluent Bit.
Last modified 5mo ago
Export as PDF
Copy link