Upon new versions of Fluent Bit, the Stream Processor engine gets new improvements. In the following section you will find the details of the new additions in the major release versions.
Release date: June 27, 2019
It's pretty common that records contains nested maps or sub-keys. Now we provide the ability to use sub-keys to perform conditionals and keys selection. Consider the following record:
Now you can perform queries like:
SELECT key3['sub1']['sub2'] FROM STREAM:test WHERE key3['sub1']['sub2'] = 789;
On conditionals we have introduced the new @record functions:
returns the record timestamp
returns true or false if key exists in the record
We currently support different data types such as strings, integers, floats, maps and null. In Fluent Bit, a null value is totally valid and is not related to the absence of a value as in normal databases. To compare if an existing key in the record have a null value or not, we have introduced IS NULL and IS NOT NULL statements, e.g:
SELECT * FROM STREAM:test WHERE key3['sub1'] IS NOT NULL;
Release date: May 09, 2019
This is the initial version of the Stream Processor into Fluent Bit.