The kafka-rest output plugin, allows to flush your records into a Kafka REST Proxy server. The following instructions assumes that you have a fully operational Kafka REST Proxy and Kafka services running in your environment.
IP address or hostname of the target Kafka REST Proxy server
TCP port of the target Kafka REST Proxy server
Set the Kafka topic
Set the partition number (optional)
Set a message key (optional)
The Time_Key property defines the name of the field that holds the record timestamp.
Defines the format of the timestamp.
Append the Tag name to the final record.
If Include_Tag_Key is enabled, this property defines the key name for the tag.
TLS / SSL
Kafka REST Proxy output plugin supports TTL/SSL, for more details about the properties available and general configuration, please refer to the TLS/SSL section.
In order to insert records into a Kafka REST Proxy service, you can run the plugin from the command line or through the configuration file:
The kafka-rest plugin, can read the parameters from the command line in two ways, through the -p argument (property), e.g:
$ fluent-bit -i cpu -t cpu -o kafka-rest -p host=127.0.0.1 -p port=8082 -m '*'
In your main configuration file append the following Input & Output sections: