Prometheus Scrape Metrics
Fluent Bit 1.9 includes additional metrics features to allow you to collect both logs and metrics with the same collector.
The initial release of the Prometheus Scrape metric allows you to collect metrics from a Prometheus-based endpoint at a set interval. These metrics can be routed to metric supported endpoints such as Prometheus Exporter, InfluxDB, or Prometheus Remote Write

Configuration

Key
Description
Default
host
The host of the prometheus metric endpoint that you want to scrape
port
The port of the promethes metric endpoint that you want to scrape
scrape_interval
The interval to scrape metrics
10s
metrics_path
The metrics URI endpoint, that must start with a forward slash. Note: Parameters can also be added to the path by using ?
/metrics

Example

If an endpoint exposes Prometheus Metrics we can specify the configuration to scrape and then output the metrics. In the following example, we retrieve metrics from the HashiCorp Vault application.
1
[INPUT]
2
name prometheus_scrape
3
host 0.0.0.0
4
port 8201
5
tag vault
6
metrics_path /v1/sys/metrics?format=prometheus
7
scrape_interval 10s
8
9
[OUTPUT]
10
name stdout
11
match *
Copied!
Example Output
1
2022-03-26T23:01:29.836663788Z go_memstats_alloc_bytes_total = 31891336
2
2022-03-26T23:01:29.836663788Z go_memstats_frees_total = 313264
3
2022-03-26T23:01:29.836663788Z go_memstats_lookups_total = 0
4
2022-03-26T23:01:29.836663788Z go_memstats_mallocs_total = 378992
5
2022-03-26T23:01:29.836663788Z process_cpu_seconds_total = 1.6200000000000001
6
2022-03-26T23:01:29.836663788Z go_goroutines = 19
7
2022-03-26T23:01:29.836663788Z go_info{version="go1.17.7"} = 1
8
2022-03-26T23:01:29.836663788Z go_memstats_alloc_bytes = 12547800
9
2022-03-26T23:01:29.836663788Z go_memstats_buck_hash_sys_bytes = 1468900
10
2022-03-26T23:01:29.836663788Z go_memstats_gc_cpu_fraction = 8.1509688352783453e-06
11
2022-03-26T23:01:29.836663788Z go_memstats_gc_sys_bytes = 5875576
12
2022-03-26T23:01:29.836663788Z go_memstats_heap_alloc_bytes = 12547800
13
2022-03-26T23:01:29.836663788Z go_memstats_heap_idle_bytes = 2220032
14
2022-03-26T23:01:29.836663788Z go_memstats_heap_inuse_bytes = 14000128
15
2022-03-26T23:01:29.836663788Z go_memstats_heap_objects = 65728
16
2022-03-26T23:01:29.836663788Z go_memstats_heap_released_bytes = 2187264
17
2022-03-26T23:01:29.836663788Z go_memstats_heap_sys_bytes = 16220160
18
2022-03-26T23:01:29.836663788Z go_memstats_last_gc_time_seconds = 1648335593.2483871
19
2022-03-26T23:01:29.836663788Z go_memstats_mcache_inuse_bytes = 2400
20
2022-03-26T23:01:29.836663788Z go_memstats_mcache_sys_bytes = 16384
21
2022-03-26T23:01:29.836663788Z go_memstats_mspan_inuse_bytes = 150280
22
2022-03-26T23:01:29.836663788Z go_memstats_mspan_sys_bytes = 163840
23
2022-03-26T23:01:29.836663788Z go_memstats_next_gc_bytes = 16586496
24
2022-03-26T23:01:29.836663788Z go_memstats_other_sys_bytes = 422572
25
2022-03-26T23:01:29.836663788Z go_memstats_stack_inuse_bytes = 557056
26
2022-03-26T23:01:29.836663788Z go_memstats_stack_sys_bytes = 557056
27
2022-03-26T23:01:29.836663788Z go_memstats_sys_bytes = 24724488
28
2022-03-26T23:01:29.836663788Z go_threads = 8
29
2022-03-26T23:01:29.836663788Z process_max_fds = 65536
30
2022-03-26T23:01:29.836663788Z process_open_fds = 12
31
2022-03-26T23:01:29.836663788Z process_resident_memory_bytes = 200638464
32
2022-03-26T23:01:29.836663788Z process_start_time_seconds = 1648333791.45
33
2022-03-26T23:01:29.836663788Z process_virtual_memory_bytes = 865849344
34
2022-03-26T23:01:29.836663788Z process_virtual_memory_max_bytes = 1.8446744073709552e+19
35
2022-03-26T23:01:29.836663788Z vault_runtime_alloc_bytes = 12482136
36
2022-03-26T23:01:29.836663788Z vault_runtime_free_count = 313256
37
2022-03-26T23:01:29.836663788Z vault_runtime_heap_objects = 65465
38
2022-03-26T23:01:29.836663788Z vault_runtime_malloc_count = 378721
39
2022-03-26T23:01:29.836663788Z vault_runtime_num_goroutines = 12
40
2022-03-26T23:01:29.836663788Z vault_runtime_sys_bytes = 24724488
41
2022-03-26T23:01:29.836663788Z vault_runtime_total_gc_pause_ns = 1917611
42
2022-03-26T23:01:29.836663788Z vault_runtime_total_gc_runs = 19
Copied!
Export as PDF
Copy link