Documentation Index
Fetch the complete documentation index at: https://docs.bronto.io/llms.txt
Use this file to discover all available pages before exploring further.
Create a new configuration file or update your existing to include the following:
input {
file {
id => "file_input_id"
path => <YOUR_LOG_PATH>
}
}
filter {
grok {
match => { "message" => "<%{NONNEGINT:pri}>%{NONNEGINT:version} +(?:%{TIMESTAMP_ISO8601:log.timestamp}|-) +(?:%{HOSTNAME:hostname}|-) +(?:-|%{NOTSPACE:app.name}) +(?:-|%{NOTSPACE:procid}) (?:-|%{NOTSPACE:msgid}) +(?:[%{DATA:structured.data}]|-|) +%{GREEDYDATA:message}"}
}
}
output {
http {
url => "https://ingestion.<REGION>.bronto.io"
id => "my_plugin_id"
headers => {
"x-bronto-client" => "Logstash"
"x-bronto-api-key" => <YOUR_API_KEY>
"x-bronto-dataset" => <YOUR_DATASET_NAME>
"x-bronto-collection" => <YOUR_COLLECTION_NAME>
"Content-Type" => "text/html"
}
http_method => "post"
}
file {
path => "test.log"
}
}
The table below lists the parameters used to determine the Bronto dataset associated with the ingested data, ordered
from highest to lowest precedence.
| Parameter Name | Parameter Type |
|---|
| x-bronto-dataset | HTTP Header |
| x-bronto-service-name | HTTP Header |
| x-bronto-log-name | HTTP Header |
| kubernetes.annotations.logs.bronto.io/dataset | Log Metadata |
| service.name | Log Metadata |
| service_name | Log Metadata |
| kubernetes.annotations.service_name | Log Metadata |
| kubernetes.labels.app.kubernetes.io/name | Log Metadata |
| kubernetes.container_name | Log Metadata |
The table below lists the parameters used to determine the Bronto collection associated with the ingested data, ordered
from highest to lowest precedence.
| Parameter Name | Parameter Type |
|---|
| x-bronto-collection | HTTP Header |
| x-bronto-service-namespace | HTTP Header |
| x-bronto-logset | HTTP Header |
| kubernetes.annotations.logs.bronto.io/collection | Log Metadata |
| service.namespace | Log Metadata |
| service_namespace | Log Metadata |
Finally the table below lists the parameters used to assign tags to datasets, ordered from highest to lowest precedence.
| Parameter Name | Parameter Type | Example |
|---|
| x-bronto-tags | HTTP Header | x-bronto-tags: tag1=value1,tag2=value2,… |
| kubernetes.annotations.tags.logs.bronto.io/<TAG_NAME> | Log Metadata | kubernetes.annotations.tags.logs.bronto.io/tag1: value1 |
Verify log collection
Once you have applied your configuration and restarted Fluent Bit, you can expect to see your log data being ingested to Bronto and accessible via the Search page.