Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.bronto.io/llms.txt

Use this file to discover all available pages before exploring further.

The AWS Kinesis Firehose integration is currently in preview. To request access, contact support@bronto.io.

Overview

Bronto’s Kinesis Firehose integration allows you to stream data directly from an AWS Kinesis Firehose delivery stream into Bronto. This is well suited to high-throughput pipelines where data already flows through Kinesis — for example, VPC Flow Logs, CloudTrail events, or custom application events published to a Kinesis stream. The integration requires no Lambda function. Firehose delivers data directly to Bronto’s HTTP endpoint, handling batching and retries natively.

When to Use Firehose

SituationRecommendation
Data already in a Kinesis streamFirehose is the natural choice
Very high event volume (GB/hour+)Firehose scales without additional Lambda cost
You want managed delivery with built-in retriesFirehose handles this natively
Application or container logsUse ADOT or the CloudWatch Forwarder instead

Supported AWS Services

Kinesis Firehose is the recommended path for high-volume sources that already flow through Kinesis, and for services that deliver directly to a Firehose stream. Many CloudWatch-native services can also be routed to Firehose via a CloudWatch Logs subscription filter when CloudWatch ingestion costs become significant.
ServiceLog type
Amazon CloudFront (real-time logs)Per-request edge logs (native Firehose delivery)
VPC Flow LogsNetwork flow records (high-volume deployments)
AWS CloudTrailManagement and data events (high-volume deployments)
AWS WAFWeb ACL traffic logs (native Firehose delivery)
Amazon API GatewayAccess logs (high-volume APIs, via CloudWatch subscription)
AWS LambdaFunction logs (high-volume functions, via CloudWatch subscription)
Amazon RDS / AuroraDatabase engine logs (high-volume, via CloudWatch subscription)
Amazon ElastiCacheEngine and slow logs (high-volume, via CloudWatch subscription)
Amazon Route 53DNS query logs (high-volume, via CloudWatch subscription)
Amazon SESSending event logs (high-volume)
Custom Kinesis pipelinesAny application events published to a Kinesis Data Stream or Firehose
For low or moderate volume sources, the S3 Log Forwarder or CloudWatch Log Forwarder are simpler to operate.

Data Organization

Bronto’s Firehose preview supports the standard recommended headers for routing data into the right place — see Data Organization for how datasets, collections, and tags work.
HeaderDescription
x-bronto-datasetDataset to ingest into
x-bronto-collectionCollection name
x-bronto-tagsComma-separated tags to attach to events
Configure these as part of the HTTP endpoint Common attributes on your Firehose delivery stream, or provide them to the Bronto team during preview onboarding to be set on the destination. To route different sources to different datasets, deploy a separate Firehose delivery stream per dataset.

Cost

Firehose pricing is based on the volume of data processed through the delivery stream (per GB). There are no CloudWatch ingestion fees and no Lambda compute cost.

Requesting Access

The Firehose integration is available to customers on request during the preview period. To get started, contact support@bronto.io with your Bronto account details and a brief description of your use case.