Streaming ingest architecture

Events land on a stream, are enriched in flight, and are written to both a lake and a search index.

AWSkinesisstreamingopensearchreal time
Ingest endpoint10M requestsKinesis Data Stream2 shardsEnrich and route5M invocations · 512MB · ~150 msS3 data lake1 TB standardSearch indext3.small.searchDead-letter queuelow volume
6 nodes. Drawn by the same layout the product uses.
What is in it

Every resource, and what it costs.

Projections from August 2026 list prices for always-on resources. Connect an account and these become the figures your provider actually bills.

Resources in the Streaming ingest template with projected monthly cost.
NodeTypeWhat it isProjected
Ingest endpointNetwork10M requests$10/mo
Kinesis Data StreamMessaging2 shardsfrom $22/mo
Enrich and routeCompute5M invocations · 512 MB · ~150 msfrom $8.00/mo
S3 data lakeStorage1 TB standard$24/mo
Search indexDatabaset3.small.search$27/mo
Dead-letter queueMessaginglow volume$0.50/mo

Agent steps are priced from provider-reported token usage once the agent runs, not estimated. Guardrails cost nothing and are the reason a runaway agent cannot. 2 rows show from because those services bill by usage, so the total is a scenario at the stated volumes, not a quote.

Open Streaming ingest on the canvas.

It loads as an editable graph. Connect an account or instrument an agent and the projected figures above become measured ones.