Nightly batch ETL architecture

Scheduled extract and load from source systems into a lake, then modelled into a warehouse.

AWSetls3redshiftschedule
Nightly schedule2M eventsExtract jobs5M invocations · 512MB · ~150 msRaw zone1 TB standardTransform ×22 × 1 vCPU · 2 GBRedshift Serverless8 RPU · ~25 h/monthCloudWatch logs30 GB ingested
6 nodes. Drawn by the same layout the product uses.
What is in it

Every resource, and what it costs.

Projections from August 2026 list prices for always-on resources. Connect an account and these become the figures your provider actually bills.

Resources in the Nightly batch ETL template with projected monthly cost.
NodeTypeWhat it isProjected
Nightly scheduleMessaging2M events$2.00/mo
Extract jobsCompute5M invocations · 512 MB · ~150 msfrom $8.00/mo
Raw zoneStorage1 TB standard$24/mo
Transform ×2Compute2 × 1 vCPU · 2 GB$72/mo
Redshift ServerlessDatabase8 RPU · ~25 h/monthfrom $75/mo
CloudWatch logsExternal30 GB ingested$18/mo

Agent steps are priced from provider-reported token usage once the agent runs, not estimated. Guardrails cost nothing and are the reason a runaway agent cannot. 2 rows show from because those services bill by usage, so the total is a scenario at the stated volumes, not a quote.

Open Nightly batch ETL on the canvas.

It loads as an editable graph. Connect an account or instrument an agent and the projected figures above become measured ones.