DE//AGENT
Explore
Pattern community intermediate

Agent-in-the-Loop Review

Coding agents can do real data-engineering work, but can also ship a schema change or drop a table.

Reference architecture canvas Sources feed processing stages; a data contract sits between processing and destinations; a failure path routes invalid output to a dead-letter zone. OLTP DBs cdc Event log stream Processing transform · model idempotent writes versioned code Data contract schema · grain · SLA validated at boundary Warehouse analytics Feature/API agents · apps Dead letter quarantined output

At a glance

What Coding agents can do real data-engineering work, but can also ship a schema change or drop a table.
When Any agent touching production data; Regulated environments
Where Agentic Data Engineering

Problem

Coding agents can do real data-engineering work, but can also ship a schema change or drop a table.

Solution

Separate read/recommend from write/execute. read ─▶ recommend ─▶ human approves ─▶ execute (scoped, logged) Constrain the agent with read-only credentials plus MCP servers limited to the needed tools. Encode the safety policy as hooks (destructive SQL guard, prod write confirmation), and keep a human in the loop for anything irreversible.

When not to use

  • A purely local sandbox with no real data

Security scan

Last sweep 2026-10-24: 0 finding(s), 0 marked as examples.

Context

Using coding agents against real data repositories and warehouses.

Forces

  • Agents accelerate review and drafting
  • Blast radius can be production
  • Trust must be earned per action

Tradeoffs

Choose this when Costs & caveats
agent velocity with bounded, auditable blast radius the human gate adds friction; requires a real permission model

Diagram

agent ─(read tools)─▶ analysis ─▶ proposal ─▶ ⛔ human gate ─▶ scoped write
                                      └─ hooks enforce policy ─┘

Registry stats

Verification community · Sep 29, 2026
Completeness 75
Trust multiplier ×1.25
Composite 35.75 · adequate
Freshness 25 days since last source check
Difficulty intermediate
Version 1.0.0
License CC-BY-4.0
Security flags none