Databricks

DE//AGENT currently lists 4 resources under Databricks: 4 skills. Everything below is derived from the live registry — counts, capabilities, verification state and security posture come from the curated records, never from marketing copy.

Documented learning objectives across these resources:

• Capture cost-relevant metrics from a Spark run — via Spark Cost Regression Guard
• Store and compare a baseline — via Spark Cost Regression Guard
• Explain which stage caused a regression — via Spark Cost Regression Guard
• Separate scan inefficiency from compute inefficiency — via Warehouse Clustering Advisor
• Choose a clustering key from predicate selectivity — via Warehouse Clustering Advisor
• Right-size a virtual warehouse from queue time — via Warehouse Clustering Advisor
• Decide if a table needs OPTIMIZE from file stats — via Delta Optimization Advisor
• Choose Z-ORDER columns from query predicates — via Delta Optimization Advisor

4 more objectives live on the individual resource pages.

These resources map to stages: Reliability (2), Lakehouse (1), Warehousing (1). Follow the four-phase roadmap to place this topic inside a progression instead of learning it in isolation.

Every entry, its shape and its trust state — sorted by the registry's composite score. This table is the honest version of a marketing comparison: no sponsored placements, no unverifiable claims.

How scores are computed: source quality score.

Highest composite score first:

1. Spark Cost Regression Guard score 37 — advanced
2. Warehouse Clustering Advisor score 36.5 — advanced
3. Delta Optimization Advisor score 34.9 — intermediate

Scores rank provenance, completeness and trust — read how verification works before adopting anything.

Reach for these with production experience: Spark Cost Regression Guard, Warehouse Clustering Advisor.

Security-flagged entries: Spark Cost Regression Guard (2 flags), Warehouse Clustering Advisor (2 flags), Delta Optimization Advisor (2 flags), Cost Unit-Economics Reporter (4 flags). Flags mean the record declares capabilities like credential use or write access — read the security posture on each page before connecting.

• Spark Cost Regression Guard — Compares a job's shuffle/spill/scan metrics against a stored baseline and fails the change if cost-per-run regresses beyond a threshold, with the diff explained. details
• Warehouse Clustering Advisor — Advises on Snowflake/BigQuery/Redshift tuning: clustering keys, warehouse sizing, result caching, and the difference between a scan problem and a compute problem. details
• Delta Optimization Advisor — Reads Delta table history and file statistics to decide between OPTIMIZE, Z-ORDER, liquid clustering and partitioning changes. details
• Cost Unit-Economics Reporter — Turns cluster/warehouse billing into unit economics (cost per 1M rows, per run, per model) so a 4x regression shows up as a number, not a surprise invoice. details

Real install commands from the registry — read the source before running any of them:

npx de-agent-platform add spark-cost-regression-guard

Spark Cost Regression Guard — review first

npx de-agent-platform add warehouse-clustering-advisor

Warehouse Clustering Advisor — review first

npx de-agent-platform add delta-optimization-advisor

Delta Optimization Advisor — review first

npx de-agent-platform add cost-unit-economics-reporter

Cost Unit-Economics Reporter — review first

Official source: Databricks — start there for the canonical documentation, then come back for the vetted registry entries.

Adjacent topics: Snowflake (2 shared), cost (2 shared), performance (2 shared).

Study path: the roadmap places this topic in a progression · the scoring model explains the numbers · the trust rule catalog shows every security check these entries passed through.