DE//AGENT
Explore

Learn

performance

17 registry resources · 7 tutorials, 4 skills · roadmap: Data Processing, Foundations, Warehousing, Python + SQL, Reliability, Lakehouse

What this topic covers

DE//AGENT currently lists 17 resources under performance: 7 tutorials, 4 skills, 3 runbooks. Everything below is derived from the live registry — counts, capabilities, verification state and security posture come from the curated records, never from marketing copy.

Also present: 2 agents, 1 plugin.

What you can learn here

Documented learning objectives across these resources:

20 more objectives live on the individual resource pages.

Where this fits in the learning roadmap

These resources map to stages: Data Processing (7), Foundations (1), Warehousing (4), Python + SQL (2), Reliability (2), Lakehouse (1). Follow the four-phase roadmap to place this topic inside a progression instead of learning it in isolation.

Compare the registry's options

Every entry, its shape and its trust state — sorted by the registry's composite score. This table is the honest version of a marketing comparison: no sponsored placements, no unverifiable claims.

ResourceTypeDifficultyVerificationScore
SQL Query Plan ExplainerSkillintermediatecommunity flags38.5
Spark Skew DiagnosisSkilladvancedcommunity flags38.5
Spark Cost Regression GuardSkilladvancedcommunity flags37
Spark job is slowRunbookadvancedcommunity flags36.75
Warehouse Clustering AdvisorSkilladvancedcommunity flags36.5
Spark OptimizerAgentadvancedcommunity flags34.5
Diagnose a skewed Spark stageTutorialintermediatecommunity34.15
Format-driven performance incidents — small scans and wrong layoutsTutorialintermediatecommunity34.15
Incident — the dashboard query that went slowTutorialintermediatecommunity34.15
Make queries prune — clustering keys and scan diagnosisTutorialintermediatecommunity34.15
Read a Spark event log with the Spark Lens pluginTutorialintermediatecommunity34.15
Read an EXPLAIN plan and pick the one fixTutorialintermediatecommunity34.15

5 more in the full list below.

How scores are computed: source quality score.

Where to start

Highest composite score first:

  1. SQL Query Plan Explainer score 38.5 — intermediate
  2. Spark Skew Diagnosis score 38.5 — advanced
  3. Spark Cost Regression Guard score 37 — advanced

Scores rank provenance, completeness and trust — read how verification works before adopting anything.

Good fits

Reach for these with production experience: Spark Skew Diagnosis, Spark Cost Regression Guard, Spark job is slow.

Cautions and limitations

Security-flagged entries: SQL Query Plan Explainer (1 flag), Spark Skew Diagnosis (2 flags), Spark Cost Regression Guard (2 flags), Spark job is slow (1 flag), Warehouse Clustering Advisor (2 flags), Spark Optimizer (1 flag), Spark Lens (2 flags), Small files explosion (3 flags), Warehouse query is slow (3 flags), Cost Optimizer (5 flags). Flags mean the record declares capabilities like credential use or write access — read the security posture on each page before connecting.

Production use cases

  • SQL Query Plan Explainer — Reads EXPLAIN / EXPLAIN ANALYZE output and explains scans, joins, spills and estimated-vs-actual row skew, then proposes the single highest-impact change. details
  • Spark Skew Diagnosis — Walks an agent through reading the Spark UI/event log to distinguish key skew, partition skew, and shuffle-write amplification, then selects between salting, AQE skew join, broadca… details
  • Spark Cost Regression Guard — Compares a job's shuffle/spill/scan metrics against a stored baseline and fails the change if cost-per-run regresses beyond a threshold, with the diff explained. details
  • Spark job is slow — A batch Spark job's runtime has jumped — find whether it is skew, partition count, spill or over-scan. details

Install and inspect

Real install commands from the registry — read the source before running any of them:

npx de-agent-platform add sql-query-plan-explainer

SQL Query Plan Explainer — review first

npx de-agent-platform add spark-skew-diagnosis

Spark Skew Diagnosis — review first

npx de-agent-platform add spark-cost-regression-guard

Spark Cost Regression Guard — review first

npx de-agent-platform add warehouse-clustering-advisor

Warehouse Clustering Advisor — review first

Further study

Adjacent topics: tutorial (7 shared), cost (5 shared), Apache Spark (2 shared), Databricks (2 shared), incident (2 shared), plugin (2 shared).

Study path: the roadmap places this topic in a progression · the scoring model explains the numbers · the trust rule catalog shows every security check these entries passed through.

Full resource list

← All topics