Skill community intermediate
Delta Optimization Advisor
OPTIMIZE, Z-ORDER, or nothing — decide with data, not vibes.
Reads Delta table history and file statistics to decide between OPTIMIZE, Z-ORDER, liquid clustering and partitioning changes.
npx de-agent-platform add delta-optimization-advisor At a glance
| What | OPTIMIZE, Z-ORDER, or nothing — decide with data, not vibes. |
|---|---|
| Where | Lakehouse · tech-delta · tech-databricks |
Learning objectives
- Decide if a table needs OPTIMIZE from file stats
- Choose Z-ORDER columns from query predicates
- Know when liquid clustering beats partitioning
Security scan
Last sweep 2026-10-24: 0 finding(s), 0 marked as examples.
Details
Delta Optimization Advisor
Decide
- Files < 32 MB and many →
OPTIMIZE. - Queries filter on 1-2 high-cardinality columns →
ZORDER BYthose columns. - High-cardinality, many predicates, frequent writes → liquid clustering.
- Predicate on one low-cardinality column (date) → partition (or leave it; Delta handles pruning well already).
Measure
Compare numFiles and query bytes scanned before and after. If scanning
didn't drop, the Z-ORDER was on the wrong columns.
Registry stats
| Verification | community · Sep 14, 2026 |
|---|---|
| Completeness | 96 |
| Trust multiplier | ×0.75 |
| Composite | 34.9 · adequate |
| Freshness | 40 days since last source check |
| Difficulty | intermediate |
| Version | 0.1.2 |
| License | Apache-2.0 |
| Security flags | 2 |
Did this solve your problem?
Delta Optimization Advisor