DE//AGENT
Explore
Reference community

Apache Spark Documentation

The authoritative reference for Spark SQL, the DataFrame API, tuning and the configuration catalogue, versioned per Spark release. Use it for exact semantics and config keys — when a job skews or slows, check the config reference and the tuning guide before changing code, alongside our skew-diagnosis and cost skills.

At a glance

What The authoritative reference for Spark SQL, the DataFrame API, tuning and the configuration catalogue, versioned per Spark release. Use it for exact semantics and config keys — when a job skews or slows, check the config reference and the tuning guide before changing code, alongside our skew-diagnosis and cost skills.
Where Spark / PySpark
Why Exact, versioned, and free to reuse. The config reference alone resolves most tuning debates.

Security scan

Last sweep 2026-10-24: 0 finding(s), 0 marked as examples.

Registry stats

Verification community · Sep 28, 2026
Completeness 58
Trust multiplier ×1.25
Composite 27.7 · adequate
Freshness 26 days since last source check
License Apache-2.0
Security flags none