Plugin community advanced

Spark Lens

Parses Spark event logs into a task histogram, flags skew and shuffle amplification, and compares against a stored cost baseline.

amp plugin add de-agent/spark-lens

At a glance

Where	Spark / PySpark

Last sweep 2026-10-24: 0 finding(s), 0 marked as examples.

/spark-analyze

/spark-baseline

/spark-explain-plan

adequate (34.1/100)

Rule-based scoring across 7 dimensions. Higher is better. How it works

performance /100

completeness 84/100

test coverage 5/100

security 90/100

documentation 15/100

maintainability 55/100

community /100

Metadata

Category: Spark / PySpark
Stage: Data Processing
Version: 0.2.0
License: Apache-2.0
Author: de-agent
Last Verified: 2026-09-26
Source: https://github.com/XMIRTUNJAY/de-agent-platform/tree/main/data/curated/plugins/spark-lens

Security Posture (2)

A listing is not an endorsement. Review the flags before connecting.

Provenance

Before you trust this

Limitations: No documented limitations — treat the unknown as unknown, not as safe.
Prerequisites: None declared
Evidence checklist: source reachable: unclaimedmetadata validated: passedlicense reviewed: unclaimedtutorial generated: unclaimedstatic checks passed: unclaimedbuild passed: unclaimedtests passed: unclaimedsmoke passed: unclaimedoutput validated: unclaimedsecurity reviewed: unclaimed

Relationships

Related in the graph (5)

Computed from shared taxonomy — not curator endorsements.

Roadmap Alignment

Data Processing (foundations)

This artifact teaches skills for the stages above in the 13-stage Data Engineering roadmap.

Spark Lens