Marketplace

Templates & starter projects

Copy-paste starting points: layered dbt projects, pipeline scaffolds and full starter repos with tests, CI and sample data already wired in.

13 entries avg composite 31 beginner · intermediate · advanced 7 templates 6 starter projects

dbtInfrastructure / Docker / TerraformAirflow / OrchestrationData ContractsSpark / PySparkStreaming

Template 28 adequate

dbt Project Template

A layered dbt project (staging/intermediate/marts) with tests, docs, a CI workflow that builds against a staging schema, and a source freshness config.

dbt beginner templatedbt community

Template 34 adequate

Local Docker Data Stack

A docker-compose stack (Postgres, Kafka, MinIO, Spark, and a DuckDB CLI) for developing and testing pipelines entirely offline.

DockerPostgreSQLApache Kafka beginner templatedocker community

Template 27 adequate

Airflow DAG Template

An idempotent DAG skeleton with task groups, retries and backoff, SLA, pools, and a sensor using reschedule mode.

Apache Airflow intermediate templateairflow community

Template 33 adequate

Data Contract Template

A contract skeleton (ownership, schema, semantics, SLA, compatibility policy) with the CI check that enforces it and a deprecation checklist.

dbt intermediate templatedata-contract community

Template 34 adequate

PySpark Project Template

A testable PySpark project: src/transforms, tests with a local Spark session, a Dockerfile, and a Makefile that runs lint + tests offline.

Apache SparkPySparkDocker intermediate templatespark community

Template 27 adequate

Kafka Streaming Job Template

A structured-streaming job with checkpointing, watermarking, a dedupe stage and an idempotent MERGE sink to Delta/Iceberg.

Apache KafkaApache SparkDelta Lake advanced templatekafka community

Template 26 adequate

Terraform AWS Data Platform

S3 buckets with lifecycle + encryption, Glue catalogue, IAM roles scoped to least privilege, and Athena workgroups with query limits.

TerraformAmazon S3AWS Glue advanced templateterraform community

Project 33 adequate

dbt → warehouse → tests → docs

Transform raw landed data into a tested, documented star schema with dbt, and gate every change on data-aware CI.

dbtPostgreSQLDuckDB beginner community

Project 32 adequate

API → S3 → Spark → Parquet

Land a paginated REST API into S3 raw, transform with PySpark into partitioned Parquet, and make the whole thing idempotent and testable offline.

PythonAmazon S3Apache Spark intermediate community

Project 39 adequate

Pipeline → DQ → quarantine → publish

Put a contract in front of a table: validate each batch, publish the clean rows, quarantine the rest with reasons, and alert on the quarantine rate.

Apache SparkDuckDBApache Parquet intermediate community

Project 30 adequate

S3 → Glue → Athena

A serverless, query-in-place pattern: land Parquet in S3, catalogue it with Glue, and query with Athena while keeping scanned bytes (and cost) low.

Amazon S3AWS GlueAmazon Athena intermediate community

Project 32 adequate

Kafka → Spark Streaming → Delta

A low-latency stream into Delta Lake with watermarking, windowed aggregation and idempotent upserts that survive replays.

Apache KafkaApache SparkDelta Lake advanced community

Project 34 adequate

Postgres → CDC → Kafka → Lakehouse

Capture changes from Postgres with Debezium, stream through Kafka, and merge into a lakehouse table with correct ordering, deletes and replay safety.

PostgreSQLDebeziumApache Kafka advanced community