Roadmap · stage 8/13

Cloud

Stage 8 of 13 · 29 resources · 6 categories

What this stage is

Cloud is stage 8 of 13 in the DE//AGENT roadmap. It currently holds 29 resources: 10 tutorials, 7 references, 3 mcp servers across 6 categories.

What it teaches

Provider primitives, IAM and managed vs self-hosted.

What you can do after this stage

Provision least-privilege access
Pick managed vs self-managed with reasons

Exit gate

Gate: You can stand up a data platform on a cloud provider. The stage deliverable: project-s3-glue-athena.

Gates are self-assessed — the roadmap does not track your progress; it tells you what to be able to do before moving on.

Categories in this stage

AWS (19), GCP (2), Databricks (2), Snowflake (3), Infrastructure / Docker / Terraform (1), CI/CD (2)

Registry resources for this stage

Sorted by composite score — provenance, completeness and trust, per the scoring model:

Resource	Type	Difficulty	Verification	Score
AWS MCP Servers (Labs)	MCP server	advanced	community	38.5
AWS Glue Job Reviewer	Skill	intermediate	community	37
Snowflake MCP Server (Labs)	MCP server	intermediate	community	36
Cut Athena bytes scanned with partitions and projection	Tutorial	beginner	community	34.15
Hold the cloud data stack mental model — storage, catalog, compute, IAM	Tutorial	beginner	community	34.15
Review a Glue job for sizing, bookmarks, and catalogue drift	Tutorial	beginner	community	34.15
Stand up the S3 → Glue → Athena starter	Tutorial	beginner	community	34.15
Wire cloud tooling — registry skills, MCP servers, and one review workflow	Tutorial	beginner	community	34.15
Capstone — the cloud guardrail checklist	Tutorial	intermediate	community	34.15
Govern cloud spend — right-sizing, resource monitors, and unit economics	Tutorial	intermediate	community	34.15
Incident — the job that quadrupled in cost overnight	Tutorial	intermediate	community	34.15
Production gotchas — surprise bills, region defaults, and IAM overreach	Tutorial	intermediate	community	34.15
Run an AWS data architecture review pass	Tutorial	intermediate	community	34.15
Local Docker Data Stack	Template	beginner	community	34.1
Databricks Reviewer	Agent	advanced	community	33.5
Athena Partition Advisor	Skill	intermediate	community	33.4
BigQuery MCP Server	MCP server	intermediate	community	32.8
Bad deployment	Runbook	intermediate	community	32.25
Snowflake Warehouse Configuration Template	Config Template	intermediate	community	31.2
S3 → Glue → Athena	Project	intermediate	community	30.15
AWS Architecture Reviewer	Agent	advanced	community	29
AWS Glue Documentation	Reference	—	community	26.7
BigQuery Documentation	Reference	—	community	26.7
Databricks Documentation	Reference	—	community	26.7
Snowflake Documentation	Reference	—	community	26.7
Terraform AWS Data Platform	Template	advanced	community	25.6
Cost-effective ETL with DuckDB and Amazon S3 Tables on AWS Glue	Reference	—	community	23.55
Investigating Build Regressions From the Last Known-Good Build	Reference	—	community	23.55
Materialize once, query anywhere: Introducing Iceberg materialized views in Amazon Redshift	Reference	—	community	23.55

Documented learning objectives

Size Glue workers from data volume, not habit
Use job bookmarks correctly
Avoid full-table reprocessing from catalogue mistakes
Read the scanned-bytes metric per query
Apply partition projection for high-cardinality columns
Compact small files to cut per-request overhead
Explain storage/compute separation with one managed example per layer
Name the IAM surface each managed service needs before the first query

Continue the progression

← Streaming · Data Quality →

← Full roadmap · All learning topics