Terraform GCP Data Stack
Designs and provisions production-grade Google Cloud data platform infrastructure using Terraform. Covers BigQuery, Cloud Storage, Pub/Sub, Dataflow, Cloud Composer, IAM, networking, and cost optimization with reusable module patterns.
SupaScore
83.75Best for
- ▸Multi-petabyte BigQuery data warehouse setup with cost-optimized slot reservations and partitioning
- ▸Production-grade data lake architecture using Cloud Storage lifecycle policies and VPC Service Controls
- ▸Real-time streaming pipelines connecting Pub/Sub, Dataflow, and BigQuery with proper IAM
- ▸Cloud Composer orchestration infrastructure with Private Service Connect networking
- ▸CMEK encryption and DLP integration for sensitive healthcare or financial datasets
What you'll get
- ●Modular Terraform codebase with separate modules for networking, BigQuery datasets with slot reservations, Cloud Storage with lifecycle policies, and comprehensive IAM bindings
- ●Production deployment architecture with remote state in GCS, environment separation (dev/staging/prod), and automated cost monitoring dashboards
- ●Security-hardened configuration with VPC Service Controls perimeters, CMEK encryption, service accounts per workload, and audit logging sinks
Not designed for ↓
- ×Writing actual data transformation logic or SQL queries for BigQuery
- ×Designing business logic for data pipelines or ETL processes
- ×Application-level data modeling or schema design decisions
- ×Performance tuning existing BigQuery queries or Dataflow jobs
Clear data platform requirements including volume, velocity, compliance needs, team structure, and existing GCP project setup.
Production-ready Terraform modules with proper state management, IAM hardening, networking configuration, and cost optimization strategies.
Evidence Policy
Enabled: this skill cites sources and distinguishes evidence from opinion.
Research Foundation: 8 sources (4 official docs, 2 books, 1 industry frameworks, 1 web)
This skill was developed through independent research and synthesis. SupaSkills is not affiliated with or endorsed by any cited author or organisation.
Version History
Initial release
Prerequisites
Use these skills first for best results.
Works well with
Need more depth?
Specialist skills that go deeper in areas this skill touches.
Common Workflows
Enterprise Data Platform Setup
Full data platform deployment from architecture planning through infrastructure provisioning to analytics setup
Activate this skill in Claude Code
Sign up for free to access the full system prompt via REST API or MCP.
Start Free to Activate This Skill© 2026 Kill The Dragon GmbH. This skill and its system prompt are protected by copyright. Unauthorised redistribution is prohibited. Terms of Service · Legal Notice