Skip to content

Separating development and production environments cleanly

Google Cloud data processing designs must support distinct development and production environments so teams can iterate quickly without risking production data quality, cost, or availability. This typically involves separate GCP projects, environment-specific configurations, and controlled promotion paths from dev to test to production.

Must-know

  • Use separate GCP projects (not just datasets or folders) for dev, test, and prod to get clean IAM boundaries, billing isolation, and quota separation.
  • Dataflow, Dataproc, and Composer support environment-specific parameters (e.g., pipeline options, Airflow variables, Terraform workspaces) so the same code/DAG can run against different service accounts, datasets, and cluster sizes per environment.
  • Production environments should favor autoscaling and managed services (e.g., Dataproc autoscaling policies, Dataflow autoscaling) while dev/test can use smaller fixed-size or ephemeral clusters to control cost.
  • Use BigQuery datasets or projects labeled by environment plus row-level/column-level security and separate service accounts so dev engineers cannot accidentally read or write production data.
  • CI/CD pipelines (Cloud Build, Cloud Deploy) should promote artifacts (container images, JAR files, DAGs) through dev, staging, and prod using the same build artifact to avoid environment drift.
  • Cost controls differ by environment: dev/test often use preemptible/Spot VMs and smaller quotas, while production uses committed use discounts and SLA-backed managed services for reliability.

Coverage checked against the published exam guide on Aug 11, 2026.

These are independent practice questions, written against this certification's published exam guide. They are not the certification vendor's own questions, and not the real exam.