Skip to content

Putting a query on a schedule and keeping it running

Google Cloud offers several ways to run queries and data pipelines on a schedule, ranging from BigQuery's built-in scheduled queries for simple recurring SQL jobs to Cloud Scheduler for triggering serverless functions or Pub/Sub messages, up to Cloud Composer for complex, multi-step, dependency-driven workflows. Choosing the right tool depends on complexity, orchestration needs, and whether you need cross-service coordination.

Must-know

  • BigQuery scheduled queries use the BigQuery Data Transfer Service under the hood and require the caller to have appropriate BigQuery Data Editor/Job User roles plus the transfer service enabled.
  • Scheduled queries run under the credentials of the user who created them (or a service account if configured), so query failures often occur silently if that user's permissions change or their OAuth token expires.
  • Cloud Scheduler is a fully managed cron-job scheduler that can invoke HTTP endpoints, Pub/Sub topics, or Cloud Run/Cloud Functions, making it suitable for triggering custom scripts or lightweight pipeline steps but not for defining multi-step DAG dependencies itself.
  • Cloud Composer (managed Apache Airflow) is the recommended tool for orchestrating complex workflows with task dependencies, retries, branching logic, and cross-service coordination (e.g., BigQuery, Dataflow, Cloud Storage) beyond simple time-based triggers.
  • BigQuery scheduled queries support configurable repeat frequency (daily, weekly, custom cron) and can write results to a destination table, but they lack built-in dependency management for downstream tasks. Use Composer or Workflows if downstream steps depend on query completion.
  • For cost and simplicity, prefer BigQuery scheduled queries for single recurring SQL jobs, Cloud Scheduler for simple periodic triggers of external actions, and Cloud Composer only when you need orchestration of multiple interdependent tasks across services.
Check this objectiveFree · always available

A data practitioner creates a scheduled query in BigQuery that runs daily, reading from a table in a dataset located in "us-central1" and writing the results to a destination table in a dataset located in "europe-west1". The scheduled query consistently fails. What is the most likely cause?

Your objective map0 tried · 0 right · 41 untouched

What you have tried across GCP ADP's objectives, not a readiness score.

Coverage checked against the published exam guide on Aug 12, 2026.

These are independent practice questions, written against this certification's published exam guide. They are not the certification vendor's own questions, and not the real exam.