Skip to content

Processing data once it is sitting in storage

Processing data for storage on Google Cloud means choosing the right compute service to transform, clean, and load data into your target store, Cloud Storage, BigQuery, Bigtable, Spanner, or Firestore, using either batch or streaming pipelines. The exam tests your ability to match a workload's latency, scale, and schema requirements to Dataflow, Dataproc, BigQuery, or Data Fusion, and to understand how processing choices affect downstream storage design (partitioning, clustering, schema evolution).

Must-know

  • Dataflow (Apache Beam) is the preferred serverless service for both batch and streaming pipelines and unifies the two under one programming model, making it the default choice when the exam mentions 'unified batch and streaming' or autoscaling ETL.
  • Dataproc runs managed Hadoop/Spark clusters and is the right answer when a scenario requires migrating existing Spark/Hadoop jobs or needs fine-grained cluster control, not for greenfield serverless pipelines.
  • BigQuery can process data in place via SQL (ELT) using scheduled queries, materialized views, or BigQuery ML, so heavy transformation logic doesn't always need an external pipeline, prefer ELT when data is already in BigQuery and transformations are SQL-expressible.
  • Cloud Data Fusion is a GUI-based, no-code/low-code ETL tool built on CDAP, useful when the exam scenario emphasizes visual pipeline design or data governance/lineage for less technical teams.
  • Streaming inserts into BigQuery (via the Storage Write API or legacy streaming API) incur different cost/latency tradeoffs than batch loads, and small/frequent writes can hit quota limits if not batched appropriately.
  • Pub/Sub is the standard ingestion buffer feeding Dataflow streaming pipelines before data lands in Bigtable, BigQuery, or Cloud Storage, decoupling producers from processing to handle bursty or out-of-order data with watermarks and windowing.

Coverage checked against the published exam guide on Aug 11, 2026.

These are independent practice questions, written against this certification's published exam guide. They are not the certification vendor's own questions, and not the real exam.