Skip to content

Making a slow pipeline run faster

Optimizing a Fabric pipeline means reducing run time, cost, and failure impact by tuning parallelism, minimizing data movement, and using monitoring data to target the true bottleneck rather than guessing. Most gains come from copy settings, incremental loading, and pipeline structure rather than raw compute scaling.

Must-know

  • Always start optimization by reviewing the pipeline run's Gantt/duration view in the Monitoring hub to identify which activity is actually the bottleneck before making changes.
  • Increase Copy activity throughput via Data Integration Units (DIU) and the degree of copy parallelism, and use ForEach activity's batchCount to run independent iterations concurrently instead of sequentially.
  • Prefer incremental or delta loading (using watermark columns, timestamps, or change data capture) over full reloads to cut data volume and execution time on repeated runs.
  • Push filtering, joins, and aggregation down to the source system (query pushdown) rather than copying full datasets and transforming them afterward, since this minimizes unnecessary data movement.
  • Break large monolithic pipelines into smaller, modular pipelines invoked via Execute Pipeline activity so sections can be reused, retried, or scaled independently without rerunning the whole workflow.
  • Set explicit timeout and retry policies on activities and use conditional/Fail activities for fast failure, since default long timeouts and unnecessary retries waste compute and delay diagnosis.
Check this objectiveFree · always available

A data engineer builds a Fabric pipeline that uses a Copy activity to ingest several thousand small JSON files (each under 50 KB) from an Azure Data Lake Storage Gen2 container into a Lakehouse. The copy takes far longer than expected, and increasing the Data Integration Units (DIUs) setting has produced almost no improvement. What should the engineer do to increase throughput for this workload?

Your objective map0 tried · 0 right · 54 untouched

What you have tried across DP-700's objectives, not a readiness score.

Coverage checked against the published exam guide on Aug 12, 2026.

These are independent practice questions, written against this certification's published exam guide. They are not the certification vendor's own questions, and not the real exam.