Scheduling a job by time, file arrival, or table update
Lakeflow Jobs (formerly Databricks Workflows) can run on a fixed schedule or be triggered automatically by external events, removing the need for manual runs or custom polling logic. Trigger types include scheduled (cron-based), file arrival (new files land in a storage location), and table update (changes to a Delta table), each configured on the job's trigger settings.
Must-know
- Scheduled triggers use a cron syntax with a selectable timezone, and jobs can also be run manually or via the REST API regardless of the configured trigger.
- File arrival triggers watch a storage location (e.g., a Unity Catalog volume or cloud object storage path) and start a run when new files are detected, using efficient event-based detection rather than constant polling.
- File arrival triggers have a minimum time between runs setting (e.g., not more than once every N minutes) to batch multiple file arrivals into a single job run and avoid excessive triggering.
- Table update triggers fire a job run when a specified Delta table (or tables) changes, useful for chaining downstream jobs to upstream data refreshes without a fixed schedule.
- Only one trigger type can be actively configured per job at a time, though the job can still be run manually or via API independent of that trigger.
- If a job is already running when a new trigger event occurs, Lakeflow Jobs queues or skips the run based on the job's concurrency/queuing settings rather than always starting a new run immediately.
A data engineer needs a Lakeflow Job to run automatically whenever new CSV files land in a cloud storage directory, but new files arrive unpredictably throughout the day and sometimes not at all for several days. Which trigger type minimizes unnecessary job runs while ensuring the job runs promptly when data does arrive?
What you have tried across Databricks DEA's objectives, not a readiness score.
Databricks Intelligence Platform
Data Ingestion and Loading
- Batch, streaming, and incremental loading patterns, and where the data comes from
- Loading files from cloud storage into governed tables with COPY INTO
- Landing data with Auto Loader, and handling schema enforcement and evolution
- Setting up Lakeflow Connect to ingest from enterprise sources reliably
- Pulling data through JDBC, ODBC, or REST clients and scheduling the job
- Choosing the right ingestion method for a given volume, frequency, and governance need
- Bringing semi-structured and unstructured data into governed Delta tables
Data Transformation and Modeling
- Cleaning bronze data into silver tables with PySpark and SQL
- Joining and combining DataFrames with the different join and union types
- Reshaping columns, rows, and arrays in a table
- Deduplicating and aggregating DataFrames
- Tuning Spark's core parameters and measuring what changed
- Building Gold-layer views and tables for BI and analytics
- Validating Silver and Gold datasets for quality
Working with Lakeflow Jobs
Implementing CI/CD
- Branching, committing, and opening pull requests from inside the Databricks workspace
- Promoting one codebase across dev, test, and prod with bundle variables and overrides
- Packaging and deploying jobs and pipelines with Automation Bundles
- Validating and managing bundle deployments from the Databricks CLI
Troubleshooting, Monitoring, and Optimization
- Spotting performance trends in a job's run history
- Reading job status, task graphs, and failure rates to monitor pipeline health
- Diagnosing skew, shuffle, and spill from Spark UI stage metrics
- What Liquid Clustering and predictive optimization actually do
- Diagnosing cluster startup failures, library conflicts, and out-of-memory errors
Governance and Security
Coverage checked against the published exam guide on Jul 26, 2026.
These are independent practice questions, written against this certification's published exam guide. They are not the certification vendor's own questions, and not the real exam.