Implementing Data Engineering Solutions Using Azure Databricks DP-750 Practice Test 21
Question 200
An operator introduces: Create a team-specific schema with ownership or delegated creation grants limited to that namespace. The situation is: A newly onboarded product team wants to create its own tables but should not have administration rights over every catalog. Which validation should be required before signoff?
- Discovery tests distinguish raw from certified curated objects and owners confirm their assigned namespaces.
- Catalog lookup and controlled read work from the registered target while unapproved principals cannot bypass it.
- A controlled create-drop rehearsal confirms the expected metadata and physical data lifecycle for the table type.
- The product service principal creates in its own schema and fails the same operation in unrelated schemas.
Explanation
Correct Answer
D:The strongest acceptance proof is: The product service principal creates in its own schema and fails the same operation in unrelated schemas. It specifically verifies: Create a team-specific schema with ownership or delegated creation grants limited to that namespace. The original issue was: A newly onboarded product team wants to create its own tables but should not have administration rights over every catalog. The underlying mechanism is: Delegating within a governed schema supports self-service without tenant-wide administrative access. Without it, global privileges may allow a team to alter or remove other products' data assets.
Incorrect Answers
A:This result would validate a different measure: Define a consistent schema and naming architecture separating layers and business domains by purpose. That is relevant to the distinct problem: Multiple data products put raw, refined and curated assets into a single schema with confusing table names. Here the acceptance criterion is: The product service principal creates in its own schema and fails the same operation in unrelated schemas.
B:This result would validate a different measure: Recreate or update supported external table registration using an approved location and correct access controls. That is relevant to the distinct problem: A managed Delta table is migrated to external storage but the team does not update table registration or grant scopes. Here the acceptance criterion is: The product service principal creates in its own schema and fails the same operation in unrelated schemas.
C:This result would validate a different measure: Select managed or external Unity Catalog table ownership intentionally and verify lifecycle semantics. That is relevant to the distinct problem: A team expects dropping a managed table to preserve all physical data as though it were an external table. Here the acceptance criterion is: The product service principal creates in its own schema and fails the same operation in unrelated schemas.
Question 201
A Databricks engineer recommends: Compare workload contention and resource reservations, then isolate or resize the critical job compute. It responds to: A production notebook intermittently times out only when many other jobs share the same classic cluster. What underlying mechanism BEST explains why?
- Shuffle spills indicate data exceeded available in-memory execution resources for a stage.
- Severe key skew causes uneven task work even with many executors.
- Shared compute competition can cause unpredictable task latency independent of input correctness.
- Different failure layers require different diagnostic paths instead of generic cluster restarts.
Explanation
Correct Answer
C:The decisive mechanism is: Shared compute competition can cause unpredictable task latency independent of input correctness. That explains the selected action: Compare workload contention and resource reservations, then isolate or resize the critical job compute. In the original scenario: A production notebook intermittently times out only when many other jobs share the same classic cluster. The specific unmanaged risk is: A critical SLA may depend on unrelated teams' scheduling and resource usage. Validate with: The isolated benchmark meets its percentile duration under simultaneous unrelated workload pressure.
Incorrect Answers
A:This principle concerns a separate data-engineering condition: A large aggregation has repeated shuffle spills to disk even though source scans finish quickly. Its targeted response is: Examine shuffle metrics, memory pressure and partition sizing to target the spilling stage. The current case is governed more directly by: Shared compute competition can cause unpredictable task latency independent of input correctness.
B:This principle concerns a separate data-engineering condition: A DataFrame join spills heavily because a single join key occurs in most rows. Its targeted response is: Use query-profile evidence and a supported skew mitigation such as adaptive execution or key-aware repartitioning. The current case is governed more directly by: Shared compute competition can cause unpredictable task latency independent of input correctness.
D:This principle concerns a separate data-engineering condition: An operations team sees Dataflow-like ingestion failures but cannot identify whether the problem is a Unity Catalog grant or a Spark stage. Its targeted response is: Correlate error messages, job run IDs, catalog authorization logs and Spark execution evidence before remediation. The current case is governed more directly by: Shared compute competition can cause unpredictable task latency independent of input correctness.
Question 202
An Azure Databricks architect reviews the following problem: A source API changes a quantity from integer to nested JSON and the pipeline silently produces nulls downstream. What should the team implement FIRST?
- Apply schema enforcement with explicit drift handling and alert on incompatible structural changes.
- Configure expectations with an explicit fail, drop or retention behavior aligned to business severity.
- Maintain a governed schema contract and integration tests across both notebook and declarative pipeline paths.
- Collect expectation metrics and reconcile input, accepted, quarantined and rejected record counts.
Explanation
Correct Answer
A:The most appropriate action is: Apply schema enforcement with explicit drift handling and alert on incompatible structural changes. It addresses the stated condition: A source API changes a quantity from integer to nested JSON and the pipeline silently produces nulls downstream. The technical basis is: Schema evolution must distinguish permissible additive fields from breaking type changes. Without this control, silently coercing a breaking type can erase measurable values while a job appears successful. A direct acceptance check is: A simulated type change is rejected or rescued with an actionable alert and no corrupted curated output.
Incorrect Answers
B:This alternative primarily addresses a different Azure Databricks problem: A Lakeflow pipeline has a quality rule but nobody has decided whether invalid transactions should stop publishing. The corresponding measure there would be: Configure expectations with an explicit fail, drop or retention behavior aligned to business severity. The stated situation instead calls for: Apply schema enforcement with explicit drift handling and alert on incompatible structural changes.
C:This alternative primarily addresses a different Azure Databricks problem: An engineer changes the expected file schema in one notebook but forgets to update the Lakeflow pipeline definition. The corresponding measure there would be: Maintain a governed schema contract and integration tests across both notebook and declarative pipeline paths. The stated situation instead calls for: Apply schema enforcement with explicit drift handling and alert on incompatible structural changes.
D:This alternative primarily addresses a different Azure Databricks problem: A pipeline reports zero failed rows because bad records are silently dropped without any count of what was removed. The corresponding measure there would be: Collect expectation metrics and reconcile input, accepted, quarantined and rejected record counts. The stated situation instead calls for: Apply schema enforcement with explicit drift handling and alert on incompatible structural changes.
Question 203
A team omits the recommended measure: Analyze concurrent query load and scaling policies rather than selecting capacity from daily averages. Its environment shows: An interactive warehouse has high query queues during the morning but low CPU utilization after lunch. What is the MOST direct residual risk?
- A warehouse sized to average load may breach dashboard p95 latency during business opening.
- Premature deletion may invalidate time travel or a lagging reader's file references.
- A critical SLA may depend on unrelated teams' scheduling and resource usage.
- Excessive false alerts can obscure serious freshness incidents.
Explanation
Correct Answer
A:The direct residual exposure is: A warehouse sized to average load may breach dashboard p95 latency during business opening. The triggering condition is: An interactive warehouse has high query queues during the morning but low CPU utilization after lunch. The omitted safeguard is: Analyze concurrent query load and scaling policies rather than selecting capacity from daily averages. This matters because: Concurrent demand peaks can drive queue delays independently of average compute utilization. A corrective test would show: A peak-concurrency replay meets latency and queue targets with recorded cost.
Incorrect Answers
B:This failure mode belongs mainly to another situation: An engineer runs VACUUM with a zero-hour retention on a shared Delta table used for historical audit queries. Its preventative action would be: Respect documented safe retention windows and coordinate VACUUM with readers, streams and time-travel needs. The most direct exposure in the current scenario is: A warehouse sized to average load may breach dashboard p95 latency during business opening.
C:This failure mode belongs mainly to another situation: A production notebook intermittently times out only when many other jobs share the same classic cluster. Its preventative action would be: Compare workload contention and resource reservations, then isolate or resize the critical job compute. The most direct exposure in the current scenario is: A warehouse sized to average load may breach dashboard p95 latency during business opening.
D:This failure mode belongs mainly to another situation: An alert triggers on every harmless microbatch delay while real hour-long ingestion stalls go unnoticed. Its preventative action would be: Define meaningful latency, error and backlog thresholds with alert routing based on the business SLO. The most direct exposure in the current scenario is: A warehouse sized to average load may breach dashboard p95 latency during business opening.
Question 204
A production data platform experiences this condition: A new Delta table maintenance job combines repeated OPTIMIZE and VACUUM at every microbatch even though changes are tiny. Which targeted measure should be selected?
- Analyze concurrent query load and scaling policies rather than selecting capacity from daily averages.
- Inspect query predicates and Delta data skipping or clustering layout before increasing warehouse size again.
- Use Lakeflow Jobs repair at the failed task when dependency outputs remain valid.
- Set a measured maintenance cadence or evaluate supported predictive optimization for eligible managed tables.
Explanation
Correct Answer
D:The most appropriate action is: Set a measured maintenance cadence or evaluate supported predictive optimization for eligible managed tables. It addresses the stated condition: A new Delta table maintenance job combines repeated OPTIMIZE and VACUUM at every microbatch even though changes are tiny. The technical basis is: Maintenance operations themselves consume compute and should correspond to data growth and read patterns. Without this control, over-maintenance can spend more resources rewriting files than it saves in queries. A direct acceptance check is: A benchmark shows lower total maintenance-plus-query cost without compromising retention.
Incorrect Answers
A:This alternative primarily addresses a different Azure Databricks problem: An interactive warehouse has high query queues during the morning but low CPU utilization after lunch. The corresponding measure there would be: Analyze concurrent query load and scaling policies rather than selecting capacity from daily averages. The stated situation instead calls for: Set a measured maintenance cadence or evaluate supported predictive optimization for eligible managed tables.
B:This alternative primarily addresses a different Azure Databricks problem: A warehouse query remains slow even after larger compute is allocated and the profile reports scanning nearly every file. The corresponding measure there would be: Inspect query predicates and Delta data skipping or clustering layout before increasing warehouse size again. The stated situation instead calls for: Set a measured maintenance cadence or evaluate supported predictive optimization for eligible managed tables.
C:This alternative primarily addresses a different Azure Databricks problem: A job fails during a temporary Azure storage outage but operators rerun every successful upstream task. The corresponding measure there would be: Use Lakeflow Jobs repair at the failed task when dependency outputs remain valid. The stated situation instead calls for: Set a measured maintenance cadence or evaluate supported predictive optimization for eligible managed tables.
Question 205
The recommended measure is: Grant only the required USE and SELECT privileges to the analyst group and inspect inherited grants. The operational context is: A finance analyst must read an approved table but was granted broad MODIFY rights at the schema level. Which data engineering concept applies?
- Row-level security evaluates access rules at query time rather than relying on users to remember a WHERE clause.
- Unity Catalog privileges are scoped to securable objects and can be inherited from containers.
- Automation authentication should be auditable, nonpersonal and resistant to repository exposure.
- Cloud IAM and Unity Catalog are complementary authorization layers that must both permit the intended operation.
Explanation
Correct Answer
B:The decisive mechanism is: Unity Catalog privileges are scoped to securable objects and can be inherited from containers. That explains the selected action: Grant only the required USE and SELECT privileges to the analyst group and inspect inherited grants. In the original scenario: A finance analyst must read an approved table but was granted broad MODIFY rights at the schema level. The specific unmanaged risk is: Unnecessary modification rights can let a compromised analyst alter financial records. Validate with: The analyst can SELECT the authorized table but cannot UPDATE it or read an unrelated protected table.
Incorrect Answers
A:This principle concerns a separate data-engineering condition: A user must see only the East region rows of a common sales table while managers see all territories. Its targeted response is: Configure a tested Unity Catalog row filter or suitable ABAC policy based on the authorized identity. The current case is governed more directly by: Unity Catalog privileges are scoped to securable objects and can be inherited from containers.
C:This principle concerns a separate data-engineering condition: A production workload uses a personal access token stored in Git for Databricks REST calls. Its targeted response is: Replace committed personal credentials with supported workload authentication and revoke exposed tokens. The current case is governed more directly by: Unity Catalog privileges are scoped to securable objects and can be inherited from containers.
D:This principle concerns a separate data-engineering condition: A managed identity can read a storage container but a newly created external table is denied in Databricks. Its targeted response is: Align Azure storage role assignments with the registered Unity Catalog storage credential and external-location privileges. The current case is governed more directly by: Unity Catalog privileges are scoped to securable objects and can be inherited from containers.
Question 206
A platform architect adopts: Configure a tested Unity Catalog row filter or suitable ABAC policy based on the authorized identity. For this requirement: A user must see only the East region rows of a common sales table while managers see all territories. Which rationale MOST directly supports it?
- Unity Catalog privileges are scoped to securable objects and can be inherited from containers.
- Row-level security evaluates access rules at query time rather than relying on users to remember a WHERE clause.
- Column masking can transform sensitive values at query time according to the querying principal.
- Data access delegation need not transfer administrative ownership of data objects.
Explanation
Correct Answer
B:The decisive mechanism is: Row-level security evaluates access rules at query time rather than relying on users to remember a WHERE clause. That explains the selected action: Configure a tested Unity Catalog row filter or suitable ABAC policy based on the authorized identity. In the original scenario: A user must see only the East region rows of a common sales table while managers see all territories. The specific unmanaged risk is: A user could retrieve other regions by querying the table without an application filter. Validate with: An East-region identity cannot read West-region test rows while the approved manager has the intended view.
Incorrect Answers
A:This principle concerns a separate data-engineering condition: A finance analyst must read an approved table but was granted broad MODIFY rights at the schema level. Its targeted response is: Grant only the required USE and SELECT privileges to the analyst group and inspect inherited grants. The current case is governed more directly by: Row-level security evaluates access rules at query time rather than relying on users to remember a WHERE clause.
C:This principle concerns a separate data-engineering condition: A customer service dashboard must show the last four digits of account identifiers but never full account values. Its targeted response is: Apply a supported column mask or ABAC masking rule to the sensitive field and test different roles. The current case is governed more directly by: Row-level security evaluates access rules at query time rather than relying on users to remember a WHERE clause.
D:This principle concerns a separate data-engineering condition: A data steward wants to grant temporary read access without handing over Unity Catalog ownership of a schema. Its targeted response is: Issue time-bounded group membership or an approved scoped SELECT grant with an access review. The current case is governed more directly by: Row-level security evaluates access rules at query time rather than relying on users to remember a WHERE clause.
Question 207
An operator introduces: Design a compatible atomic publication or versioned readiness contract so consumers see consistent results. The situation is: A regulated pipeline needs consistent transaction boundaries across multiple table writes but updates are published one at a time. Which validation should be required before signoff?
- A delayed-ingestion test prevents gold refresh until bronze and silver are completed successfully.
- A controlled consumer test sees only one approved publication version across dependent datasets.
- A staged failure triggers the documented alert and cleanup while skipping dependent publication.
- A simulated hung request times out, alerts the owner and avoids publishing incomplete data.
Explanation
Correct Answer
B:The strongest acceptance proof is: A controlled consumer test sees only one approved publication version across dependent datasets. It specifically verifies: Design a compatible atomic publication or versioned readiness contract so consumers see consistent results. The original issue was: A regulated pipeline needs consistent transaction boundaries across multiple table writes but updates are published one at a time. The underlying mechanism is: Multi-table orchestration requires a defined consistency point even if each individual Delta write is atomic. Without it, readers can combine incompatible versions when related tables update independently.
Incorrect Answers
A:This result would validate a different measure: Define explicit Lakeflow Jobs task dependencies so silver and gold steps run only after their required predecessors succeed. That is relevant to the distinct problem: A sales pipeline aggregates gold metrics before the bronze ingestion task finishes and occasionally reports incomplete totals. Here the acceptance criterion is: A controlled consumer test sees only one approved publication version across dependent datasets.
C:This result would validate a different measure: Design a separate failure-handling or completion branch with the supported run-if logic for alerts and cleanup. That is relevant to the distinct problem: A source task fails yet the monitoring task never executes because all downstream tasks require upstream success. Here the acceptance criterion is: A controlled consumer test sees only one approved publication version across dependent datasets.
D:This result would validate a different measure: Use controlled task-level timeouts and isolate unpredictable external calls from bounded transform stages. That is relevant to the distinct problem: A scheduled notebook contains both transformation SQL and a long-running external API loop that occasionally hangs. Here the acceptance criterion is: A controlled consumer test sees only one approved publication version across dependent datasets.
Question 208
For this Azure Databricks issue: A student dataset uses SQL GROUP BY with unhandled duplicate enrollment rows before reporting course completion. Engineers choose: Validate business keys and choose a deterministic latest-enrollment record before aggregation. What acceptance evidence is BEST?
- Test histories with retries and real re-enrollments produce the approved per-student count.
- A controlled money sample matches expected exact decimal totals and rejects malformed amounts.
- A sample includes all approved categories and status totals reconcile to source rows.
- A seeded repeated-ID sample yields one chosen current order version and reconciled totals.
Explanation
Correct Answer
A:The strongest acceptance proof is: Test histories with retries and real re-enrollments produce the approved per-student count. It specifically verifies: Validate business keys and choose a deterministic latest-enrollment record before aggregation. The original issue was: A student dataset uses SQL GROUP BY with unhandled duplicate enrollment rows before reporting course completion. The underlying mechanism is: Aggregation alone cannot distinguish valid repeat enrollments from accidental duplicates. Without it, completion metrics may be inflated or undercounted when duplicate business events are not resolved.
Incorrect Answers
B:This result would validate a different measure: Parse and cast monetary values to a suitable decimal type with invalid-value handling. That is relevant to the distinct problem: A finance field arrives as a string with currency symbols and the team aggregates it lexicographically. Here the acceptance criterion is: Test histories with retries and real re-enrollments produce the approved per-student count.
C:This result would validate a different measure: Apply a controlled pivot with a defined set of expected categories and aggregation rule. That is relevant to the distinct problem: A quality report needs one column for each product status category but stores status as separate rows. Here the acceptance criterion is: Test histories with retries and real re-enrollments produce the approved per-student count.
D:This result would validate a different measure: Apply a deterministic deduplication rule based on stable order identity and source version before aggregation. That is relevant to the distinct problem: An incoming orders table contains repeated order IDs because a vendor retransmits the same daily extract. Here the acceptance criterion is: Test histories with retries and real re-enrollments produce the approved per-student count.
Question 209
The following control has NOT been implemented: Choose node families and driver/worker sizes using CPU, memory, shuffle and workload profile evidence. In this case: A new job uses a large memory-optimized node merely because its source data is large, although profiling shows compute-bound transforms. Which exposure remains?
- An untrusted library or unrestricted cluster edit can affect other users' sessions or access to protected data.
- Overspending on memory does not relieve a CPU-bound stage and may worsen the cost-performance ratio.
- An unverified runtime switch may break a previously working production ingestion notebook.
- Leaving an interactive cluster running around the clock accumulates charges unrelated to completed pipeline work.
Explanation
Correct Answer
B:The direct residual exposure is: Overspending on memory does not relieve a CPU-bound stage and may worsen the cost-performance ratio. The triggering condition is: A new job uses a large memory-optimized node merely because its source data is large, although profiling shows compute-bound transforms. The omitted safeguard is: Choose node families and driver/worker sizes using CPU, memory, shuffle and workload profile evidence. This matters because: Workload bottlenecks rather than raw input size should drive Spark cluster shape and resource selection. A corrective test would show: A controlled instance-family comparison achieves the same results with improved stage time and total execution cost.
Incorrect Answers
A:This failure mode belongs mainly to another situation: A multi-team interactive cluster permits users to attach arbitrary unapproved libraries and run notebooks under broad shared privileges. Its preventative action would be: Apply suitable compute access modes, policies and entitlements that restrict who can attach or modify shared compute. The most direct exposure in the current scenario is: Overspending on memory does not relieve a CPU-bound stage and may worsen the cost-performance ratio.
C:This failure mode belongs mainly to another situation: A developer selects a new Databricks Runtime version for production despite an untested JDBC driver dependency. Its preventative action would be: Pin a supported Databricks Runtime version and validate application libraries against it before deployment. The most direct exposure in the current scenario is: Overspending on memory does not relieve a CPU-bound stage and may worsen the cost-performance ratio.
D:This failure mode belongs mainly to another situation: A nightly batch transformation uses a continuously running all-purpose cluster even though no analyst interacts with the workload between runs. Its preventative action would be: Move the scheduled transformation to appropriately configured jobs compute or supported serverless jobs and release resources after execution. The most direct exposure in the current scenario is: Overspending on memory does not relieve a CPU-bound stage and may worsen the cost-performance ratio.
Question 210
An implementation skips: Configure a tested Unity Catalog row filter or suitable ABAC policy based on the authorized identity. Engineers are observing: A user must see only the East region rows of a common sales table while managers see all territories. What consequence is MOST likely?
- An employee departure or password rotation can unexpectedly break critical production ingestion.
- A copied notebook may leak storage access keys beyond the intended data-processing environment.
- A retired vendor workload can continue reading business data through unchanged credentials.
- A user could retrieve other regions by querying the table without an application filter.
Explanation
Correct Answer
D:The direct residual exposure is: A user could retrieve other regions by querying the table without an application filter. The triggering condition is: A user must see only the East region rows of a common sales table while managers see all territories. The omitted safeguard is: Configure a tested Unity Catalog row filter or suitable ABAC policy based on the authorized identity. This matters because: Row-level security evaluates access rules at query time rather than relying on users to remember a WHERE clause. A corrective test would show: An East-region identity cannot read West-region test rows while the approved manager has the intended view.
Incorrect Answers
A:This failure mode belongs mainly to another situation: An ETL service principal is granted permissions through a personal employee account that will leave the company. Its preventative action would be: Use a dedicated service principal with scoped Unity Catalog grants and governed credential lifecycle. The most direct exposure in the current scenario is: A user could retrieve other regions by querying the table without an application filter.
B:This failure mode belongs mainly to another situation: A scheduled cloud-data ingestion needs an Azure storage identity but engineers embed a reusable account key inside notebooks. Its preventative action would be: Use a supported Azure managed identity and Unity Catalog storage credential or equivalent approved access path. The most direct exposure in the current scenario is: A user could retrieve other regions by querying the table without an application filter.
C:This failure mode belongs mainly to another situation: A vendor's service principal was granted global access for a one-month integration and the project ended. Its preventative action would be: Review and revoke stale grants and any linked service credentials, preserving required internal ownership. The most direct exposure in the current scenario is: A user could retrieve other regions by querying the table without an application filter.