Implementing Data Engineering Solutions Using Azure Databricks DP-750 Practice Test 6
Question 50
A pipeline owner declines the action: Configure bounded autoscaling using measured workload demand and verify maximum cost and startup behavior. The business situation is: A data engineering job sometimes requires twice its usual executor capacity during month-end loads while weekdays are much smaller. What specific failure can follow?
- Unmeasured tuning changes can hide the original bottleneck or increase compute costs.
- A fixed undersized cluster misses month-end deadlines while an oversized fixed cluster wastes daily spend.
- Sizing from isolated benchmark queries can leave hundreds of dashboard viewers waiting in a query queue.
- Ignoring startup overhead can make small jobs miss a narrow delivery window even when their Spark tasks are fast.
Explanation
Correct Answer
B:The direct residual exposure is: A fixed undersized cluster misses month-end deadlines while an oversized fixed cluster wastes daily spend. The triggering condition is: A data engineering job sometimes requires twice its usual executor capacity during month-end loads while weekdays are much smaller. The omitted safeguard is: Configure bounded autoscaling using measured workload demand and verify maximum cost and startup behavior. This matters because: Autoscaling can adapt worker resources to changing parallel workload demand within a defined limit. A corrective test would show: Load tests for normal and month-end volumes satisfy runtime targets without exceeding the approved worker ceiling.
Incorrect Answers
A:This failure mode belongs mainly to another situation: A team turns on every performance setting for a workload without benchmarking whether disk spills or network shuffle dominate runtime. Its preventative action would be: Collect Spark stage profiles and test a targeted compute or Photon setting against comparable data. The most direct exposure in the current scenario is: A fixed undersized cluster misses month-end deadlines while an oversized fixed cluster wastes daily spend.
C:This failure mode belongs mainly to another situation: A BI warehouse repeatedly slows during morning sign-in peaks even though a single analyst query runs quickly. Its preventative action would be: Tune supported SQL warehouse capacity and concurrency scaling based on simultaneous production query measurements. The most direct exposure in the current scenario is: A fixed undersized cluster misses month-end deadlines while an oversized fixed cluster wastes daily spend.
D:This failure mode belongs mainly to another situation: A scheduled workflow launches dozens of short-lived classic clusters and loses several minutes each time waiting for virtual machines. Its preventative action would be: Evaluate compatible instance pools or supported serverless startup behavior rather than keeping unused all-purpose clusters awake. The most direct exposure in the current scenario is: A fixed undersized cluster misses month-end deadlines while an oversized fixed cluster wastes daily spend.
Question 51
The team implements: Define Lakeflow Spark Declarative Pipelines source options, incremental behavior and expectations with a durable target. The original problem is: A declarative pipeline loads cloud object files continuously but its configuration omits how duplicate files and bad records are handled. Which test MOST convincingly demonstrates correctness?
- Readers observe a complete validated target before or after cutover, not partial data.
- Injected duplicate and malformed source samples follow the intended dedupe or quarantine rules.
- The import reads the intended input files once and reconciles the expected row count and schema.
- Replaying the same microbatch produces one target effect per business key.
Explanation
Correct Answer
B:The strongest acceptance proof is: Injected duplicate and malformed source samples follow the intended dedupe or quarantine rules. It specifically verifies: Define Lakeflow Spark Declarative Pipelines source options, incremental behavior and expectations with a durable target. The original issue was: A declarative pipeline loads cloud object files continuously but its configuration omits how duplicate files and bad records are handled. The underlying mechanism is: Declarative ingestion still requires explicit quality and replay assumptions. Without it, A stream can write duplicate or malformed records into curated output without policy.
Incorrect Answers
A:This result would validate a different measure: Choose a controlled CREATE OR REPLACE TABLE or compatible atomic table-replacement strategy and validate schema/permissions. That is relevant to the distinct problem: An existing table must be rebuilt from corrected historical files while its readers require a consistent atomic replacement. Here the acceptance criterion is: Injected duplicate and malformed source samples follow the intended dedupe or quarantine rules.
C:This result would validate a different measure: Use a suitable COPY INTO or supported batch ingestion statement with validated format and path options. That is relevant to the distinct problem: An integration performs a one-off initial import of an existing CSV folder into a Delta table. Here the acceptance criterion is: Injected duplicate and malformed source samples follow the intended dedupe or quarantine rules.
D:This result would validate a different measure: Implement idempotent foreachBatch or compatible transactional sink logic keyed by epoch or business identity. That is relevant to the distinct problem: A stream writes into an external sink without stable batch identities and causes duplicate side effects on retry. Here the acceptance criterion is: Injected duplicate and malformed source samples follow the intended dedupe or quarantine rules.
Question 52
During a lakehouse implementation review, engineers observe: A dataset has a strict requirement that Azure storage ownership and lifecycle remain under a separate platform team. What is the BEST next action?
- Use an external Unity Catalog table with an approved registered location instead of assuming managed storage ownership.
- Define a supported typed schema for nested structures and expected optional fields before writing to curated Delta.
- Enable supported liquid clustering with appropriate keys and run compatible optimization.
- Design event-time fields, ingestion timestamps and late-data behavior suited to replay and temporal queries.
Explanation
Correct Answer
A:The most appropriate action is: Use an external Unity Catalog table with an approved registered location instead of assuming managed storage ownership. It addresses the stated condition: A dataset has a strict requirement that Azure storage ownership and lifecycle remain under a separate platform team. The technical basis is: External tables separate catalog management from independently controlled underlying file lifecycle. Without this control, migrating data into a managed table can violate external storage governance agreements. A direct acceptance check is: The platform team retains approved storage lifecycle authority while Databricks queries the registered data.
Incorrect Answers
B:This alternative primarily addresses a different Azure Databricks problem: A stream produces nested JSON events with optional fields but an analyst hardcodes every field as STRING. The corresponding measure there would be: Define a supported typed schema for nested structures and expected optional fields before writing to curated Delta. The stated situation instead calls for: Use an external Unity Catalog table with an approved registered location instead of assuming managed storage ownership.
C:This alternative primarily addresses a different Azure Databricks problem: A large Delta fact table is filtered primarily on high-cardinality account IDs with changing query patterns. The corresponding measure there would be: Enable supported liquid clustering with appropriate keys and run compatible optimization. The stated situation instead calls for: Use an external Unity Catalog table with an approved registered location instead of assuming managed storage ownership.
D:This alternative primarily addresses a different Azure Databricks problem: A lakehouse receives sensor observations with event timestamps that arrive out of order. The corresponding measure there would be: Design event-time fields, ingestion timestamps and late-data behavior suited to replay and temporal queries. The stated situation instead calls for: Use an external Unity Catalog table with an approved registered location instead of assuming managed storage ownership.
Question 53
The recommended measure is: Add reviewed Unity Catalog table and column comments, owners and business definitions for consumer discovery. The operational context is: A business glossary has table names but no indication of which field is net revenue versus gross sales. Which data engineering concept applies?
- Technical retention settings and organizational policy need an auditable, consistent lifecycle.
- Object governance is ongoing and must follow organizational role and service identity changes.
- Governed descriptive metadata reduces ambiguity and supports correct analytical interpretation.
- Governance depends on maintained object ownership as teams and responsibilities change.
Explanation
Correct Answer
C:The decisive mechanism is: Governed descriptive metadata reduces ambiguity and supports correct analytical interpretation. That explains the selected action: Add reviewed Unity Catalog table and column comments, owners and business definitions for consumer discovery. In the original scenario: A business glossary has table names but no indication of which field is net revenue versus gross sales. The specific unmanaged risk is: Analysts may combine incompatible metrics and deliver unreliable reports. Validate with: A data steward can find the certified revenue definition and verify the correct field in Catalog Explorer.
Incorrect Answers
A:This principle concerns a separate data-engineering condition: A regulated source dataset receives an updated retention period but storage cleanup still follows the obsolete policy. Its targeted response is: Align table retention properties, scheduled maintenance and legal ownership approvals with the current classification. The current case is governed more directly by: Governed descriptive metadata reduces ambiguity and supports correct analytical interpretation.
B:This principle concerns a separate data-engineering condition: A company needs to review table-owner changes and permissions after organizational restructuring. Its targeted response is: Run a scheduled ownership and grant recertification process using catalog metadata and audit events. The current case is governed more directly by: Governed descriptive metadata reduces ambiguity and supports correct analytical interpretation.
D:This principle concerns a separate data-engineering condition: An audit asks who owns a catalog table but object ownership still points to an inactive employee. Its targeted response is: Transfer ownership through approved governance workflow and review grants after reassignment. The current case is governed more directly by: Governed descriptive metadata reduces ambiguity and supports correct analytical interpretation.
Question 54
A pipeline owner declines the action: Define fact-table grain at the required transaction or line-item level before aggregation. The business situation is: A facts table groups product sales at daily level although auditors must inspect individual transaction adjustments. What specific failure can follow?
- String-only columns can make numerical aggregation or timestamp ordering incorrect.
- Migrating data into a managed table can violate external storage governance agreements.
- One-file-per-customer patterns can overwhelm metadata and worsen query startup.
- Premature aggregation can make returns, corrections and invoice-line disputes impossible to reconcile.
Explanation
Correct Answer
D:The direct residual exposure is: Premature aggregation can make returns, corrections and invoice-line disputes impossible to reconcile. The triggering condition is: A facts table groups product sales at daily level although auditors must inspect individual transaction adjustments. The omitted safeguard is: Define fact-table grain at the required transaction or line-item level before aggregation. This matters because: Fact grain determines which analyses can be reconstructed without information loss. A corrective test would show: Sample invoice lines reconcile exactly to the fact table and roll up to the approved daily total.
Incorrect Answers
A:This failure mode belongs mainly to another situation: A stream produces nested JSON events with optional fields but an analyst hardcodes every field as STRING. Its preventative action would be: Define a supported typed schema for nested structures and expected optional fields before writing to curated Delta. The most direct exposure in the current scenario is: Premature aggregation can make returns, corrections and invoice-line disputes impossible to reconcile.
B:This failure mode belongs mainly to another situation: A dataset has a strict requirement that Azure storage ownership and lifecycle remain under a separate platform team. Its preventative action would be: Use an external Unity Catalog table with an approved registered location instead of assuming managed storage ownership. The most direct exposure in the current scenario is: Premature aggregation can make returns, corrections and invoice-line disputes impossible to reconcile.
C:This failure mode belongs mainly to another situation: A data engineer chooses the distinct customer ID as a partition directory for an SCD dimension with millions of customers. Its preventative action would be: Prefer appropriate clustering or lower-cardinality partitioning and assess file sizes for the dimension. The most direct exposure in the current scenario is: Premature aggregation can make returns, corrections and invoice-line disputes impossible to reconcile.
Question 55
A production data platform experiences this condition: A cloud file feed needs a job triggered by arriving files instead of polling every minute. Which targeted measure should be selected?
- Review explicit dependency and run-if settings and validate skip behavior through a staged failure.
- Wait for or explicitly verify required external or asynchronous work before reporting task success.
- Use a supported file-arrival trigger where its prerequisites and source location are compatible.
- Assign a dedicated run-as identity with durable scoped grants and an ownership review.
Explanation
Correct Answer
C:The most appropriate action is: Use a supported file-arrival trigger where its prerequisites and source location are compatible. It addresses the stated condition: A cloud file feed needs a job triggered by arriving files instead of polling every minute. The technical basis is: Event or file-arrival triggers can reduce idle polling while maintaining responsive execution. Without this control, constant scheduling may incur empty-run costs and still miss arrivals between checks. A direct acceptance check is: A test file arrives and starts one valid job run without repeated empty polling.
Incorrect Answers
A:This alternative primarily addresses a different Azure Databricks problem: A job owner cannot explain why a task skipped execution after a predecessor failed. The corresponding measure there would be: Review explicit dependency and run-if settings and validate skip behavior through a staged failure. The stated situation instead calls for: Use a supported file-arrival trigger where its prerequisites and source location are compatible.
B:This alternative primarily addresses a different Azure Databricks problem: A job is successful in the orchestrator but the business target is not updated because the notebook returns before async work completes. The corresponding measure there would be: Wait for or explicitly verify required external or asynchronous work before reporting task success. The stated situation instead calls for: Use a supported file-arrival trigger where its prerequisites and source location are compatible.
D:This alternative primarily addresses a different Azure Databricks problem: A job uses a service principal that loses access to the destination schema when an employee leaves. The corresponding measure there would be: Assign a dedicated run-as identity with durable scoped grants and an ownership review. The stated situation instead calls for: Use a supported file-arrival trigger where its prerequisites and source location are compatible.
Question 56
The recommended measure is: Pin a supported Databricks Runtime version and validate application libraries against it before deployment. The operational context is: A developer selects a new Databricks Runtime version for production despite an untested JDBC driver dependency. Which data engineering concept applies?
- Compute isolation reduces interference between unrelated application environments and execution libraries.
- SQL warehouses are optimized for SQL analytics and isolate query serving from other compute activities.
- Reproducible dependencies avoid unintentional behavior changes across cluster restarts and deployments.
- Spark and runtime upgrades can change supported APIs, dependency versions and execution behavior.
Explanation
Correct Answer
D:The decisive mechanism is: Spark and runtime upgrades can change supported APIs, dependency versions and execution behavior. That explains the selected action: Pin a supported Databricks Runtime version and validate application libraries against it before deployment. In the original scenario: A developer selects a new Databricks Runtime version for production despite an untested JDBC driver dependency. The specific unmanaged risk is: An unverified runtime switch may break a previously working production ingestion notebook. Validate with: A staging run on the proposed runtime loads the required JDBC driver and reproduces validated output.
Incorrect Answers
A:This principle concerns a separate data-engineering condition: A notebook pipeline uses a shared cluster with unstable third-party dependencies while a critical finance job needs controlled isolation. Its targeted response is: Run the finance job on dedicated supported job compute with its own pinned libraries and permissions. The current case is governed more directly by: Spark and runtime upgrades can change supported APIs, dependency versions and execution behavior.
B:This principle concerns a separate data-engineering condition: Analysts run short SQL dashboard queries against a shared lakehouse but their notebooks share a general-purpose Spark cluster with training experiments. Its targeted response is: Use an appropriately sized SQL warehouse with workload isolation and measured concurrency for dashboard queries. The current case is governed more directly by: Spark and runtime upgrades can change supported APIs, dependency versions and execution behavior.
C:This principle concerns a separate data-engineering condition: A notebook workflow imports a Python package without pinning its version, producing different results after an environment update. Its targeted response is: Record and pin supported package versions in the workload deployment specification and test reproducibility. The current case is governed more directly by: Spark and runtime upgrades can change supported APIs, dependency versions and execution behavior.
Question 57
For this Microsoft DP-750 case: Multiple data products put raw, refined and curated assets into a single schema with confusing table names. Which design or operational response BEST fits?
- Define a consistent schema and naming architecture separating layers and business domains by purpose.
- Select managed or external Unity Catalog table ownership intentionally and verify lifecycle semantics.
- Split catalogs or governance boundaries along residency and ownership requirements and validate workspace bindings.
- Recreate or update supported external table registration using an approved location and correct access controls.
Explanation
Correct Answer
A:The most appropriate action is: Define a consistent schema and naming architecture separating layers and business domains by purpose. It addresses the stated condition: Multiple data products put raw, refined and curated assets into a single schema with confusing table names. The technical basis is: Catalog naming and grouping should communicate lifecycle, owner and trust level for consumers. Without this control, users may query raw unvalidated records as though they were approved curated metrics. A direct acceptance check is: Discovery tests distinguish raw from certified curated objects and owners confirm their assigned namespaces.
Incorrect Answers
B:This alternative primarily addresses a different Azure Databricks problem: A team expects dropping a managed table to preserve all physical data as though it were an external table. The corresponding measure there would be: Select managed or external Unity Catalog table ownership intentionally and verify lifecycle semantics. The stated situation instead calls for: Define a consistent schema and naming architecture separating layers and business domains by purpose.
C:This alternative primarily addresses a different Azure Databricks problem: A platform architect creates one catalog for subsidiaries with incompatible regional data-residency permissions. The corresponding measure there would be: Split catalogs or governance boundaries along residency and ownership requirements and validate workspace bindings. The stated situation instead calls for: Define a consistent schema and naming architecture separating layers and business domains by purpose.
D:This alternative primarily addresses a different Azure Databricks problem: A managed Delta table is migrated to external storage but the team does not update table registration or grant scopes. The corresponding measure there would be: Recreate or update supported external table registration using an approved location and correct access controls. The stated situation instead calls for: Define a consistent schema and naming architecture separating layers and business domains by purpose.
Question 58
The design team proposes: Design a task DAG with parallel independent ingestion and an aggregation dependency after both complete. The situation is: A pipeline uses a single notebook to read four sources sequentially even though two can be processed independently. Which technical principle justifies the decision?
- Notebooks and declarative pipelines serve different orchestration and transformation patterns.
- Job status must accurately reflect failed required operations for alerting and dependency logic.
- Parallelism is safe when tasks have no mutual data dependency and the join point is explicit.
- Retryable transient failures should be distinguished from permanent data or permission errors.
Explanation
Correct Answer
C:The decisive mechanism is: Parallelism is safe when tasks have no mutual data dependency and the join point is explicit. That explains the selected action: Design a task DAG with parallel independent ingestion and an aggregation dependency after both complete. In the original scenario: A pipeline uses a single notebook to read four sources sequentially even though two can be processed independently. The specific unmanaged risk is: Unnecessary serial execution can extend the critical path beyond the freshness target. Validate with: Timing evidence shows independent branches run concurrently and the merge waits for both results.
Incorrect Answers
A:This principle concerns a separate data-engineering condition: An ad hoc machine-learning preparation task has complex custom Python orchestration and no declarative table graph. Its targeted response is: Select a notebook task within Lakeflow Jobs when procedural control and custom libraries fit the requirements. The current case is governed more directly by: Parallelism is safe when tasks have no mutual data dependency and the join point is explicit.
B:This principle concerns a separate data-engineering condition: A workflow uses a notebook task that catches exceptions and returns success even when a write step fails. Its targeted response is: Propagate nonrecoverable exceptions to Lakeflow Jobs and attach actionable error metadata. The current case is governed more directly by: Parallelism is safe when tasks have no mutual data dependency and the join point is explicit.
D:This principle concerns a separate data-engineering condition: A batch enrichment task downloads a remote file and sometimes receives transient HTTP 503 responses. Its targeted response is: Add bounded retries with exponential backoff and observable failure after the retry budget. The current case is governed more directly by: Parallelism is safe when tasks have no mutual data dependency and the join point is explicit.
Question 59
A data engineering team faces this Azure Databricks requirement: A quality report needs one column for each product status category but stores status as separate rows. Which action is MOST appropriate?
- Validate business keys and choose a deterministic latest-enrollment record before aggregation.
- Normalize time zone semantics before extracting business-local reporting dates.
- Apply a controlled pivot with a defined set of expected categories and aggregation rule.
- Align compatible schemas and use name-based union semantics with explicit type checks.
Explanation
Correct Answer
C:The most appropriate action is: Apply a controlled pivot with a defined set of expected categories and aggregation rule. It addresses the stated condition: A quality report needs one column for each product status category but stores status as separate rows. The technical basis is: Pivoting transposes category values into columns but requires stable categories and aggregation semantics. Without this control, unknown statuses may be dropped or duplicated if pivot categories are assumed without validation. A direct acceptance check is: A sample includes all approved categories and status totals reconcile to source rows.
Incorrect Answers
A:This alternative primarily addresses a different Azure Databricks problem: A student dataset uses SQL GROUP BY with unhandled duplicate enrollment rows before reporting course completion. The corresponding measure there would be: Validate business keys and choose a deterministic latest-enrollment record before aggregation. The stated situation instead calls for: Apply a controlled pivot with a defined set of expected categories and aggregation rule.
B:This alternative primarily addresses a different Azure Databricks problem: A date field mixes UTC timestamps and local store times but a pipeline groups all values by the raw date string. The corresponding measure there would be: Normalize time zone semantics before extracting business-local reporting dates. The stated situation instead calls for: Apply a controlled pivot with a defined set of expected categories and aggregation rule.
D:This alternative primarily addresses a different Azure Databricks problem: Two quarterly sales feeds have the same logical fields but different column ordering and a union shifts amounts into dates. The corresponding measure there would be: Align compatible schemas and use name-based union semantics with explicit type checks. The stated situation instead calls for: Apply a controlled pivot with a defined set of expected categories and aggregation rule.
Question 60
An operator introduces: Split catalogs or governance boundaries along residency and ownership requirements and validate workspace bindings. The situation is: A platform architect creates one catalog for subsidiaries with incompatible regional data-residency permissions. Which validation should be required before signoff?
- Approved regional workspaces access their catalogs while a disallowed workspace fails its access test.
- Catalog Explorer shows reviewed descriptions and a sample consumer can identify the column's intended units.
- An architecture test proves the selected object's refresh and query cost meet defined needs.
- A controlled MERGE and SQL query succeed against the governed Delta table with expected records.
Explanation
Correct Answer
A:The strongest acceptance proof is: Approved regional workspaces access their catalogs while a disallowed workspace fails its access test. It specifically verifies: Split catalogs or governance boundaries along residency and ownership requirements and validate workspace bindings. The original issue was: A platform architect creates one catalog for subsidiaries with incompatible regional data-residency permissions. The underlying mechanism is: Catalog separation and workspace access controls can help enforce organizational and geography boundaries. Without it, A broadly shared catalog can expose regulated data to unintended region workspaces.
Incorrect Answers
B:This result would validate a different measure: Maintain table and column descriptions in Unity Catalog metadata at creation and during schema changes. That is relevant to the distinct problem: Analysts create tables without column comments and the data steward cannot explain monetary units or null semantics. Here the acceptance criterion is: Approved regional workspaces access their catalogs while a disallowed workspace fails its access test.
C:This result would validate a different measure: Choose a view, materialized view or stored table based on freshness, cost and refresh responsibilities. That is relevant to the distinct problem: A data pipeline creates a physical table for a reporting transformation that would be better maintained as a query definition. Here the acceptance criterion is: Approved regional workspaces access their catalogs while a disallowed workspace fails its access test.
D:This result would validate a different measure: Register the structured dataset as an appropriate managed Delta table rather than treating the volume itself as a SQL table. That is relevant to the distinct problem: A team exposes structured transaction data as files in a volume but wants SQL analytics and ACID MERGE behavior. Here the acceptance criterion is: Approved regional workspaces access their catalogs while a disallowed workspace fails its access test.