NCA - AI Infrastructure and Operations NCA-AIIO Practice Test 15
Question 140
An organization is evaluating an AI deployment: A recommendation project improves after collecting representative interaction logs but management attributes all gains to GPU upgrades. What solution MOST directly fits the stated need?
- Identify accessible accelerated computation as an enabler of feasible large-scale model training.
- Include interconnect performance among the conditions supporting modern distributed AI training progress.
- Use transfer learning appropriately and validate downstream quality with the domain-specific dataset.
- Evaluate data quantity, label quality and dataset representativeness alongside accelerated hardware improvements.
Explanation
Correct Answer
D:The appropriate response is to evaluate data quantity, label quality and dataset representativeness alongside accelerated hardware improvements. This is specific to the case where a recommendation project improves after collecting representative interaction logs but management attributes all gains to GPU upgrades. The mechanism is that recent AI improvements depend on useful training data as well as computing resources and algorithms. If ignored, hardware purchases may deliver little benefit if the data remain biased or insufficient for the target users. Validate the choice using this targeted evidence: A controlled model comparison isolates the impact of data improvements from compute changes.
Incorrect Answers
A:This alternative addresses a different requirement: A research group trains larger neural networks after acquiring accelerators with much higher parallel throughput. It would be appropriate there to identify accessible accelerated computation as an enabler of feasible large-scale model training. But the present scenario is about a recommendation project improves after collecting representative interaction logs but management attributes all gains to GPU upgrades. For it, the needed control is to evaluate data quantity, label quality and dataset representativeness alongside accelerated hardware improvements.
B:This alternative addresses a different requirement: A multi-node project scales after faster network fabrics reduce the time workers spend synchronizing gradients. It would be appropriate there to include interconnect performance among the conditions supporting modern distributed AI training progress. But the present scenario is about a recommendation project improves after collecting representative interaction logs but management attributes all gains to GPU upgrades. For it, the needed control is to evaluate data quantity, label quality and dataset representativeness alongside accelerated hardware improvements.
C:This alternative addresses a different requirement: An applied AI team starts from an existing pretrained vision model rather than training its representation from random weights. It would be appropriate there to use transfer learning appropriately and validate downstream quality with the domain-specific dataset. But the present scenario is about a recommendation project improves after collecting representative interaction logs but management attributes all gains to GPU upgrades. For it, the needed control is to evaluate data quantity, label quality and dataset representativeness alongside accelerated hardware improvements.
Question 141
A team omits this measure: Include interconnect performance among the conditions supporting modern distributed AI training progress. In this environment: A multi-node project scales after faster network fabrics reduce the time workers spend synchronizing gradients. Which resulting problem is MOST likely?
- Hardware purchases may deliver little benefit if the data remain biased or insufficient for the target users.
- Starting every model from scratch may waste scarce labeled data and long training windows.
- A workload may be described as software-only even when it cannot complete within available CPU time.
- A GPU-only upgrade can fail to improve end-to-end speed when communication remains the bottleneck.
Explanation
Correct Answer
D:The primary exposure is that a GPU-only upgrade can fail to improve end-to-end speed when communication remains the bottleneck. This follows from a multi-node project scales after faster network fabrics reduce the time workers spend synchronizing gradients. where the omitted measure was to include interconnect performance among the conditions supporting modern distributed AI training progress. The technical reason is that distributed learning benefits from improved networking and collective communication in addition to GPU compute. A good operational validation after repair would be: A before-and-after scale test reports collective time and total training throughput under identical workloads.
Incorrect Answers
A:This exposure arises in a different situation: A recommendation project improves after collecting representative interaction logs but management attributes all gains to GPU upgrades. There, the corresponding safeguard is to evaluate data quantity, label quality and dataset representativeness alongside accelerated hardware improvements. In the present case, the more direct risk is that a GPU-only upgrade can fail to improve end-to-end speed when communication remains the bottleneck.
B:This exposure arises in a different situation: An applied AI team starts from an existing pretrained vision model rather than training its representation from random weights. There, the corresponding safeguard is to use transfer learning appropriately and validate downstream quality with the domain-specific dataset. In the present case, the more direct risk is that a GPU-only upgrade can fail to improve end-to-end speed when communication remains the bottleneck.
C:This exposure arises in a different situation: A research group trains larger neural networks after acquiring accelerators with much higher parallel throughput. There, the corresponding safeguard is to identify accessible accelerated computation as an enabler of feasible large-scale model training. In the present case, the more direct risk is that a GPU-only upgrade can fail to improve end-to-end speed when communication remains the bottleneck.
Question 142
The proposed approach is to enforce hypervisor, guest-driver and tenant resource permissions for virtualized accelerated workloads. In the following setting, an organization consolidates multiple AI tenants but has no process to constrain access to virtual GPU devices and images. Which principle BEST supports the approach?
- GPU virtualization requires isolation at management, device allocation and data access layers.
- Virtual GPU technology can expose allocated accelerator capabilities to separate virtual-machine workloads.
- Physical GPU assignment offers a different management and isolation trade-off from shared virtual profiles.
- MIG creates hardware-partitioned accelerator instances on supported GPUs for eligible workloads.
Explanation
Correct Answer
A:The governing principle is that gPU virtualization requires isolation at management, device allocation and data access layers. It supports the measure to enforce hypervisor, guest-driver and tenant resource permissions for virtualized accelerated workloads. because an organization consolidates multiple AI tenants but has no process to constrain access to virtual GPU devices and images. Without the control, a misconfigured guest may gain access to shared device resources or another tenant's data. The most useful acceptance evidence is: An unauthorized guest test cannot view unassigned device resources or protected host management endpoints.
Incorrect Answers
B:That principle is relevant to this distinct case: A virtual-desktop deployment requires accelerated graphics for several isolated users on shared server GPUs. The associated response would be to evaluate supported NVIDIA vGPU capabilities, profiles and licensing against the application requirements. It does not describe the central reason for this case, which is that gPU virtualization requires isolation at management, device allocation and data access layers.
C:That principle is relevant to this distinct case: A low-latency training appliance requires direct use of a physical GPU, but the deployment plan inserts an unsuitable shared virtual layer. The associated response would be to evaluate GPU passthrough or supported direct assignment where workload performance and management justify it. It does not describe the central reason for this case, which is that gPU virtualization requires isolation at management, device allocation and data access layers.
D:That principle is relevant to this distinct case: A trusted internal platform needs to run several smaller inference services on one MIG-capable GPU with reserved resources for each workload. The associated response would be to assess GPU Multi-Instance GPU partitions on supported hardware with compatible workload sizes. It does not describe the central reason for this case, which is that gPU virtualization requires isolation at management, device allocation and data access layers.
Question 143
A team omits this measure: Version preprocessing and feature transformations with the model and verify training-serving parity. In this environment: A feature-extraction job produces different input scales in training and the live inference service. Which resulting problem is MOST likely?
- A valid model can give unreliable predictions when live inputs are normalized differently.
- An incident team may deploy untested weights or lose the ability to reproduce a past prediction.
- Silent drift can degrade decisions while system CPU and GPU health still look normal.
- An apparent accuracy improvement cannot be attributed or recreated for production approval.
Explanation
Correct Answer
A:The primary exposure is that a valid model can give unreliable predictions when live inputs are normalized differently. This follows from a feature-extraction job produces different input scales in training and the live inference service. where the omitted measure was to version preprocessing and feature transformations with the model and verify training-serving parity. The technical reason is that feature processing must be consistent across training and deployment to preserve model behavior. A good operational validation after repair would be: The same raw sample produces matching feature vectors in both the training and inference pipelines.
Incorrect Answers
B:This exposure arises in a different situation: Operations cannot determine which trained model is running in each deployment because artifacts are overwritten under one label. There, the corresponding safeguard is to register immutable model versions with provenance, evaluation results and approved release transitions. In the present case, the more direct risk is that a valid model can give unreliable predictions when live inputs are normalized differently.
C:This exposure arises in a different situation: A demand-forecasting model loses accuracy months after deployment as user behavior changes. There, the corresponding safeguard is to monitor production data distribution, predictive performance and drift with assigned retraining triggers. In the present case, the more direct risk is that a valid model can give unreliable predictions when live inputs are normalized differently.
D:This exposure arises in a different situation: Research experiments change learning rates and seeds without recording configuration or resulting checkpoints. There, the corresponding safeguard is to track hyperparameters, dataset versions, random seeds and artifacts in an experiment registry. In the present case, the more direct risk is that a valid model can give unreliable predictions when live inputs are normalized differently.
Question 144
An organization is evaluating an AI deployment: Facilities schedules maintenance to an air-handling unit while operations keeps every GPU rack at full demand. What solution MOST directly fits the stated need?
- Calculate worst-case electrical demand and verify PDU, branch-circuit and feed ratings with facilities staff.
- Validate truly independent power paths and loss-of-feed operation with qualified facility engineers.
- Validate rack heat rejection and cooling solution against documented maximum system power.
- Coordinate workload reduction and protected shutdown windows against available cooling redundancy.
Explanation
Correct Answer
D:The appropriate response is to coordinate workload reduction and protected shutdown windows against available cooling redundancy. This is specific to the case where facilities schedules maintenance to an air-handling unit while operations keeps every GPU rack at full demand. The mechanism is that data-center maintenance planning must account for the coupling between compute load and cooling availability. If ignored, loss of cooling under peak GPU load can produce widespread thermal alarms and abrupt job termination. Validate the choice using this targeted evidence: An approved maintenance rehearsal holds measured rack temperatures within safe limits during reduced cooling.
Incorrect Answers
A:This alternative addresses a different requirement: A proposed rack contains high-density GPU servers but its power distribution units cannot deliver full simultaneous load. It would be appropriate there to calculate worst-case electrical demand and verify PDU, branch-circuit and feed ratings with facilities staff. But the present scenario is about facilities schedules maintenance to an air-handling unit while operations keeps every GPU rack at full demand. For it, the needed control is to coordinate workload reduction and protected shutdown windows against available cooling redundancy.
B:This alternative addresses a different requirement: A cluster uses redundant electrical feeds but both power cables are plugged into the same unprotected PDU. It would be appropriate there to validate truly independent power paths and loss-of-feed operation with qualified facility engineers. But the present scenario is about facilities schedules maintenance to an air-handling unit while operations keeps every GPU rack at full demand. For it, the needed control is to coordinate workload reduction and protected shutdown windows against available cooling redundancy.
C:This alternative addresses a different requirement: An existing server room can cool ordinary web racks but a planned accelerated rack doubles local heat density. It would be appropriate there to validate rack heat rejection and cooling solution against documented maximum system power. But the present scenario is about facilities schedules maintenance to an air-handling unit while operations keeps every GPU rack at full demand. For it, the needed control is to coordinate workload reduction and protected shutdown windows against available cooling redundancy.
Question 145
An architecture review proposes: Monitor supported BlueField interfaces, service state and relevant packet or error counters. The underlying requirement is: A cluster sees intermittent network errors but its DPU ports and offload services are missing from health dashboards. What technical rationale MOST strongly supports it?
- DPU deployment adds operational elements that need observability alongside GPU and host status.
- DPU lifecycle operations introduce their own software, security and maintenance responsibilities.
- DPUs can execute selected infrastructure functions on dedicated resources, reducing host CPU contention.
- Dedicated infrastructure processing can separate selected network and security duties from general host code.
Explanation
Correct Answer
A:The governing principle is that dPU deployment adds operational elements that need observability alongside GPU and host status. It supports the measure to monitor supported BlueField interfaces, service state and relevant packet or error counters. because a cluster sees intermittent network errors but its DPU ports and offload services are missing from health dashboards. Without the control, invisible offload failures may be mistaken for model or GPU faults and prolong repair. The most useful acceptance evidence is: An injected supported offload fault is localized to the DPU service or interface in cluster telemetry.
Incorrect Answers
B:That principle is relevant to this distinct case: An administrator configures BlueField networking without documenting ownership of DPU software and firmware updates. The associated response would be to define supported DPU management, update and rollback procedures separate from host OS changes. It does not describe the central reason for this case, which is that dPU deployment adds operational elements that need observability alongside GPU and host status.
C:That principle is relevant to this distinct case: A busy accelerated server spends significant host CPU cycles processing storage and network control tasks. The associated response would be to assess supported DPU offload for suitable networking and storage functions and measure actual net benefit. It does not describe the central reason for this case, which is that dPU deployment adds operational elements that need observability alongside GPU and host status.
D:That principle is relevant to this distinct case: A security architect wants infrastructure service isolation from host applications that may be compromised. The associated response would be to evaluate BlueField DPU-supported trusted infrastructure processing and its administrative trust boundaries. It does not describe the central reason for this case, which is that dPU deployment adds operational elements that need observability alongside GPU and host status.
Question 146
The following safeguard was deployed: Evaluate supported adaptive or congestion-aware routing behavior against application traffic distribution. What operational observation would demonstrate its success?
- An approved Ethernet pilot shows stable throughput and congestion metrics under all-to-all traffic.
- A failure-domain diagram and multi-rack load test confirm acceptable path diversity and throughput.
- A path-aware test demonstrates traffic redistribution and reduced worst-case communication delay.
- Topology mapping confirms intra-node tensors use the expected high-bandwidth GPU interconnect.
Explanation
Correct Answer
C:The strongest proof is: A path-aware test demonstrates traffic redistribution and reduced worst-case communication delay. It directly tests the safeguard to evaluate supported adaptive or congestion-aware routing behavior against application traffic distribution. The control addresses this specific context: A large network shows uneven path utilization during all-to-all traffic despite ample aggregate switch capacity. It matters because network routing and load distribution influence collective tail latency as much as raw line rate. Without it, hot paths can saturate while alternate available links are underused.
Incorrect Answers
A:This observation would validate a different control: Assess a tuned high-speed Ethernet or RoCE solution rather than assuming ordinary LAN defaults are enough. It fits the case where a cloud provider standardizes on Ethernet switching but wants accelerated AI traffic over the existing operational model. It cannot prove success here; instead the required evidence is a path-aware test demonstrates traffic redistribution and reduced worst-case communication delay.
B:This observation would validate a different control: Design an appropriate resilient leaf-spine topology and validate required bisection bandwidth. It fits the case where a data center expands the number of training racks but relies on a single aggregation switch for every east-west transfer. It cannot prove success here; instead the required evidence is a path-aware test demonstrates traffic redistribution and reduced worst-case communication delay.
D:This observation would validate a different control: Use supported NVLink or NVSwitch paths for local GPU exchange rather than assuming every copy crosses Ethernet. It fits the case where a scale-up system exchanges large tensors between GPUs inside one chassis and compares that traffic with rack networking. It cannot prove success here; instead the required evidence is a path-aware test demonstrates traffic redistribution and reduced worst-case communication delay.
Question 147
A GPU operations plan calls for: Evaluate TensorRT optimization and supported precision profiles for the deployed inference model and hardware. The reason is that a model trained in PyTorch produces slow serving latency when deployed unchanged as a general-purpose Python process. Which principle is MOST relevant?
- GPU data-processing libraries can accelerate suitable parallel transformations without redefining the analytical objective.
- The NGC catalog helps distribute optimized AI software artifacts with documented versions and dependencies.
- TensorRT targets optimized inference execution through graph and kernel transformations on supported accelerators.
- Containerized AI requires both host accelerator support and an authorized device exposure path to workloads.
Explanation
Correct Answer
C:The governing principle is that tensorRT targets optimized inference execution through graph and kernel transformations on supported accelerators. It supports the measure to evaluate TensorRT optimization and supported precision profiles for the deployed inference model and hardware. because a model trained in PyTorch produces slow serving latency when deployed unchanged as a general-purpose Python process. Without the control, the service may miss latency and throughput targets even when model accuracy remains acceptable in offline tests. The most useful acceptance evidence is: An accuracy-checked optimized engine meets the specified p95 latency at representative request concurrency.
Incorrect Answers
A:That principle is relevant to this distinct case: An analytics department runs large tabular transformations on CPUs while its GPUs remain idle between training jobs. The associated response would be to assess RAPIDS GPU-accelerated data processing where the data format and operators are compatible. It does not describe the central reason for this case, which is that tensorRT targets optimized inference execution through graph and kernel transformations on supported accelerators.
B:That principle is relevant to this distinct case: Data scientists repeatedly download unverified deep-learning container images from personal registries before sharing GPU nodes. The associated response would be to use vetted NGC catalog images and pin approved container versions with tested driver compatibility. It does not describe the central reason for this case, which is that tensorRT targets optimized inference execution through graph and kernel transformations on supported accelerators.
D:That principle is relevant to this distinct case: A cluster project treats a container runtime as sufficient to expose GPUs without installing drivers or configuring GPU access. The associated response would be to install compatible NVIDIA drivers and container runtime integration, then validate device visibility inside containers. It does not describe the central reason for this case, which is that tensorRT targets optimized inference execution through graph and kernel transformations on supported accelerators.
Question 148
Consider this NVIDIA AI infrastructure scenario: A data center expands the number of training racks but relies on a single aggregation switch for every east-west transfer. Which design choice should be made FIRST?
- Design an appropriate resilient leaf-spine topology and validate required bisection bandwidth.
- Evaluate supported adaptive or congestion-aware routing behavior against application traffic distribution.
- Select supported optics, fiber media and loss budgets for the required data-center link distances.
- Assess a tuned high-speed Ethernet or RoCE solution rather than assuming ordinary LAN defaults are enough.
Explanation
Correct Answer
A:The appropriate response is to design an appropriate resilient leaf-spine topology and validate required bisection bandwidth. This is specific to the case where a data center expands the number of training racks but relies on a single aggregation switch for every east-west transfer. The mechanism is that a scalable high-speed fabric requires multiple robust paths and sufficient aggregation capacity. If ignored, one shared aggregation failure or bottleneck can disrupt many GPU training jobs. Validate the choice using this targeted evidence: A failure-domain diagram and multi-rack load test confirm acceptable path diversity and throughput.
Incorrect Answers
B:This alternative addresses a different requirement: A large network shows uneven path utilization during all-to-all traffic despite ample aggregate switch capacity. It would be appropriate there to evaluate supported adaptive or congestion-aware routing behavior against application traffic distribution. But the present scenario is about a data center expands the number of training racks but relies on a single aggregation switch for every east-west transfer. For it, the needed control is to design an appropriate resilient leaf-spine topology and validate required bisection bandwidth.
C:This alternative addresses a different requirement: A planned GPU cluster spans distant data halls but its optical cabling design ignores reach and transceiver compatibility. It would be appropriate there to select supported optics, fiber media and loss budgets for the required data-center link distances. But the present scenario is about a data center expands the number of training racks but relies on a single aggregation switch for every east-west transfer. For it, the needed control is to design an appropriate resilient leaf-spine topology and validate required bisection bandwidth.
D:This alternative addresses a different requirement: A cloud provider standardizes on Ethernet switching but wants accelerated AI traffic over the existing operational model. It would be appropriate there to assess a tuned high-speed Ethernet or RoCE solution rather than assuming ordinary LAN defaults are enough. But the present scenario is about a data center expands the number of training racks but relies on a single aggregation switch for every east-west transfer. For it, the needed control is to design an appropriate resilient leaf-spine topology and validate required bisection bandwidth.
Question 149
Consider this NVIDIA AI infrastructure scenario: A GPU cluster has healthy operating-system pings but the platform team cannot see accelerator or board-level fault events. Which design choice should be made FIRST?
- Create an owned incident workflow with timeline, affected device identity, evidence and escalation rules.
- Enforce maintenance windows with scheduler drain, workload notice and readiness verification.
- Integrate supported BMC and accelerator telemetry into the central monitoring and incident workflow.
- Use governed change records, dependency checks and validated rollback procedures for cluster-wide updates.
Explanation
Correct Answer
C:The appropriate response is to integrate supported BMC and accelerator telemetry into the central monitoring and incident workflow. This is specific to the case where a GPU cluster has healthy operating-system pings but the platform team cannot see accelerator or board-level fault events. The mechanism is that node availability cannot be inferred from network reachability alone when hardware components can degrade independently. If ignored, accelerator jobs may fail repeatedly without a monitored hardware alert or assigned repair action. Validate the choice using this targeted evidence: An authorized simulated hardware-health event identifies the affected node and reaches the correct on-call owner.
Incorrect Answers
A:This alternative addresses a different requirement: A node reports intermittent GPU failures but operators simply restart the job without recording the incident context. It would be appropriate there to create an owned incident workflow with timeline, affected device identity, evidence and escalation rules. But the present scenario is about a GPU cluster has healthy operating-system pings but the platform team cannot see accelerator or board-level fault events. For it, the needed control is to integrate supported BMC and accelerator telemetry into the central monitoring and incident workflow.
B:This alternative addresses a different requirement: Technicians take shared GPU nodes offline during business hours without coordinating active checkpointing jobs. It would be appropriate there to enforce maintenance windows with scheduler drain, workload notice and readiness verification. But the present scenario is about a GPU cluster has healthy operating-system pings but the platform team cannot see accelerator or board-level fault events. For it, the needed control is to integrate supported BMC and accelerator telemetry into the central monitoring and incident workflow.
D:This alternative addresses a different requirement: A team changes cluster networking and driver versions on the same day without an approval window or recovery plan. It would be appropriate there to use governed change records, dependency checks and validated rollback procedures for cluster-wide updates. But the present scenario is about a GPU cluster has healthy operating-system pings but the platform team cannot see accelerator or board-level fault events. For it, the needed control is to integrate supported BMC and accelerator telemetry into the central monitoring and incident workflow.
Question 150
A GPU operations plan calls for: Assess electrical redundancy, UPS autonomy and generator integration against the site's availability objective. The reason is that a GPU hall relies on one unprotected utility feed although the business requires continued operation through feed faults. Which principle is MOST relevant?
- Facility availability depends on the complete power chain, not only server dual power supplies.
- Facility monitoring should detect environmental conditions that threaten accelerated equipment operation.
- Rack placement requires verifying physical building capacity rather than relying on electrical diagrams alone.
- Fire detection and safety systems must be planned alongside accelerator and cooling deployment.
Explanation
Correct Answer
A:The governing principle is that facility availability depends on the complete power chain, not only server dual power supplies. It supports the measure to assess electrical redundancy, UPS autonomy and generator integration against the site's availability objective. because a GPU hall relies on one unprotected utility feed although the business requires continued operation through feed faults. Without the control, a short upstream feed interruption can stop every accelerator node in the hall. The most useful acceptance evidence is: A qualified power-chain review maps independent paths and documented recovery actions for feed loss.
Incorrect Answers
B:That principle is relevant to this distinct case: A new AI room has reliable cooling capacity but no monitoring for localized humidity or leak alarms. The associated response would be to add appropriate environmental sensors and integrate alerts with owned operational response procedures. It does not describe the central reason for this case, which is that facility availability depends on the complete power chain, not only server dual power supplies.
C:That principle is relevant to this distinct case: A facility plans high-density GPU racks on an upper floor without confirming structural load limits. The associated response would be to obtain qualified structural review of populated rack weight and floor-loading constraints. It does not describe the central reason for this case, which is that facility availability depends on the complete power chain, not only server dual power supplies.
D:That principle is relevant to this distinct case: Facility operations adds high-density racks without reviewing fire detection and emergency shutoff responsibilities. The associated response would be to validate approved facility life-safety procedures and equipment integration with qualified engineers. It does not describe the central reason for this case, which is that facility availability depends on the complete power chain, not only server dual power supplies.