AWS Certified AI Practitioner AIF-C01 Practice Test 38
Question 370
A model offers high accuracy but opaque reasons for high-stakes decisions. A pilot uses this approach instead: Choose highest accuracy without assessing auditability. Which limitation MOST DIRECTLY explains why the requirement is not met?
- Interpretability alone does not guarantee acceptable outcomes
- Opaque gains may not justify lost explainability in regulated decisions
- Adoption counts do not measure explainability or model reliability
- Pure accuracy can fail explanation obligations
Explanation
Correct Answer
D:This is the actual failure mode of the proposed approach: Choose highest accuracy without assessing auditability. Pure accuracy can fail explanation obligations
Incorrect Answers
A:This limitation concerns Choose the simplest model regardless of accuracy or safety; it does not diagnose the proposed Choose highest accuracy without assessing auditability approach.
B:Opaque gains may not justify lost explainability in regulated decisions This explains the recommended design, but it is not the requested diagnosis of Choose highest accuracy without assessing auditability.
C:This limitation concerns Use model popularity as the risk-adjusted decision; it does not diagnose the proposed Choose highest accuracy without assessing auditability approach.
Question 371
A credit-screening model performs well overall but misses qualified applicants in one protected group. Which option BEST meets the business requirement?
- Remove demographic evaluation fields before measuring disparities
- Evaluate false-negative rates and outcomes separately by relevant subgroup
- Judge fairness solely by model parameter count
- Use overall accuracy as the only fairness measure
Explanation
Correct Answer
B:Aggregate metrics can hide disparities across populations The specified scenario makes this the most appropriate approach.
Incorrect Answers
A:Without appropriate controlled subgroup information the disparity may remain hidden This prevents the approach from meeting the stated requirement.
C:Size does not measure differential impact This prevents the approach from meeting the stated requirement.
D:A high average score can coexist with harmful group-level errors This prevents the approach from meeting the stated requirement.
Question 372
A GenAI assistant must avoid repeating social security numbers found in user-provided text. A pilot uses this approach instead: Rely only on a natural-language request to keep secrets. Which limitation MOST DIRECTLY explains why the requirement is not met?
- A polite request is not enforceable protection
- Sensitive data handling needs explicit controls rather than model goodwill
- Unnecessary prompt logging can increase exposure
- Sampling does not reliably prevent information disclosure
Explanation
Correct Answer
A:This is the actual failure mode of the proposed approach: Rely only on a natural-language request to keep secrets. A polite request is not enforceable protection
Incorrect Answers
B:Sensitive data handling needs explicit controls rather than model goodwill This explains the recommended design, but it is not the requested diagnosis of Rely only on a natural-language request to keep secrets.
C:This limitation concerns Use public CloudTrail events as a repository for raw sensitive prompts; it does not diagnose the proposed Rely only on a natural-language request to keep secrets approach.
D:This limitation concerns Increase model temperature so identifiers become random; it does not diagnose the proposed Rely only on a natural-language request to keep secrets approach.
Question 373
An insurer already using SageMaker Clarify needs feature-level explanations of an existing tabular risk model. After selecting the recommended approach, which evidence MOST DIRECTLY demonstrates that the actual required outcome has been achieved?
- A reviewed design record approves this competing approach: Use S3 object version IDs as causal model explanations
- A system inventory lists this competing approach as active: Use CloudTrail API logs as model-feature explanations
- Analysts inspect attribution reports and compare them with known model behavior
- A component test invokes this alternate approach successfully: Use KMS encryption keys as explanations
Explanation
Correct Answer
C:Analysts inspect attribution reports and compare them with known model behavior. This checks the business result rather than just a configured feature.
Incorrect Answers
A:Object versions do not explain predicted scores Design approval is not evidence that the alternative meets the actual requirement.
B:Activity logs do not calculate feature attribution An active setting cannot independently prove the requested business outcome.
D:Encryption manages key protection rather than attribution A component invocation does not validate the necessary end-to-end outcome.
Question 374
A model offers high accuracy but opaque reasons for high-stakes decisions. Which option BEST meets the business requirement?
- Use model popularity as the risk-adjusted decision
- Evaluate accuracy against interpretability and application risk before selection
- Choose the simplest model regardless of accuracy or safety
- Choose highest accuracy without assessing auditability
Explanation
Correct Answer
B:Opaque gains may not justify lost explainability in regulated decisions The specified scenario makes this the most appropriate approach.
Incorrect Answers
A:Adoption counts do not measure explainability or model reliability This prevents the approach from meeting the stated requirement.
C:Interpretability alone does not guarantee acceptable outcomes This prevents the approach from meeting the stated requirement.
D:Pure accuracy can fail explanation obligations This prevents the approach from meeting the stated requirement.
Question 375
A customer-facing medical information assistant may invent unsafe dosage recommendations. During a design review, someone proposes Disable all source links and let the model reason unaudited. Which technical objection is specifically relevant to this proposal?
- High-stakes unsupported medical claims need source checking and human control
- Model confidence cannot establish medical safety
- Removing provenance increases the chance of undetected errors
- Longer advice is not clinical validation
Explanation
Correct Answer
C:This is the actual failure mode of the proposed approach: Disable all source links and let the model reason unaudited. Removing provenance increases the chance of undetected errors
Incorrect Answers
A:High-stakes unsupported medical claims need source checking and human control This explains the recommended design, but it is not the requested diagnosis of Disable all source links and let the model reason unaudited.
B:This limitation concerns Treat any confident generated dosage as approved clinical guidance; it does not diagnose the proposed Disable all source links and let the model reason unaudited approach.
D:This limitation concerns Increase completion length to improve medical authority; it does not diagnose the proposed Disable all source links and let the model reason unaudited approach.
Question 376
A high-impact customer eligibility model has borderline cases needing a human decision. During a design review, someone proposes Treat a guardrail toxicity filter as the final eligibility reviewer. Which technical objection is specifically relevant to this proposal?
- Faster inference is not evidence of acceptable decision risk
- Confidence alone may not meet policy for sensitive outcomes
- Toxicity filtering does not replace human eligibility judgment
- Reviewers can inspect uncertain outputs before critical action
Explanation
Correct Answer
C:This is the actual failure mode of the proposed approach: Treat a guardrail toxicity filter as the final eligibility reviewer. Toxicity filtering does not replace human eligibility judgment
Incorrect Answers
A:This limitation concerns Use lower latency as proof that human review is unnecessary; it does not diagnose the proposed Treat a guardrail toxicity filter as the final eligibility reviewer approach.
B:This limitation concerns Automatically approve every high-confidence output without defined controls; it does not diagnose the proposed Treat a guardrail toxicity filter as the final eligibility reviewer approach.
D:Reviewers can inspect uncertain outputs before critical action This explains the recommended design, but it is not the requested diagnosis of Treat a guardrail toxicity filter as the final eligibility reviewer.
Question 377
An insurer already using SageMaker Clarify needs feature-level explanations of an existing tabular risk model. During a design review, someone proposes Use KMS encryption keys as explanations. Which technical objection is specifically relevant to this proposal?
- Object versions do not explain predicted scores
- Activity logs do not calculate feature attribution
- Encryption manages key protection rather than attribution
- Clarify supports attribution and bias analysis for supported models
Explanation
Correct Answer
C:This is the actual failure mode of the proposed approach: Use KMS encryption keys as explanations. Encryption manages key protection rather than attribution
Incorrect Answers
A:This limitation concerns Use S3 object version IDs as causal model explanations; it does not diagnose the proposed Use KMS encryption keys as explanations approach.
B:This limitation concerns Use CloudTrail API logs as model-feature explanations; it does not diagnose the proposed Use KMS encryption keys as explanations approach.
D:Clarify supports attribution and bias analysis for supported models This explains the recommended design, but it is not the requested diagnosis of Use KMS encryption keys as explanations.
Question 378
A firm must disclose that customers are interacting with AI and provide escalation. During a design review, someone proposes Use only automated satisfaction guesses without user recourse. Which technical objection is specifically relevant to this proposal?
- Deception removes user choice and feedback
- Human-centered design supports informed use and correction of mistakes
- No contest or escalation path weakens trust
- Predicted sentiment does not let users contest outcomes
Explanation
Correct Answer
D:This is the actual failure mode of the proposed approach: Use only automated satisfaction guesses without user recourse. Predicted sentiment does not let users contest outcomes
Incorrect Answers
A:This limitation concerns Hide the model identity to make replies seem human; it does not diagnose the proposed Use only automated satisfaction guesses without user recourse approach.
B:Human-centered design supports informed use and correction of mistakes This explains the recommended design, but it is not the requested diagnosis of Use only automated satisfaction guesses without user recourse.
C:This limitation concerns Require users to accept all outputs without correction; it does not diagnose the proposed Use only automated satisfaction guesses without user recourse approach.
Question 379
A credit-screening model performs well overall but misses qualified applicants in one protected group. A pilot uses this approach instead: Use overall accuracy as the only fairness measure. Which limitation MOST DIRECTLY explains why the requirement is not met?
- Size does not measure differential impact
- A high average score can coexist with harmful group-level errors
- Without appropriate controlled subgroup information the disparity may remain hidden
- Aggregate metrics can hide disparities across populations
Explanation
Correct Answer
B:This is the actual failure mode of the proposed approach: Use overall accuracy as the only fairness measure. A high average score can coexist with harmful group-level errors
Incorrect Answers
A:This limitation concerns Judge fairness solely by model parameter count; it does not diagnose the proposed Use overall accuracy as the only fairness measure approach.
C:This limitation concerns Remove demographic evaluation fields before measuring disparities; it does not diagnose the proposed Use overall accuracy as the only fairness measure approach.
D:Aggregate metrics can hide disparities across populations This explains the recommended design, but it is not the requested diagnosis of Use overall accuracy as the only fairness measure.
Question 380
A customer-facing medical information assistant may invent unsafe dosage recommendations. Which option BEST meets the business requirement?
- Increase completion length to improve medical authority
- Ground answers in approved references and require safety and clinical escalation rules
- Treat any confident generated dosage as approved clinical guidance
- Disable all source links and let the model reason unaudited
Explanation
Correct Answer
B:High-stakes unsupported medical claims need source checking and human control The specified scenario makes this the most appropriate approach.
Incorrect Answers
A:Longer advice is not clinical validation This prevents the approach from meeting the stated requirement.
C:Model confidence cannot establish medical safety This prevents the approach from meeting the stated requirement.
D:Removing provenance increases the chance of undetected errors This prevents the approach from meeting the stated requirement.