AWS Certified AI Practitioner AIF-C01 Practice Test 36
Question 350
An evaluation team wants scalable subjective feedback on FM answers before human sampling. During a design review, someone proposes Use the price per token as the sole quality score. Which technical objection is specifically relevant to this proposal?
- Cost does not judge whether the response is correct
- Self-reported confidence may be poorly calibrated
- A judging model can scale rubric-based scoring but may have systematic bias
- Automated judges can be biased and should be calibrated
Explanation
Correct Answer
A:This is the actual failure mode of the proposed approach: Use the price per token as the sole quality score. Cost does not judge whether the response is correct
Incorrect Answers
B:This limitation concerns Use only the model's confidence in its own answer; it does not diagnose the proposed Use the price per token as the sole quality score approach.
C:A judging model can scale rubric-based scoring but may have systematic bias This explains the recommended design, but it is not the requested diagnosis of Use the price per token as the sole quality score.
D:This limitation concerns Treat judge outputs as infallible ground truth; it does not diagnose the proposed Use the price per token as the sole quality score approach.
Question 351
A firm wants to adapt a pretrained FM to sector-specific instructions without training it from scratch. After selecting the recommended approach, which evidence MOST DIRECTLY demonstrates that the actual required outcome has been achieved?
- A reviewed design record approves this competing approach: Only increase prompt token allowance as the training step
- Holdout prompts show the adapted task behavior without major general capability loss
- A system inventory lists this competing approach as active: Pretrain an entirely new large model for a small style adjustment
- A component test invokes this alternate approach successfully: Assume adding a new API Gateway route changes the model weights
Explanation
Correct Answer
B:Holdout prompts show the adapted task behavior without major general capability loss. This checks the business result rather than just a configured feature.
Incorrect Answers
A:A quota increase is not a model adaptation run Design approval is not evidence that the alternative meets the actual requirement.
C:Full pretraining demands much greater data and compute An active setting cannot independently prove the requested business outcome.
D:Routing infrastructure does not fine-tune model parameters A component invocation does not validate the necessary end-to-end outcome.
Question 352
A multi-step support agent appears fluent but regularly fails to complete the requested customer workflow. During a design review, someone proposes Measure retrieval relevance without tracking whether actions finished. Which technical objection is specifically relevant to this proposal?
- Longer responses can mask unfinished work
- Agent value depends on actual workflow outcomes, not only attractive prose
- Retrieval quality alone is not end-to-end task success
- Tool availability is not successful authorized execution
Explanation
Correct Answer
C:This is the actual failure mode of the proposed approach: Measure retrieval relevance without tracking whether actions finished. Retrieval quality alone is not end-to-end task success
Incorrect Answers
A:This limitation concerns Score only conversational word count; it does not diagnose the proposed Measure retrieval relevance without tracking whether actions finished approach.
B:Agent value depends on actual workflow outcomes, not only attractive prose This explains the recommended design, but it is not the requested diagnosis of Measure retrieval relevance without tracking whether actions finished.
D:This limitation concerns Treat configured tools as proof every action executed; it does not diagnose the proposed Measure retrieval relevance without tracking whether actions finished approach.
Question 353
A document search app needs managed search across embedding vectors generated from product descriptions. A pilot uses this approach instead: Put only prose in CloudTrail audit logs for semantic lookup. Which limitation MOST DIRECTLY explains why the requirement is not met?
- Audit logs are not designed as the search similarity index
- Resource-configuration history is not a vector similarity engine
- Encryption key storage cannot evaluate nearest-neighbor queries
- Vector search supports similarity-based candidate retrieval
Explanation
Correct Answer
A:This is the actual failure mode of the proposed approach: Put only prose in CloudTrail audit logs for semantic lookup. Audit logs are not designed as the search similarity index
Incorrect Answers
B:This limitation concerns Use AWS Config compliance timelines as a vector store; it does not diagnose the proposed Put only prose in CloudTrail audit logs for semantic lookup approach.
C:This limitation concerns Use KMS keys as the embedding database; it does not diagnose the proposed Put only prose in CloudTrail audit logs for semantic lookup approach.
D:Vector search supports similarity-based candidate retrieval This explains the recommended design, but it is not the requested diagnosis of Put only prose in CloudTrail audit logs for semantic lookup.
Question 354
A contract model must infer the desired classification format from several labeled examples supplied in a prompt. Before approving a rollout, an architect suggests Replace examples with a larger token billing limit. Which mismatch should be documented for this precise design?
- Unrelated demonstrations may confuse the mapping
- Few-shot examples illustrate how to map new inputs to target outputs
- Billing settings do not provide task examples
- No demonstrations makes it zero-shot
Explanation
Correct Answer
C:This is the actual failure mode of the proposed approach: Replace examples with a larger token billing limit. Billing settings do not provide task examples
Incorrect Answers
A:This limitation concerns Use a random list of unrelated paragraphs as examples; it does not diagnose the proposed Replace examples with a larger token billing limit approach.
B:Few-shot examples illustrate how to map new inputs to target outputs This explains the recommended design, but it is not the requested diagnosis of Replace examples with a larger token billing limit.
D:This limitation concerns Call a prompt with no examples few-shot; it does not diagnose the proposed Replace examples with a larger token billing limit approach.
Question 355
A specialized science assistant requires substantial domain-language familiarity absent from generic pretraining. During a design review, someone proposes Treat a new user interface as domain adaptation. Which technical objection is specifically relevant to this proposal?
- Presentation changes do not alter model language knowledge
- Further training on domain corpora can adapt foundational representations
- RAG helps facts but may not substitute for deep domain adaptation
- Caching reused prefixes does not train model weights
Explanation
Correct Answer
A:This is the actual failure mode of the proposed approach: Treat a new user interface as domain adaptation. Presentation changes do not alter model language knowledge
Incorrect Answers
B:Further training on domain corpora can adapt foundational representations This explains the recommended design, but it is not the requested diagnosis of Treat a new user interface as domain adaptation.
C:This limitation concerns Assume retrieval alone always yields the desired base domain language behavior; it does not diagnose the proposed Treat a new user interface as domain adaptation approach.
D:This limitation concerns Use prompt caching as the only way to teach unfamiliar specialized language; it does not diagnose the proposed Treat a new user interface as domain adaptation approach.
Question 356
A translation model's output must be compared to reference translations. After selecting the recommended approach, which evidence MOST DIRECTLY demonstrates that the actual required outcome has been achieved?
- A component test invokes this alternate approach successfully: Use only model parameter count to score translations
- A reviewed design record approves this competing approach: Treat request throughput as semantic translation accuracy
- BLEU trends and bilingual human review agree on acceptable meaning preservation
- A system inventory lists this competing approach as active: Use a fraud confusion matrix as the translation-quality metric
Explanation
Correct Answer
C:BLEU trends and bilingual human review agree on acceptable meaning preservation. This checks the business result rather than just a configured feature.
Incorrect Answers
A:Size does not establish reference translation match A component invocation does not validate the necessary end-to-end outcome.
B:Speed is not fidelity of meaning Design approval is not evidence that the alternative meets the actual requirement.
D:Binary classification counts do not compare translated sentences An active setting cannot independently prove the requested business outcome.
Question 357
A healthcare team is curating fine-tuning examples and many contain sensitive patient identifiers. After selecting the recommended approach, which evidence MOST DIRECTLY demonstrates that the actual required outcome has been achieved?
- Training dataset samples pass privacy and provenance review before fitting
- A component test invokes this alternate approach successfully: Treat the model's hidden parameters as proof no patient data can leak
- A system inventory lists this competing approach as active: Use every raw patient record without consent assessment
- A reviewed design record approves this competing approach: Assume file encryption alone establishes the right to use all medical records
Explanation
Correct Answer
A:Training dataset samples pass privacy and provenance review before fitting. This checks the business result rather than just a configured feature.
Incorrect Answers
B:Weights do not by themselves guarantee training privacy A component invocation does not validate the necessary end-to-end outcome.
C:Unvetted sensitive training data creates privacy and compliance risks An active setting cannot independently prove the requested business outcome.
D:Encryption does not replace lawful data-use authorization Design approval is not evidence that the alternative meets the actual requirement.
Question 358
A team repeatedly edits instructions used by three Bedrock applications and needs a common revision history. After selecting the recommended approach, which evidence MOST DIRECTLY demonstrates that the actual required outcome has been achieved?
- A component test invokes this alternate approach successfully: Change model temperature to create an audit history
- The approved prompt version can be identified and tested across applications
- A system inventory lists this competing approach as active: Store only untracked text snippets in personal chat histories
- A reviewed design record approves this competing approach: Write prompts into CloudTrail as the only prompt-template system
Explanation
Correct Answer
B:The approved prompt version can be identified and tested across applications. This checks the business result rather than just a configured feature.
Incorrect Answers
A:Sampling settings do not track who approved a prompt A component invocation does not validate the necessary end-to-end outcome.
C:Ad hoc prompts lack shared version governance An active setting cannot independently prove the requested business outcome.
D:Audit logs record API activities rather than manage reusable prompts Design approval is not evidence that the alternative meets the actual requirement.
Question 359
An image model should avoid including brand logos in generated artwork. During a design review, someone proposes Set the output token count to one as a logo filter. Which technical objection is specifically relevant to this proposal?
- Training provenance alone does not enforce prompt-specific exclusions
- Positive instructions can encourage the excluded object
- Length settings are not semantic content filters
- Negative constraints can steer generation away from named elements
Explanation
Correct Answer
C:This is the actual failure mode of the proposed approach: Set the output token count to one as a logo filter. Length settings are not semantic content filters
Incorrect Answers
A:This limitation concerns Assume only a model's training history prevents every unwanted brand; it does not diagnose the proposed Set the output token count to one as a logo filter approach.
B:This limitation concerns Mention the prohibited logo as a desired featured element; it does not diagnose the proposed Set the output token count to one as a logo filter approach.
D:Negative constraints can steer generation away from named elements This explains the recommended design, but it is not the requested diagnosis of Set the output token count to one as a logo filter.
Question 360
An image model should avoid including brand logos in generated artwork. After selecting the recommended approach, which evidence MOST DIRECTLY demonstrates that the actual required outcome has been achieved?
- A component test invokes this alternate approach successfully: Set the output token count to one as a logo filter
- A system inventory lists this competing approach as active: Mention the prohibited logo as a desired featured element
- Human review confirms prohibited logos are absent from sample images
- A reviewed design record approves this competing approach: Assume only a model's training history prevents every unwanted brand
Explanation
Correct Answer
C:Human review confirms prohibited logos are absent from sample images. This checks the business result rather than just a configured feature.
Incorrect Answers
A:Length settings are not semantic content filters A component invocation does not validate the necessary end-to-end outcome.
B:Positive instructions can encourage the excluded object An active setting cannot independently prove the requested business outcome.
D:Training provenance alone does not enforce prompt-specific exclusions Design approval is not evidence that the alternative meets the actual requirement.