ISACA Advanced in AI Audit AAIA Practice Test 42
Question 410
In a review of Audit Planning and Design, investigators cannot establish the expected control proof: change inventory and documented revisions to annual audit priorities. The underlying event was that a model is trained for one purpose and reused for another without any scoping change in next year's audit. Which control weakness is the MOST likely cause requiring focused audit work?
- New intended uses and affected persons are omitted from risk-based audit planning
- Dynamic risks do not trigger audit plan reconsideration
- Audit scope lacks a complete AI asset and dependency boundary
- Independence and reliability of management evidence were not assessed
Explanation
Correct Answer
A:Correct. The observed condition specifically indicates new intended uses and affected persons are omitted from risk-based audit planning. A meaningful audit response is to verify this diagnosis and then recommend reassess emerging use cases and update the audit universe each planning cycle.
Incorrect Answers
B:“Dynamic risks do not trigger audit plan reconsideration” concerns a separate audit weakness, not the missing assurance described by new intended uses and affected persons are omitted from risk-based audit planning. The correct cause is “New intended uses and affected persons are omitted from risk-based audit planning”.
C:“Audit scope lacks a complete AI asset and dependency boundary” concerns a separate audit weakness, not the missing assurance described by new intended uses and affected persons are omitted from risk-based audit planning. The correct cause is “New intended uses and affected persons are omitted from risk-based audit planning”.
D:“Independence and reliability of management evidence were not assessed” concerns a separate audit weakness, not the missing assurance described by new intended uses and affected persons are omitted from risk-based audit planning. The correct cause is “New intended uses and affected persons are omitted from risk-based audit planning”.
Question 411
The audit charter authorizes IT audits but does not clarify assurance work on automated customer decisions. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Identify models, datasets, interfaces, third parties and human decision points before scoping
- Prioritize scope using impact, autonomy, exposure and control maturity
- Map each outsourced AI component, assurance rights and retained responsibilities
- Establish audit authority for AI evidence, experts and escalation to governance
Explanation
Correct Answer
D:Correct. Establish audit authority for AI evidence, experts and escalation to governance is aimed at the actual failure: ai audit mandate and decision-rights access are not explicit. The audit should subsequently obtain charter or engagement approval and agreed unrestricted evidence access to test execution, not merely the existence of a policy.
Incorrect Answers
A:“Identify models, datasets, interfaces, third parties and human decision points before scoping” is a control for audit scope lacks a complete AI asset and dependency boundary, but the audit finding here is aI audit mandate and decision-rights access are not explicit. The relevant measure is “Establish audit authority for AI evidence, experts and escalation to governance”.
B:“Prioritize scope using impact, autonomy, exposure and control maturity” is a control for risk assessment does not determine assurance depth by potential harm, but the audit finding here is aI audit mandate and decision-rights access are not explicit. The relevant measure is “Establish audit authority for AI evidence, experts and escalation to governance”.
C:“Map each outsourced AI component, assurance rights and retained responsibilities” is a control for third-party boundaries and shared control responsibility are outside audit scope, but the audit finding here is aI audit mandate and decision-rights access are not explicit. The relevant measure is “Establish audit authority for AI evidence, experts and escalation to governance”.
Question 412
In an audit of Audit Planning and Design, managers say this measure is live: Establish audit authority for AI evidence, experts and escalation to governance. They claim it corrected a material audit gap. What direct operating evidence would allow the auditor to substantiate that particular claim across a defensible sample?
- Verified architecture and asset inventory reconciled to production usage
- Documented risk-based audit universe and engagement resource allocation
- Charter or engagement approval and agreed unrestricted evidence access
- Contract map and audit scope covering provider and internal control interfaces
Explanation
Correct Answer
C:Correct. The proposed records—charter or engagement approval and agreed unrestricted evidence access—are directly tied to the asserted safeguard and allow its actual operation to be corroborated. The gap being tested is ai audit mandate and decision-rights access are not explicit.
Incorrect Answers
A:“Verified architecture and asset inventory reconciled to production usage” would test audit scope lacks a complete AI asset and dependency boundary, not the present safeguard against aI audit mandate and decision-rights access are not explicit. The expected audit evidence is “Charter or engagement approval and agreed unrestricted evidence access”.
B:“Documented risk-based audit universe and engagement resource allocation” would test risk assessment does not determine assurance depth by potential harm, not the present safeguard against aI audit mandate and decision-rights access are not explicit. The expected audit evidence is “Charter or engagement approval and agreed unrestricted evidence access”.
D:“Contract map and audit scope covering provider and internal control interfaces” would test third-party boundaries and shared control responsibility are outside audit scope, not the present safeguard against aI audit mandate and decision-rights access are not explicit. The expected audit evidence is “Charter or engagement approval and agreed unrestricted evidence access”.
Question 413
In a review of Audit Planning and Design, investigators cannot establish the expected control proof: charter or engagement approval and agreed unrestricted evidence access. The underlying event was that the audit charter authorizes IT audits but does not clarify assurance work on automated customer decisions. Which control weakness is the MOST likely cause requiring focused audit work?
- Audit scope lacks a complete AI asset and dependency boundary
- AI audit mandate and decision-rights access are not explicit
- Risk assessment does not determine assurance depth by potential harm
- Third-party boundaries and shared control responsibility are outside audit scope
Explanation
Correct Answer
B:Correct. The observed condition specifically indicates ai audit mandate and decision-rights access are not explicit. A meaningful audit response is to verify this diagnosis and then recommend establish audit authority for ai evidence, experts and escalation to governance.
Incorrect Answers
A:“Audit scope lacks a complete AI asset and dependency boundary” concerns a separate audit weakness, not the missing assurance described by aI audit mandate and decision-rights access are not explicit. The correct cause is “AI audit mandate and decision-rights access are not explicit”.
C:“Risk assessment does not determine assurance depth by potential harm” concerns a separate audit weakness, not the missing assurance described by aI audit mandate and decision-rights access are not explicit. The correct cause is “AI audit mandate and decision-rights access are not explicit”.
D:“Third-party boundaries and shared control responsibility are outside audit scope” concerns a separate audit weakness, not the missing assurance described by aI audit mandate and decision-rights access are not explicit. The correct cause is “AI audit mandate and decision-rights access are not explicit”.
Question 414
An audit schedule is fixed despite a major AI deployment incident occurring before fieldwork. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Update engagement objectives for the incident, impact pathways and corrective controls
- Prioritize scope using impact, autonomy, exposure and control maturity
- Plan corroborating tests and independent data extraction for material risk assertions
- Reassess emerging use cases and update the audit universe each planning cycle
Explanation
Correct Answer
A:Correct. Update engagement objectives for the incident, impact pathways and corrective controls is aimed at the actual failure: dynamic risks do not trigger audit plan reconsideration. The audit should subsequently obtain revised risk assessment and approved audit scope change to test execution, not merely the existence of a policy.
Incorrect Answers
B:“Prioritize scope using impact, autonomy, exposure and control maturity” is a control for risk assessment does not determine assurance depth by potential harm, but the audit finding here is dynamic risks do not trigger audit plan reconsideration. The relevant measure is “Update engagement objectives for the incident, impact pathways and corrective controls”.
C:“Plan corroborating tests and independent data extraction for material risk assertions” is a control for independence and reliability of management evidence were not assessed, but the audit finding here is dynamic risks do not trigger audit plan reconsideration. The relevant measure is “Update engagement objectives for the incident, impact pathways and corrective controls”.
D:“Reassess emerging use cases and update the audit universe each planning cycle” is a control for new intended uses and affected persons are omitted from risk-based audit planning, but the audit finding here is dynamic risks do not trigger audit plan reconsideration. The relevant measure is “Update engagement objectives for the incident, impact pathways and corrective controls”.
Question 415
In an audit of Audit Planning and Design, managers say this measure is live: Update engagement objectives for the incident, impact pathways and corrective controls. They claim it corrected a material audit gap. What direct operating evidence would allow the auditor to substantiate that particular claim across a defensible sample?
- Documented risk-based audit universe and engagement resource allocation
- Approved audit program specifying independent corroboration and source integrity
- Change inventory and documented revisions to annual audit priorities
- Revised risk assessment and approved audit scope change
Explanation
Correct Answer
D:Correct. The proposed records—revised risk assessment and approved audit scope change—are directly tied to the asserted safeguard and allow its actual operation to be corroborated. The gap being tested is dynamic risks do not trigger audit plan reconsideration.
Incorrect Answers
A:“Documented risk-based audit universe and engagement resource allocation” would test risk assessment does not determine assurance depth by potential harm, not the present safeguard against dynamic risks do not trigger audit plan reconsideration. The expected audit evidence is “Revised risk assessment and approved audit scope change”.
B:“Approved audit program specifying independent corroboration and source integrity” would test independence and reliability of management evidence were not assessed, not the present safeguard against dynamic risks do not trigger audit plan reconsideration. The expected audit evidence is “Revised risk assessment and approved audit scope change”.
C:“Change inventory and documented revisions to annual audit priorities” would test new intended uses and affected persons are omitted from risk-based audit planning, not the present safeguard against dynamic risks do not trigger audit plan reconsideration. The expected audit evidence is “Revised risk assessment and approved audit scope change”.
Question 416
In a review of Audit Planning and Design, investigators cannot establish the expected control proof: revised risk assessment and approved audit scope change. The underlying event was that an audit schedule is fixed despite a major AI deployment incident occurring before fieldwork. Which control weakness is the MOST likely cause requiring focused audit work?
- Risk assessment does not determine assurance depth by potential harm
- Independence and reliability of management evidence were not assessed
- Dynamic risks do not trigger audit plan reconsideration
- New intended uses and affected persons are omitted from risk-based audit planning
Explanation
Correct Answer
C:Correct. The observed condition specifically indicates dynamic risks do not trigger audit plan reconsideration. A meaningful audit response is to verify this diagnosis and then recommend update engagement objectives for the incident, impact pathways and corrective controls.
Incorrect Answers
A:“Risk assessment does not determine assurance depth by potential harm” concerns a separate audit weakness, not the missing assurance described by dynamic risks do not trigger audit plan reconsideration. The correct cause is “Dynamic risks do not trigger audit plan reconsideration”.
B:“Independence and reliability of management evidence were not assessed” concerns a separate audit weakness, not the missing assurance described by dynamic risks do not trigger audit plan reconsideration. The correct cause is “Dynamic risks do not trigger audit plan reconsideration”.
D:“New intended uses and affected persons are omitted from risk-based audit planning” concerns a separate audit weakness, not the missing assurance described by dynamic risks do not trigger audit plan reconsideration. The correct cause is “Dynamic risks do not trigger audit plan reconsideration”.
Question 417
An auditor samples only ordinary chatbot sessions although rare prompts can cause catastrophic disclosure. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Stratify samples by weekday, weekend and peak processing conditions
- Select risk-stratified cases including high-impact exceptions and adversarial inputs
- Preserve deterministic sample selection, population snapshots and trace IDs
- Draw independent samples from complete decision and override logs
Explanation
Correct Answer
B:Correct. Select risk-stratified cases including high-impact exceptions and adversarial inputs is aimed at the actual failure: sampling design misses severity-stratified tail events. The audit should subsequently obtain sampling frame and documented coverage of high-severity scenarios to test execution, not merely the existence of a policy.
Incorrect Answers
A:“Stratify samples by weekday, weekend and peak processing conditions” is a control for selection method omits temporal operational risk windows, but the audit finding here is sampling design misses severity-stratified tail events. The relevant measure is “Select risk-stratified cases including high-impact exceptions and adversarial inputs”.
C:“Preserve deterministic sample selection, population snapshots and trace IDs” is a control for sampling reproducibility and evidence chain are absent, but the audit finding here is sampling design misses severity-stratified tail events. The relevant measure is “Select risk-stratified cases including high-impact exceptions and adversarial inputs”.
D:“Draw independent samples from complete decision and override logs” is a control for selection bias undermines audit conclusions about control performance, but the audit finding here is sampling design misses severity-stratified tail events. The relevant measure is “Select risk-stratified cases including high-impact exceptions and adversarial inputs”.
Question 418
In an audit of Audit Testing and Sampling Methodologies, managers say this measure is live: Select risk-stratified cases including high-impact exceptions and adversarial inputs. They claim it corrected a material audit gap. What direct operating evidence would allow the auditor to substantiate that particular claim across a defensible sample?
- Sampling frame and documented coverage of high-severity scenarios
- Date-stratified sample list and observed control execution
- Seeded sampling script, frozen population and replayable sample manifests
- Source-population reconciliation and independent random seed record
Explanation
Correct Answer
A:Correct. The proposed records—sampling frame and documented coverage of high-severity scenarios—are directly tied to the asserted safeguard and allow its actual operation to be corroborated. The gap being tested is sampling design misses severity-stratified tail events.
Incorrect Answers
B:“Date-stratified sample list and observed control execution” would test selection method omits temporal operational risk windows, not the present safeguard against sampling design misses severity-stratified tail events. The expected audit evidence is “Sampling frame and documented coverage of high-severity scenarios”.
C:“Seeded sampling script, frozen population and replayable sample manifests” would test sampling reproducibility and evidence chain are absent, not the present safeguard against sampling design misses severity-stratified tail events. The expected audit evidence is “Sampling frame and documented coverage of high-severity scenarios”.
D:“Source-population reconciliation and independent random seed record” would test selection bias undermines audit conclusions about control performance, not the present safeguard against sampling design misses severity-stratified tail events. The expected audit evidence is “Sampling frame and documented coverage of high-severity scenarios”.
Question 419
In a review of Audit Testing and Sampling Methodologies, investigators cannot establish the expected control proof: sampling frame and documented coverage of high-severity scenarios. The underlying event was that an auditor samples only ordinary chatbot sessions although rare prompts can cause catastrophic disclosure. Which control weakness is the MOST likely cause requiring focused audit work?
- Selection method omits temporal operational risk windows
- Sampling reproducibility and evidence chain are absent
- Selection bias undermines audit conclusions about control performance
- Sampling design misses severity-stratified tail events
Explanation
Correct Answer
D:Correct. The observed condition specifically indicates sampling design misses severity-stratified tail events. A meaningful audit response is to verify this diagnosis and then recommend select risk-stratified cases including high-impact exceptions and adversarial inputs.
Incorrect Answers
A:“Selection method omits temporal operational risk windows” concerns a separate audit weakness, not the missing assurance described by sampling design misses severity-stratified tail events. The correct cause is “Sampling design misses severity-stratified tail events”.
B:“Sampling reproducibility and evidence chain are absent” concerns a separate audit weakness, not the missing assurance described by sampling design misses severity-stratified tail events. The correct cause is “Sampling design misses severity-stratified tail events”.
C:“Selection bias undermines audit conclusions about control performance” concerns a separate audit weakness, not the missing assurance described by sampling design misses severity-stratified tail events. The correct cause is “Sampling design misses severity-stratified tail events”.
Question 420
An audit estimates a model's error rate from 20 examples but claims population-level precision. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Preserve deterministic sample selection, population snapshots and trace IDs
- Apply correct weights and report group-specific intervals separately
- Set sample size and confidence limits appropriate to the test objective
- Include evolving attack strategies, threat-informed mutations and retesting
Explanation
Correct Answer
C:Correct. Set sample size and confidence limits appropriate to the test objective is aimed at the actual failure: sampling uncertainty and population representativeness were ignored. The audit should subsequently obtain sampling calculation, inclusion probabilities and confidence intervals to test execution, not merely the existence of a policy.
Incorrect Answers
A:“Preserve deterministic sample selection, population snapshots and trace IDs” is a control for sampling reproducibility and evidence chain are absent, but the audit finding here is sampling uncertainty and population representativeness were ignored. The relevant measure is “Set sample size and confidence limits appropriate to the test objective”.
B:“Apply correct weights and report group-specific intervals separately” is a control for stratified sample estimates were aggregated without sampling weights, but the audit finding here is sampling uncertainty and population representativeness were ignored. The relevant measure is “Set sample size and confidence limits appropriate to the test objective”.
D:“Include evolving attack strategies, threat-informed mutations and retesting” is a control for test selection does not reflect adaptable AI attack patterns, but the audit finding here is sampling uncertainty and population representativeness were ignored. The relevant measure is “Set sample size and confidence limits appropriate to the test objective”.