ISACA Advanced in AI Audit AAIA Practice Test 49
Question 480
An AI audit concludes 'model governance effective' despite three unremediated high-severity control failures. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Report population, metric, threshold, evidence limitations and affected stakeholders
- Use minimization, secure appendices and role-appropriate disclosure controls
- Qualify conclusions and link each material exception to risk and evidence
- Record management response, evidence basis and unresolved risk in governance reporting
Explanation
Correct Answer
C:Correct. Qualify conclusions and link each material exception to risk and evidence is aimed at the actual failure: reporting opinion is not supported by severity-ranked evidence. The audit should subsequently obtain revised report opinion and traceable high-severity finding references to test execution, not merely the existence of a policy.
Incorrect Answers
A:“Report population, metric, threshold, evidence limitations and affected stakeholders” is a control for findings lack reproducible criteria and measurable impact context, but the audit finding here is reporting opinion is not supported by severity-ranked evidence. The relevant measure is “Qualify conclusions and link each material exception to risk and evidence”.
B:“Use minimization, secure appendices and role-appropriate disclosure controls” is a control for sensitive evidentiary detail is overexposed during assurance reporting, but the audit finding here is reporting opinion is not supported by severity-ranked evidence. The relevant measure is “Qualify conclusions and link each material exception to risk and evidence”.
D:“Record management response, evidence basis and unresolved risk in governance reporting” is a control for auditor independence is undermined by suppressing unresolved material exceptions, but the audit finding here is reporting opinion is not supported by severity-ranked evidence. The relevant measure is “Qualify conclusions and link each material exception to risk and evidence”.
Question 481
In an audit of AI Audit Outputs and Reports, managers say this measure is live: Qualify conclusions and link each material exception to risk and evidence. They claim it corrected a material audit gap. What direct operating evidence would allow the auditor to substantiate that particular claim across a defensible sample?
- Reproducible subgroup analysis and clear scope/limitations in final finding
- Revised report opinion and traceable high-severity finding references
- Distribution controls and approved redacted report version
- Signed management response and escalation of unresolved high-severity finding
Explanation
Correct Answer
B:Correct. The proposed records—revised report opinion and traceable high-severity finding references—are directly tied to the asserted safeguard and allow its actual operation to be corroborated. The gap being tested is reporting opinion is not supported by severity-ranked evidence.
Incorrect Answers
A:“Reproducible subgroup analysis and clear scope/limitations in final finding” would test findings lack reproducible criteria and measurable impact context, not the present safeguard against reporting opinion is not supported by severity-ranked evidence. The expected audit evidence is “Revised report opinion and traceable high-severity finding references”.
C:“Distribution controls and approved redacted report version” would test sensitive evidentiary detail is overexposed during assurance reporting, not the present safeguard against reporting opinion is not supported by severity-ranked evidence. The expected audit evidence is “Revised report opinion and traceable high-severity finding references”.
D:“Signed management response and escalation of unresolved high-severity finding” would test auditor independence is undermined by suppressing unresolved material exceptions, not the present safeguard against reporting opinion is not supported by severity-ranked evidence. The expected audit evidence is “Revised report opinion and traceable high-severity finding references”.
Question 482
In a review of AI Audit Outputs and Reports, investigators cannot establish the expected control proof: revised report opinion and traceable high-severity finding references. The underlying event was that an AI audit concludes 'model governance effective' despite three unremediated high-severity control failures. Which control weakness is the MOST likely cause requiring focused audit work?
- Reporting opinion is not supported by severity-ranked evidence
- Findings lack reproducible criteria and measurable impact context
- Sensitive evidentiary detail is overexposed during assurance reporting
- Auditor independence is undermined by suppressing unresolved material exceptions
Explanation
Correct Answer
A:Correct. The observed condition specifically indicates reporting opinion is not supported by severity-ranked evidence. A meaningful audit response is to verify this diagnosis and then recommend qualify conclusions and link each material exception to risk and evidence.
Incorrect Answers
B:“Findings lack reproducible criteria and measurable impact context” concerns a separate audit weakness, not the missing assurance described by reporting opinion is not supported by severity-ranked evidence. The correct cause is “Reporting opinion is not supported by severity-ranked evidence”.
C:“Sensitive evidentiary detail is overexposed during assurance reporting” concerns a separate audit weakness, not the missing assurance described by reporting opinion is not supported by severity-ranked evidence. The correct cause is “Reporting opinion is not supported by severity-ranked evidence”.
D:“Auditor independence is undermined by suppressing unresolved material exceptions” concerns a separate audit weakness, not the missing assurance described by reporting opinion is not supported by severity-ranked evidence. The correct cause is “Reporting opinion is not supported by severity-ranked evidence”.
Question 483
An audit report lists technical defects but no accountable owners or remediation deadlines. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Use minimization, secure appendices and role-appropriate disclosure controls
- Reperform target control tests before validating closure
- Label AI-assisted analysis, validation scope and limitations for each conclusion
- Specify affected risk, root cause, owner, action, due date and validation plan
Explanation
Correct Answer
D:Correct. Specify affected risk, root cause, owner, action, due date and validation plan is aimed at the actual failure: findings are not actionable or trackable to closure. The audit should subsequently obtain management action plan and independently verified completion evidence to test execution, not merely the existence of a policy.
Incorrect Answers
A:“Use minimization, secure appendices and role-appropriate disclosure controls” is a control for sensitive evidentiary detail is overexposed during assurance reporting, but the audit finding here is findings are not actionable or trackable to closure. The relevant measure is “Specify affected risk, root cause, owner, action, due date and validation plan”.
B:“Reperform target control tests before validating closure” is a control for issue follow-up lacks independent effectiveness retesting, but the audit finding here is findings are not actionable or trackable to closure. The relevant measure is “Specify affected risk, root cause, owner, action, due date and validation plan”.
C:“Label AI-assisted analysis, validation scope and limitations for each conclusion” is a control for assurance levels and use of AI-generated evidence are not distinguished, but the audit finding here is findings are not actionable or trackable to closure. The relevant measure is “Specify affected risk, root cause, owner, action, due date and validation plan”.
Question 484
In an audit of AI Audit Outputs and Reports, managers say this measure is live: Specify affected risk, root cause, owner, action, due date and validation plan. They claim it corrected a material audit gap. What direct operating evidence would allow the auditor to substantiate that particular claim across a defensible sample?
- Distribution controls and approved redacted report version
- Retest evidence and documented closure decision independent of implementer
- Management action plan and independently verified completion evidence
- Evidence provenance tags and reviewer signoffs separated by assurance level
Explanation
Correct Answer
C:Correct. The proposed records—management action plan and independently verified completion evidence—are directly tied to the asserted safeguard and allow its actual operation to be corroborated. The gap being tested is findings are not actionable or trackable to closure.
Incorrect Answers
A:“Distribution controls and approved redacted report version” would test sensitive evidentiary detail is overexposed during assurance reporting, not the present safeguard against findings are not actionable or trackable to closure. The expected audit evidence is “Management action plan and independently verified completion evidence”.
B:“Retest evidence and documented closure decision independent of implementer” would test issue follow-up lacks independent effectiveness retesting, not the present safeguard against findings are not actionable or trackable to closure. The expected audit evidence is “Management action plan and independently verified completion evidence”.
D:“Evidence provenance tags and reviewer signoffs separated by assurance level” would test assurance levels and use of AI-generated evidence are not distinguished, not the present safeguard against findings are not actionable or trackable to closure. The expected audit evidence is “Management action plan and independently verified completion evidence”.
Question 485
In a review of AI Audit Outputs and Reports, investigators cannot establish the expected control proof: management action plan and independently verified completion evidence. The underlying event was that an audit report lists technical defects but no accountable owners or remediation deadlines. Which control weakness is the MOST likely cause requiring focused audit work?
- Sensitive evidentiary detail is overexposed during assurance reporting
- Findings are not actionable or trackable to closure
- Issue follow-up lacks independent effectiveness retesting
- Assurance levels and use of AI-generated evidence are not distinguished
Explanation
Correct Answer
B:Correct. The observed condition specifically indicates findings are not actionable or trackable to closure. A meaningful audit response is to verify this diagnosis and then recommend specify affected risk, root cause, owner, action, due date and validation plan.
Incorrect Answers
A:“Sensitive evidentiary detail is overexposed during assurance reporting” concerns a separate audit weakness, not the missing assurance described by findings are not actionable or trackable to closure. The correct cause is “Findings are not actionable or trackable to closure”.
C:“Issue follow-up lacks independent effectiveness retesting” concerns a separate audit weakness, not the missing assurance described by findings are not actionable or trackable to closure. The correct cause is “Findings are not actionable or trackable to closure”.
D:“Assurance levels and use of AI-generated evidence are not distinguished” concerns a separate audit weakness, not the missing assurance described by findings are not actionable or trackable to closure. The correct cause is “Findings are not actionable or trackable to closure”.
Question 486
An AI oversight report says 'biased model' without defining subgroup, test conditions or uncertainty. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Report population, metric, threshold, evidence limitations and affected stakeholders
- Reperform target control tests before validating closure
- Record management response, evidence basis and unresolved risk in governance reporting
- Qualify conclusions and link each material exception to risk and evidence
Explanation
Correct Answer
A:Correct. Report population, metric, threshold, evidence limitations and affected stakeholders is aimed at the actual failure: findings lack reproducible criteria and measurable impact context. The audit should subsequently obtain reproducible subgroup analysis and clear scope/limitations in final finding to test execution, not merely the existence of a policy.
Incorrect Answers
B:“Reperform target control tests before validating closure” is a control for issue follow-up lacks independent effectiveness retesting, but the audit finding here is findings lack reproducible criteria and measurable impact context. The relevant measure is “Report population, metric, threshold, evidence limitations and affected stakeholders”.
C:“Record management response, evidence basis and unresolved risk in governance reporting” is a control for auditor independence is undermined by suppressing unresolved material exceptions, but the audit finding here is findings lack reproducible criteria and measurable impact context. The relevant measure is “Report population, metric, threshold, evidence limitations and affected stakeholders”.
D:“Qualify conclusions and link each material exception to risk and evidence” is a control for reporting opinion is not supported by severity-ranked evidence, but the audit finding here is findings lack reproducible criteria and measurable impact context. The relevant measure is “Report population, metric, threshold, evidence limitations and affected stakeholders”.
Question 487
In an audit of AI Audit Outputs and Reports, managers say this measure is live: Report population, metric, threshold, evidence limitations and affected stakeholders. They claim it corrected a material audit gap. What direct operating evidence would allow the auditor to substantiate that particular claim across a defensible sample?
- Retest evidence and documented closure decision independent of implementer
- Signed management response and escalation of unresolved high-severity finding
- Revised report opinion and traceable high-severity finding references
- Reproducible subgroup analysis and clear scope/limitations in final finding
Explanation
Correct Answer
D:Correct. The proposed records—reproducible subgroup analysis and clear scope/limitations in final finding—are directly tied to the asserted safeguard and allow its actual operation to be corroborated. The gap being tested is findings lack reproducible criteria and measurable impact context.
Incorrect Answers
A:“Retest evidence and documented closure decision independent of implementer” would test issue follow-up lacks independent effectiveness retesting, not the present safeguard against findings lack reproducible criteria and measurable impact context. The expected audit evidence is “Reproducible subgroup analysis and clear scope/limitations in final finding”.
B:“Signed management response and escalation of unresolved high-severity finding” would test auditor independence is undermined by suppressing unresolved material exceptions, not the present safeguard against findings lack reproducible criteria and measurable impact context. The expected audit evidence is “Reproducible subgroup analysis and clear scope/limitations in final finding”.
C:“Revised report opinion and traceable high-severity finding references” would test reporting opinion is not supported by severity-ranked evidence, not the present safeguard against findings lack reproducible criteria and measurable impact context. The expected audit evidence is “Reproducible subgroup analysis and clear scope/limitations in final finding”.
Question 488
In a review of AI Audit Outputs and Reports, investigators cannot establish the expected control proof: reproducible subgroup analysis and clear scope/limitations in final finding. The underlying event was that an AI oversight report says 'biased model' without defining subgroup, test conditions or uncertainty. Which control weakness is the MOST likely cause requiring focused audit work?
- Issue follow-up lacks independent effectiveness retesting
- Auditor independence is undermined by suppressing unresolved material exceptions
- Findings lack reproducible criteria and measurable impact context
- Reporting opinion is not supported by severity-ranked evidence
Explanation
Correct Answer
C:Correct. The observed condition specifically indicates findings lack reproducible criteria and measurable impact context. A meaningful audit response is to verify this diagnosis and then recommend report population, metric, threshold, evidence limitations and affected stakeholders.
Incorrect Answers
A:“Issue follow-up lacks independent effectiveness retesting” concerns a separate audit weakness, not the missing assurance described by findings lack reproducible criteria and measurable impact context. The correct cause is “Findings lack reproducible criteria and measurable impact context”.
B:“Auditor independence is undermined by suppressing unresolved material exceptions” concerns a separate audit weakness, not the missing assurance described by findings lack reproducible criteria and measurable impact context. The correct cause is “Findings lack reproducible criteria and measurable impact context”.
D:“Reporting opinion is not supported by severity-ranked evidence” concerns a separate audit weakness, not the missing assurance described by findings lack reproducible criteria and measurable impact context. The correct cause is “Findings lack reproducible criteria and measurable impact context”.
Question 489
An audit team publishes customer-level prompt excerpts in an unrestricted board report. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Record management response, evidence basis and unresolved risk in governance reporting
- Use minimization, secure appendices and role-appropriate disclosure controls
- Label AI-assisted analysis, validation scope and limitations for each conclusion
- Specify affected risk, root cause, owner, action, due date and validation plan
Explanation
Correct Answer
B:Correct. Use minimization, secure appendices and role-appropriate disclosure controls is aimed at the actual failure: sensitive evidentiary detail is overexposed during assurance reporting. The audit should subsequently obtain distribution controls and approved redacted report version to test execution, not merely the existence of a policy.
Incorrect Answers
A:“Record management response, evidence basis and unresolved risk in governance reporting” is a control for auditor independence is undermined by suppressing unresolved material exceptions, but the audit finding here is sensitive evidentiary detail is overexposed during assurance reporting. The relevant measure is “Use minimization, secure appendices and role-appropriate disclosure controls”.
C:“Label AI-assisted analysis, validation scope and limitations for each conclusion” is a control for assurance levels and use of AI-generated evidence are not distinguished, but the audit finding here is sensitive evidentiary detail is overexposed during assurance reporting. The relevant measure is “Use minimization, secure appendices and role-appropriate disclosure controls”.
D:“Specify affected risk, root cause, owner, action, due date and validation plan” is a control for findings are not actionable or trackable to closure, but the audit finding here is sensitive evidentiary detail is overexposed during assurance reporting. The relevant measure is “Use minimization, secure appendices and role-appropriate disclosure controls”.
Question 490
In an audit of AI Audit Outputs and Reports, managers say this measure is live: Use minimization, secure appendices and role-appropriate disclosure controls. They claim it corrected a material audit gap. What direct operating evidence would allow the auditor to substantiate that particular claim across a defensible sample?
- Distribution controls and approved redacted report version
- Signed management response and escalation of unresolved high-severity finding
- Evidence provenance tags and reviewer signoffs separated by assurance level
- Management action plan and independently verified completion evidence
Explanation
Correct Answer
A:Correct. The proposed records—distribution controls and approved redacted report version—are directly tied to the asserted safeguard and allow its actual operation to be corroborated. The gap being tested is sensitive evidentiary detail is overexposed during assurance reporting.
Incorrect Answers
B:“Signed management response and escalation of unresolved high-severity finding” would test auditor independence is undermined by suppressing unresolved material exceptions, not the present safeguard against sensitive evidentiary detail is overexposed during assurance reporting. The expected audit evidence is “Distribution controls and approved redacted report version”.
C:“Evidence provenance tags and reviewer signoffs separated by assurance level” would test assurance levels and use of AI-generated evidence are not distinguished, not the present safeguard against sensitive evidentiary detail is overexposed during assurance reporting. The expected audit evidence is “Distribution controls and approved redacted report version”.
D:“Management action plan and independently verified completion evidence” would test findings are not actionable or trackable to closure, not the present safeguard against sensitive evidentiary detail is overexposed during assurance reporting. The expected audit evidence is “Distribution controls and approved redacted report version”.