ISACA Advanced in AI Audit AAIA Practice Test 16
Question 150
In a review of Leading Practices, Ethics, Regulations, and Standards for AI, investigators cannot establish the expected control proof: reviewed case explanations, fidelity tests and comprehensibility feedback. The underlying event was that a vendor sells an AI decision model as 'fully explainable' but provides only generic feature rankings. Which control weakness is the MOST likely cause requiring focused audit work?
- Explanations are not validated for individual decision context and audience
- Marketing attestations were accepted without independent evidence of risk controls
- Continuous governance and measurement were reduced to static documentation
- Voluntary framework alignment was mistaken for jurisdiction-specific legal compliance
Explanation
Correct Answer
A:Correct. The observed condition specifically indicates explanations are not validated for individual decision context and audience. A meaningful audit response is to verify this diagnosis and then recommend assess local explanation fidelity and suitability for users and reviewers.
Incorrect Answers
B:“Marketing attestations were accepted without independent evidence of risk controls” concerns a separate audit weakness, not the missing assurance described by explanations are not validated for individual decision context and audience. The correct cause is “Explanations are not validated for individual decision context and audience”.
C:“Continuous governance and measurement were reduced to static documentation” concerns a separate audit weakness, not the missing assurance described by explanations are not validated for individual decision context and audience. The correct cause is “Explanations are not validated for individual decision context and audience”.
D:“Voluntary framework alignment was mistaken for jurisdiction-specific legal compliance” concerns a separate audit weakness, not the missing assurance described by explanations are not validated for individual decision context and audience. The correct cause is “Explanations are not validated for individual decision context and audience”.
Question 151
A government case-assistance system is deployed without considering the groups least able to challenge an error. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Evaluate necessity, less intrusive alternatives and employee safeguards
- Provide understandable notice, accessible review and empowered human appeals
- Determine applicable disclosure duties and implement timely understandable notices
- Conduct participatory impact review and establish accessible challenge mechanisms
Explanation
Correct Answer
D:Correct. Conduct participatory impact review and establish accessible challenge mechanisms is aimed at the actual failure: vulnerable stakeholder impact was absent from responsible ai assessment. The audit should subsequently obtain impact-assessment minutes and targeted user testing of appeal paths to test execution, not merely the existence of a policy.
Incorrect Answers
A:“Evaluate necessity, less intrusive alternatives and employee safeguards” is a control for workforce impacts and proportionality were excluded from deployment assessment, but the audit finding here is vulnerable stakeholder impact was absent from responsible AI assessment. The relevant measure is “Conduct participatory impact review and establish accessible challenge mechanisms”.
B:“Provide understandable notice, accessible review and empowered human appeals” is a control for human rights and contestability were not incorporated into consequential AI decision design, but the audit finding here is vulnerable stakeholder impact was absent from responsible AI assessment. The relevant measure is “Conduct participatory impact review and establish accessible challenge mechanisms”.
C:“Determine applicable disclosure duties and implement timely understandable notices” is a control for required transparency and notice assessments were omitted from user experience, but the audit finding here is vulnerable stakeholder impact was absent from responsible AI assessment. The relevant measure is “Conduct participatory impact review and establish accessible challenge mechanisms”.
Question 152
In an audit of Leading Practices, Ethics, Regulations, and Standards for AI, managers say this measure is live: Conduct participatory impact review and establish accessible challenge mechanisms. They claim it corrected a material audit gap. What direct operating evidence would allow the auditor to substantiate that particular claim across a defensible sample?
- Workforce consultation record, proportionality analysis and monitoring limits
- Sampled appeal cases, reversal authority and applicant notification records
- Impact-assessment minutes and targeted user testing of appeal paths
- Approved notice language, delivery logs and complaints-handling evidence
Explanation
Correct Answer
C:Correct. The proposed records—impact-assessment minutes and targeted user testing of appeal paths—are directly tied to the asserted safeguard and allow its actual operation to be corroborated. The gap being tested is vulnerable stakeholder impact was absent from responsible ai assessment.
Incorrect Answers
A:“Workforce consultation record, proportionality analysis and monitoring limits” would test workforce impacts and proportionality were excluded from deployment assessment, not the present safeguard against vulnerable stakeholder impact was absent from responsible AI assessment. The expected audit evidence is “Impact-assessment minutes and targeted user testing of appeal paths”.
B:“Sampled appeal cases, reversal authority and applicant notification records” would test human rights and contestability were not incorporated into consequential AI decision design, not the present safeguard against vulnerable stakeholder impact was absent from responsible AI assessment. The expected audit evidence is “Impact-assessment minutes and targeted user testing of appeal paths”.
D:“Approved notice language, delivery logs and complaints-handling evidence” would test required transparency and notice assessments were omitted from user experience, not the present safeguard against vulnerable stakeholder impact was absent from responsible AI assessment. The expected audit evidence is “Impact-assessment minutes and targeted user testing of appeal paths”.
Question 153
In a review of Leading Practices, Ethics, Regulations, and Standards for AI, investigators cannot establish the expected control proof: impact-assessment minutes and targeted user testing of appeal paths. The underlying event was that a government case-assistance system is deployed without considering the groups least able to challenge an error. Which control weakness is the MOST likely cause requiring focused audit work?
- Workforce impacts and proportionality were excluded from deployment assessment
- Vulnerable stakeholder impact was absent from responsible AI assessment
- Human rights and contestability were not incorporated into consequential AI decision design
- Required transparency and notice assessments were omitted from user experience
Explanation
Correct Answer
B:Correct. The observed condition specifically indicates vulnerable stakeholder impact was absent from responsible ai assessment. A meaningful audit response is to verify this diagnosis and then recommend conduct participatory impact review and establish accessible challenge mechanisms.
Incorrect Answers
A:“Workforce impacts and proportionality were excluded from deployment assessment” concerns a separate audit weakness, not the missing assurance described by vulnerable stakeholder impact was absent from responsible AI assessment. The correct cause is “Vulnerable stakeholder impact was absent from responsible AI assessment”.
C:“Human rights and contestability were not incorporated into consequential AI decision design” concerns a separate audit weakness, not the missing assurance described by vulnerable stakeholder impact was absent from responsible AI assessment. The correct cause is “Vulnerable stakeholder impact was absent from responsible AI assessment”.
D:“Required transparency and notice assessments were omitted from user experience” concerns a separate audit weakness, not the missing assurance described by vulnerable stakeholder impact was absent from responsible AI assessment. The correct cause is “Vulnerable stakeholder impact was absent from responsible AI assessment”.
Question 154
A team relies on an AI supplier's ethical badge to bypass procurement due diligence. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Obtain control-specific assurance, testing scope and material exception disclosure
- Retain decision rationale, responsible official and meaningful challenge information
- Evaluate subgroup errors, likely harms and risk treatment before deployment
- Assess local explanation fidelity and suitability for users and reviewers
Explanation
Correct Answer
A:Correct. Obtain control-specific assurance, testing scope and material exception disclosure is aimed at the actual failure: marketing attestations were accepted without independent evidence of risk controls. The audit should subsequently obtain supplier audit evidence, findings and accepted remediation plans to test execution, not merely the existence of a policy.
Incorrect Answers
B:“Retain decision rationale, responsible official and meaningful challenge information” is a control for public accountability requires traceable reasons and reviewed decision ownership, but the audit finding here is marketing attestations were accepted without independent evidence of risk controls. The relevant measure is “Obtain control-specific assurance, testing scope and material exception disclosure”.
C:“Evaluate subgroup errors, likely harms and risk treatment before deployment” is a control for equity objectives and subgroup testing were excluded from ethical release criteria, but the audit finding here is marketing attestations were accepted without independent evidence of risk controls. The relevant measure is “Obtain control-specific assurance, testing scope and material exception disclosure”.
D:“Assess local explanation fidelity and suitability for users and reviewers” is a control for explanations are not validated for individual decision context and audience, but the audit finding here is marketing attestations were accepted without independent evidence of risk controls. The relevant measure is “Obtain control-specific assurance, testing scope and material exception disclosure”.
Question 155
In an audit of Leading Practices, Ethics, Regulations, and Standards for AI, managers say this measure is live: Obtain control-specific assurance, testing scope and material exception disclosure. They claim it corrected a material audit gap. What direct operating evidence would allow the auditor to substantiate that particular claim across a defensible sample?
- Sampled decisions with provenance, reason codes and human signoff
- Group-disaggregated false-match rates and approved mitigation threshold results
- Reviewed case explanations, fidelity tests and comprehensibility feedback
- Supplier audit evidence, findings and accepted remediation plans
Explanation
Correct Answer
D:Correct. The proposed records—supplier audit evidence, findings and accepted remediation plans—are directly tied to the asserted safeguard and allow its actual operation to be corroborated. The gap being tested is marketing attestations were accepted without independent evidence of risk controls.
Incorrect Answers
A:“Sampled decisions with provenance, reason codes and human signoff” would test public accountability requires traceable reasons and reviewed decision ownership, not the present safeguard against marketing attestations were accepted without independent evidence of risk controls. The expected audit evidence is “Supplier audit evidence, findings and accepted remediation plans”.
B:“Group-disaggregated false-match rates and approved mitigation threshold results” would test equity objectives and subgroup testing were excluded from ethical release criteria, not the present safeguard against marketing attestations were accepted without independent evidence of risk controls. The expected audit evidence is “Supplier audit evidence, findings and accepted remediation plans”.
C:“Reviewed case explanations, fidelity tests and comprehensibility feedback” would test explanations are not validated for individual decision context and audience, not the present safeguard against marketing attestations were accepted without independent evidence of risk controls. The expected audit evidence is “Supplier audit evidence, findings and accepted remediation plans”.
Question 156
In a review of Leading Practices, Ethics, Regulations, and Standards for AI, investigators cannot establish the expected control proof: supplier audit evidence, findings and accepted remediation plans. The underlying event was that a team relies on an AI supplier's ethical badge to bypass procurement due diligence. Which control weakness is the MOST likely cause requiring focused audit work?
- Public accountability requires traceable reasons and reviewed decision ownership
- Equity objectives and subgroup testing were excluded from ethical release criteria
- Marketing attestations were accepted without independent evidence of risk controls
- Explanations are not validated for individual decision context and audience
Explanation
Correct Answer
C:Correct. The observed condition specifically indicates marketing attestations were accepted without independent evidence of risk controls. A meaningful audit response is to verify this diagnosis and then recommend obtain control-specific assurance, testing scope and material exception disclosure.
Incorrect Answers
A:“Public accountability requires traceable reasons and reviewed decision ownership” concerns a separate audit weakness, not the missing assurance described by marketing attestations were accepted without independent evidence of risk controls. The correct cause is “Marketing attestations were accepted without independent evidence of risk controls”.
B:“Equity objectives and subgroup testing were excluded from ethical release criteria” concerns a separate audit weakness, not the missing assurance described by marketing attestations were accepted without independent evidence of risk controls. The correct cause is “Marketing attestations were accepted without independent evidence of risk controls”.
D:“Explanations are not validated for individual decision context and audience” concerns a separate audit weakness, not the missing assurance described by marketing attestations were accepted without independent evidence of risk controls. The correct cause is “Marketing attestations were accepted without independent evidence of risk controls”.
Question 157
An automated workplace monitoring tool increases productivity but creates chilling effects on staff. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Integrate govern-map-measure-manage activities into change and operating cycles
- Evaluate necessity, less intrusive alternatives and employee safeguards
- Map ethics principles to lifecycle controls with evidence owners and independent testing
- Conduct participatory impact review and establish accessible challenge mechanisms
Explanation
Correct Answer
B:Correct. Evaluate necessity, less intrusive alternatives and employee safeguards is aimed at the actual failure: workforce impacts and proportionality were excluded from deployment assessment. The audit should subsequently obtain workforce consultation record, proportionality analysis and monitoring limits to test execution, not merely the existence of a policy.
Incorrect Answers
A:“Integrate govern-map-measure-manage activities into change and operating cycles” is a control for continuous governance and measurement were reduced to static documentation, but the audit finding here is workforce impacts and proportionality were excluded from deployment assessment. The relevant measure is “Evaluate necessity, less intrusive alternatives and employee safeguards”.
C:“Map ethics principles to lifecycle controls with evidence owners and independent testing” is a control for abstract principles lack assigned operational controls and measurable compliance, but the audit finding here is workforce impacts and proportionality were excluded from deployment assessment. The relevant measure is “Evaluate necessity, less intrusive alternatives and employee safeguards”.
D:“Conduct participatory impact review and establish accessible challenge mechanisms” is a control for vulnerable stakeholder impact was absent from responsible AI assessment, but the audit finding here is workforce impacts and proportionality were excluded from deployment assessment. The relevant measure is “Evaluate necessity, less intrusive alternatives and employee safeguards”.
Question 158
In an audit of Leading Practices, Ethics, Regulations, and Standards for AI, managers say this measure is live: Evaluate necessity, less intrusive alternatives and employee safeguards. They claim it corrected a material audit gap. What direct operating evidence would allow the auditor to substantiate that particular claim across a defensible sample?
- Workforce consultation record, proportionality analysis and monitoring limits
- Versioned risk records, monitored outcomes and management-action closure
- Control-to-principle trace and audited execution artifacts
- Impact-assessment minutes and targeted user testing of appeal paths
Explanation
Correct Answer
A:Correct. The proposed records—workforce consultation record, proportionality analysis and monitoring limits—are directly tied to the asserted safeguard and allow its actual operation to be corroborated. The gap being tested is workforce impacts and proportionality were excluded from deployment assessment.
Incorrect Answers
B:“Versioned risk records, monitored outcomes and management-action closure” would test continuous governance and measurement were reduced to static documentation, not the present safeguard against workforce impacts and proportionality were excluded from deployment assessment. The expected audit evidence is “Workforce consultation record, proportionality analysis and monitoring limits”.
C:“Control-to-principle trace and audited execution artifacts” would test abstract principles lack assigned operational controls and measurable compliance, not the present safeguard against workforce impacts and proportionality were excluded from deployment assessment. The expected audit evidence is “Workforce consultation record, proportionality analysis and monitoring limits”.
D:“Impact-assessment minutes and targeted user testing of appeal paths” would test vulnerable stakeholder impact was absent from responsible AI assessment, not the present safeguard against workforce impacts and proportionality were excluded from deployment assessment. The expected audit evidence is “Workforce consultation record, proportionality analysis and monitoring limits”.
Question 159
In a review of Leading Practices, Ethics, Regulations, and Standards for AI, investigators cannot establish the expected control proof: workforce consultation record, proportionality analysis and monitoring limits. The underlying event was that an automated workplace monitoring tool increases productivity but creates chilling effects on staff. Which control weakness is the MOST likely cause requiring focused audit work?
- Continuous governance and measurement were reduced to static documentation
- Abstract principles lack assigned operational controls and measurable compliance
- Vulnerable stakeholder impact was absent from responsible AI assessment
- Workforce impacts and proportionality were excluded from deployment assessment
Explanation
Correct Answer
D:Correct. The observed condition specifically indicates workforce impacts and proportionality were excluded from deployment assessment. A meaningful audit response is to verify this diagnosis and then recommend evaluate necessity, less intrusive alternatives and employee safeguards.
Incorrect Answers
A:“Continuous governance and measurement were reduced to static documentation” concerns a separate audit weakness, not the missing assurance described by workforce impacts and proportionality were excluded from deployment assessment. The correct cause is “Workforce impacts and proportionality were excluded from deployment assessment”.
B:“Abstract principles lack assigned operational controls and measurable compliance” concerns a separate audit weakness, not the missing assurance described by workforce impacts and proportionality were excluded from deployment assessment. The correct cause is “Workforce impacts and proportionality were excluded from deployment assessment”.
C:“Vulnerable stakeholder impact was absent from responsible AI assessment” concerns a separate audit weakness, not the missing assurance described by workforce impacts and proportionality were excluded from deployment assessment. The correct cause is “Workforce impacts and proportionality were excluded from deployment assessment”.
Question 160
A public-sector AI decision is logged only as an opaque model score. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Provide understandable notice, accessible review and empowered human appeals
- Map binding obligations by use, geography and sector separately from voluntary guidance
- Retain decision rationale, responsible official and meaningful challenge information
- Obtain control-specific assurance, testing scope and material exception disclosure
Explanation
Correct Answer
C:Correct. Retain decision rationale, responsible official and meaningful challenge information is aimed at the actual failure: public accountability requires traceable reasons and reviewed decision ownership. The audit should subsequently obtain sampled decisions with provenance, reason codes and human signoff to test execution, not merely the existence of a policy.
Incorrect Answers
A:“Provide understandable notice, accessible review and empowered human appeals” is a control for human rights and contestability were not incorporated into consequential AI decision design, but the audit finding here is public accountability requires traceable reasons and reviewed decision ownership. The relevant measure is “Retain decision rationale, responsible official and meaningful challenge information”.
B:“Map binding obligations by use, geography and sector separately from voluntary guidance” is a control for voluntary framework alignment was mistaken for jurisdiction-specific legal compliance, but the audit finding here is public accountability requires traceable reasons and reviewed decision ownership. The relevant measure is “Retain decision rationale, responsible official and meaningful challenge information”.
D:“Obtain control-specific assurance, testing scope and material exception disclosure” is a control for marketing attestations were accepted without independent evidence of risk controls, but the audit finding here is public accountability requires traceable reasons and reviewed decision ownership. The relevant measure is “Retain decision rationale, responsible official and meaningful challenge information”.