ISACA Advanced in AI Audit AAIA Practice Test 15
Question 140
In an audit of Leading Practices, Ethics, Regulations, and Standards for AI, managers say this measure is live: Map ethics principles to lifecycle controls with evidence owners and independent testing. They claim it corrected a material audit gap. What direct operating evidence would allow the auditor to substantiate that particular claim across a defensible sample?
- Approved notice language, delivery logs and complaints-handling evidence
- Supplier audit evidence, findings and accepted remediation plans
- Control-to-principle trace and audited execution artifacts
- Sampled appeal cases, reversal authority and applicant notification records
Explanation
Correct Answer
C:Correct. The proposed records—control-to-principle trace and audited execution artifacts—are directly tied to the asserted safeguard and allow its actual operation to be corroborated. The gap being tested is abstract principles lack assigned operational controls and measurable compliance.
Incorrect Answers
A:“Approved notice language, delivery logs and complaints-handling evidence” would test required transparency and notice assessments were omitted from user experience, not the present safeguard against abstract principles lack assigned operational controls and measurable compliance. The expected audit evidence is “Control-to-principle trace and audited execution artifacts”.
B:“Supplier audit evidence, findings and accepted remediation plans” would test marketing attestations were accepted without independent evidence of risk controls, not the present safeguard against abstract principles lack assigned operational controls and measurable compliance. The expected audit evidence is “Control-to-principle trace and audited execution artifacts”.
D:“Sampled appeal cases, reversal authority and applicant notification records” would test human rights and contestability were not incorporated into consequential AI decision design, not the present safeguard against abstract principles lack assigned operational controls and measurable compliance. The expected audit evidence is “Control-to-principle trace and audited execution artifacts”.
Question 141
In a review of Leading Practices, Ethics, Regulations, and Standards for AI, investigators cannot establish the expected control proof: control-to-principle trace and audited execution artifacts. The underlying event was that an AI ethics charter is displayed publicly but product teams have no documented control implementation. Which control weakness is the MOST likely cause requiring focused audit work?
- Required transparency and notice assessments were omitted from user experience
- Abstract principles lack assigned operational controls and measurable compliance
- Marketing attestations were accepted without independent evidence of risk controls
- Human rights and contestability were not incorporated into consequential AI decision design
Explanation
Correct Answer
B:Correct. The observed condition specifically indicates abstract principles lack assigned operational controls and measurable compliance. A meaningful audit response is to verify this diagnosis and then recommend map ethics principles to lifecycle controls with evidence owners and independent testing.
Incorrect Answers
A:“Required transparency and notice assessments were omitted from user experience” concerns a separate audit weakness, not the missing assurance described by abstract principles lack assigned operational controls and measurable compliance. The correct cause is “Abstract principles lack assigned operational controls and measurable compliance”.
C:“Marketing attestations were accepted without independent evidence of risk controls” concerns a separate audit weakness, not the missing assurance described by abstract principles lack assigned operational controls and measurable compliance. The correct cause is “Abstract principles lack assigned operational controls and measurable compliance”.
D:“Human rights and contestability were not incorporated into consequential AI decision design” concerns a separate audit weakness, not the missing assurance described by abstract principles lack assigned operational controls and measurable compliance. The correct cause is “Abstract principles lack assigned operational controls and measurable compliance”.
Question 142
A team states that an AI system is compliant globally because it follows one voluntary AI standard. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Map binding obligations by use, geography and sector separately from voluntary guidance
- Assess local explanation fidelity and suitability for users and reviewers
- Evaluate necessity, less intrusive alternatives and employee safeguards
- Evaluate subgroup errors, likely harms and risk treatment before deployment
Explanation
Correct Answer
A:Correct. Map binding obligations by use, geography and sector separately from voluntary guidance is aimed at the actual failure: voluntary framework alignment was mistaken for jurisdiction-specific legal compliance. The audit should subsequently obtain jurisdictional obligation matrix and legal-reviewed control coverage to test execution, not merely the existence of a policy.
Incorrect Answers
B:“Assess local explanation fidelity and suitability for users and reviewers” is a control for explanations are not validated for individual decision context and audience, but the audit finding here is voluntary framework alignment was mistaken for jurisdiction-specific legal compliance. The relevant measure is “Map binding obligations by use, geography and sector separately from voluntary guidance”.
C:“Evaluate necessity, less intrusive alternatives and employee safeguards” is a control for workforce impacts and proportionality were excluded from deployment assessment, but the audit finding here is voluntary framework alignment was mistaken for jurisdiction-specific legal compliance. The relevant measure is “Map binding obligations by use, geography and sector separately from voluntary guidance”.
D:“Evaluate subgroup errors, likely harms and risk treatment before deployment” is a control for equity objectives and subgroup testing were excluded from ethical release criteria, but the audit finding here is voluntary framework alignment was mistaken for jurisdiction-specific legal compliance. The relevant measure is “Map binding obligations by use, geography and sector separately from voluntary guidance”.
Question 143
In an audit of Leading Practices, Ethics, Regulations, and Standards for AI, managers say this measure is live: Map binding obligations by use, geography and sector separately from voluntary guidance. They claim it corrected a material audit gap. What direct operating evidence would allow the auditor to substantiate that particular claim across a defensible sample?
- Reviewed case explanations, fidelity tests and comprehensibility feedback
- Workforce consultation record, proportionality analysis and monitoring limits
- Group-disaggregated false-match rates and approved mitigation threshold results
- Jurisdictional obligation matrix and legal-reviewed control coverage
Explanation
Correct Answer
D:Correct. The proposed records—jurisdictional obligation matrix and legal-reviewed control coverage—are directly tied to the asserted safeguard and allow its actual operation to be corroborated. The gap being tested is voluntary framework alignment was mistaken for jurisdiction-specific legal compliance.
Incorrect Answers
A:“Reviewed case explanations, fidelity tests and comprehensibility feedback” would test explanations are not validated for individual decision context and audience, not the present safeguard against voluntary framework alignment was mistaken for jurisdiction-specific legal compliance. The expected audit evidence is “Jurisdictional obligation matrix and legal-reviewed control coverage”.
B:“Workforce consultation record, proportionality analysis and monitoring limits” would test workforce impacts and proportionality were excluded from deployment assessment, not the present safeguard against voluntary framework alignment was mistaken for jurisdiction-specific legal compliance. The expected audit evidence is “Jurisdictional obligation matrix and legal-reviewed control coverage”.
C:“Group-disaggregated false-match rates and approved mitigation threshold results” would test equity objectives and subgroup testing were excluded from ethical release criteria, not the present safeguard against voluntary framework alignment was mistaken for jurisdiction-specific legal compliance. The expected audit evidence is “Jurisdictional obligation matrix and legal-reviewed control coverage”.
Question 144
In a review of Leading Practices, Ethics, Regulations, and Standards for AI, investigators cannot establish the expected control proof: jurisdictional obligation matrix and legal-reviewed control coverage. The underlying event was that a team states that an AI system is compliant globally because it follows one voluntary AI standard. Which control weakness is the MOST likely cause requiring focused audit work?
- Explanations are not validated for individual decision context and audience
- Workforce impacts and proportionality were excluded from deployment assessment
- Voluntary framework alignment was mistaken for jurisdiction-specific legal compliance
- Equity objectives and subgroup testing were excluded from ethical release criteria
Explanation
Correct Answer
C:Correct. The observed condition specifically indicates voluntary framework alignment was mistaken for jurisdiction-specific legal compliance. A meaningful audit response is to verify this diagnosis and then recommend map binding obligations by use, geography and sector separately from voluntary guidance.
Incorrect Answers
A:“Explanations are not validated for individual decision context and audience” concerns a separate audit weakness, not the missing assurance described by voluntary framework alignment was mistaken for jurisdiction-specific legal compliance. The correct cause is “Voluntary framework alignment was mistaken for jurisdiction-specific legal compliance”.
B:“Workforce impacts and proportionality were excluded from deployment assessment” concerns a separate audit weakness, not the missing assurance described by voluntary framework alignment was mistaken for jurisdiction-specific legal compliance. The correct cause is “Voluntary framework alignment was mistaken for jurisdiction-specific legal compliance”.
D:“Equity objectives and subgroup testing were excluded from ethical release criteria” concerns a separate audit weakness, not the missing assurance described by voluntary framework alignment was mistaken for jurisdiction-specific legal compliance. The correct cause is “Voluntary framework alignment was mistaken for jurisdiction-specific legal compliance”.
Question 145
A candidate-ranking tool never discloses that screening is automated to people affected. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Conduct participatory impact review and establish accessible challenge mechanisms
- Determine applicable disclosure duties and implement timely understandable notices
- Retain decision rationale, responsible official and meaningful challenge information
- Map ethics principles to lifecycle controls with evidence owners and independent testing
Explanation
Correct Answer
B:Correct. Determine applicable disclosure duties and implement timely understandable notices is aimed at the actual failure: required transparency and notice assessments were omitted from user experience. The audit should subsequently obtain approved notice language, delivery logs and complaints-handling evidence to test execution, not merely the existence of a policy.
Incorrect Answers
A:“Conduct participatory impact review and establish accessible challenge mechanisms” is a control for vulnerable stakeholder impact was absent from responsible AI assessment, but the audit finding here is required transparency and notice assessments were omitted from user experience. The relevant measure is “Determine applicable disclosure duties and implement timely understandable notices”.
C:“Retain decision rationale, responsible official and meaningful challenge information” is a control for public accountability requires traceable reasons and reviewed decision ownership, but the audit finding here is required transparency and notice assessments were omitted from user experience. The relevant measure is “Determine applicable disclosure duties and implement timely understandable notices”.
D:“Map ethics principles to lifecycle controls with evidence owners and independent testing” is a control for abstract principles lack assigned operational controls and measurable compliance, but the audit finding here is required transparency and notice assessments were omitted from user experience. The relevant measure is “Determine applicable disclosure duties and implement timely understandable notices”.
Question 146
In an audit of Leading Practices, Ethics, Regulations, and Standards for AI, managers say this measure is live: Determine applicable disclosure duties and implement timely understandable notices. They claim it corrected a material audit gap. What direct operating evidence would allow the auditor to substantiate that particular claim across a defensible sample?
- Approved notice language, delivery logs and complaints-handling evidence
- Impact-assessment minutes and targeted user testing of appeal paths
- Sampled decisions with provenance, reason codes and human signoff
- Control-to-principle trace and audited execution artifacts
Explanation
Correct Answer
A:Correct. The proposed records—approved notice language, delivery logs and complaints-handling evidence—are directly tied to the asserted safeguard and allow its actual operation to be corroborated. The gap being tested is required transparency and notice assessments were omitted from user experience.
Incorrect Answers
B:“Impact-assessment minutes and targeted user testing of appeal paths” would test vulnerable stakeholder impact was absent from responsible AI assessment, not the present safeguard against required transparency and notice assessments were omitted from user experience. The expected audit evidence is “Approved notice language, delivery logs and complaints-handling evidence”.
C:“Sampled decisions with provenance, reason codes and human signoff” would test public accountability requires traceable reasons and reviewed decision ownership, not the present safeguard against required transparency and notice assessments were omitted from user experience. The expected audit evidence is “Approved notice language, delivery logs and complaints-handling evidence”.
D:“Control-to-principle trace and audited execution artifacts” would test abstract principles lack assigned operational controls and measurable compliance, not the present safeguard against required transparency and notice assessments were omitted from user experience. The expected audit evidence is “Approved notice language, delivery logs and complaints-handling evidence”.
Question 147
In a review of Leading Practices, Ethics, Regulations, and Standards for AI, investigators cannot establish the expected control proof: approved notice language, delivery logs and complaints-handling evidence. The underlying event was that a candidate-ranking tool never discloses that screening is automated to people affected. Which control weakness is the MOST likely cause requiring focused audit work?
- Vulnerable stakeholder impact was absent from responsible AI assessment
- Public accountability requires traceable reasons and reviewed decision ownership
- Abstract principles lack assigned operational controls and measurable compliance
- Required transparency and notice assessments were omitted from user experience
Explanation
Correct Answer
D:Correct. The observed condition specifically indicates required transparency and notice assessments were omitted from user experience. A meaningful audit response is to verify this diagnosis and then recommend determine applicable disclosure duties and implement timely understandable notices.
Incorrect Answers
A:“Vulnerable stakeholder impact was absent from responsible AI assessment” concerns a separate audit weakness, not the missing assurance described by required transparency and notice assessments were omitted from user experience. The correct cause is “Required transparency and notice assessments were omitted from user experience”.
B:“Public accountability requires traceable reasons and reviewed decision ownership” concerns a separate audit weakness, not the missing assurance described by required transparency and notice assessments were omitted from user experience. The correct cause is “Required transparency and notice assessments were omitted from user experience”.
C:“Abstract principles lack assigned operational controls and measurable compliance” concerns a separate audit weakness, not the missing assurance described by required transparency and notice assessments were omitted from user experience. The correct cause is “Required transparency and notice assessments were omitted from user experience”.
Question 148
A vendor sells an AI decision model as 'fully explainable' but provides only generic feature rankings. From an AI audit perspective, which corrective action is the MOST direct response to the weakness described, rather than a useful control for some different AI risk?
- Obtain control-specific assurance, testing scope and material exception disclosure
- Integrate govern-map-measure-manage activities into change and operating cycles
- Assess local explanation fidelity and suitability for users and reviewers
- Map binding obligations by use, geography and sector separately from voluntary guidance
Explanation
Correct Answer
C:Correct. Assess local explanation fidelity and suitability for users and reviewers is aimed at the actual failure: explanations are not validated for individual decision context and audience. The audit should subsequently obtain reviewed case explanations, fidelity tests and comprehensibility feedback to test execution, not merely the existence of a policy.
Incorrect Answers
A:“Obtain control-specific assurance, testing scope and material exception disclosure” is a control for marketing attestations were accepted without independent evidence of risk controls, but the audit finding here is explanations are not validated for individual decision context and audience. The relevant measure is “Assess local explanation fidelity and suitability for users and reviewers”.
B:“Integrate govern-map-measure-manage activities into change and operating cycles” is a control for continuous governance and measurement were reduced to static documentation, but the audit finding here is explanations are not validated for individual decision context and audience. The relevant measure is “Assess local explanation fidelity and suitability for users and reviewers”.
D:“Map binding obligations by use, geography and sector separately from voluntary guidance” is a control for voluntary framework alignment was mistaken for jurisdiction-specific legal compliance, but the audit finding here is explanations are not validated for individual decision context and audience. The relevant measure is “Assess local explanation fidelity and suitability for users and reviewers”.
Question 149
In an audit of Leading Practices, Ethics, Regulations, and Standards for AI, managers say this measure is live: Assess local explanation fidelity and suitability for users and reviewers. They claim it corrected a material audit gap. What direct operating evidence would allow the auditor to substantiate that particular claim across a defensible sample?
- Supplier audit evidence, findings and accepted remediation plans
- Reviewed case explanations, fidelity tests and comprehensibility feedback
- Versioned risk records, monitored outcomes and management-action closure
- Jurisdictional obligation matrix and legal-reviewed control coverage
Explanation
Correct Answer
B:Correct. The proposed records—reviewed case explanations, fidelity tests and comprehensibility feedback—are directly tied to the asserted safeguard and allow its actual operation to be corroborated. The gap being tested is explanations are not validated for individual decision context and audience.
Incorrect Answers
A:“Supplier audit evidence, findings and accepted remediation plans” would test marketing attestations were accepted without independent evidence of risk controls, not the present safeguard against explanations are not validated for individual decision context and audience. The expected audit evidence is “Reviewed case explanations, fidelity tests and comprehensibility feedback”.
C:“Versioned risk records, monitored outcomes and management-action closure” would test continuous governance and measurement were reduced to static documentation, not the present safeguard against explanations are not validated for individual decision context and audience. The expected audit evidence is “Reviewed case explanations, fidelity tests and comprehensibility feedback”.
D:“Jurisdictional obligation matrix and legal-reviewed control coverage” would test voluntary framework alignment was mistaken for jurisdiction-specific legal compliance, not the present safeguard against explanations are not validated for individual decision context and audience. The expected audit evidence is “Reviewed case explanations, fidelity tests and comprehensibility feedback”.
Question 150
In a review of Leading Practices, Ethics, Regulations, and Standards for AI, investigators cannot establish the expected control proof: reviewed case explanations, fidelity tests and comprehensibility feedback. The underlying event was that a vendor sells an AI decision model as 'fully explainable' but provides only generic feature rankings. Which control weakness is the MOST likely cause requiring focused audit work?
- Explanations are not validated for individual decision context and audience
- Marketing attestations were accepted without independent evidence of risk controls
- Continuous governance and measurement were reduced to static documentation
- Voluntary framework alignment was mistaken for jurisdiction-specific legal compliance
Explanation
Correct Answer
A:Correct. The observed condition specifically indicates explanations are not validated for individual decision context and audience. A meaningful audit response is to verify this diagnosis and then recommend assess local explanation fidelity and suitability for users and reviewers.
Incorrect Answers
B:“Marketing attestations were accepted without independent evidence of risk controls” concerns a separate audit weakness, not the missing assurance described by explanations are not validated for individual decision context and audience. The correct cause is “Explanations are not validated for individual decision context and audience”.
C:“Continuous governance and measurement were reduced to static documentation” concerns a separate audit weakness, not the missing assurance described by explanations are not validated for individual decision context and audience. The correct cause is “Explanations are not validated for individual decision context and audience”.
D:“Voluntary framework alignment was mistaken for jurisdiction-specific legal compliance” concerns a separate audit weakness, not the missing assurance described by explanations are not validated for individual decision context and audience. The correct cause is “Explanations are not validated for individual decision context and audience”.