CSPAI practice question 8 of 10
What metric is often used in GenAI risk models to evaluate bias?
Full set: 50 questionsGenAI risk models evaluate bias by using quantitative fairness metrics. These metrics are specifically designed to measure disparities in model performance across different demographic groups (e.g., race, gender). Metrics like demographic parity (or statistical parity) ensure that the proportion of positive outcomes is similar across groups, while equalized odds ensures that the true positive rate and false positive rate are equal across groups. These are standard, technical measures for identifying and quantifying systemic bias in a model's predictions, which is a critical component of responsible AI governance and risk management.
A. Accuracy rate without considering demographics is incorrect because high overall accuracy can mask severe underperformance and bias against specific minority subgroups.
C. Computational efficiency during training measures resource consumption (time, memory) and is unrelated to the fairness or ethical implications of the model's outputs.
D. The number of parameters in the model relates to its complexity and capacity, not its fairness. A model can be biased regardless of its size.
1. National Institute of Standards and Technology (NIST). (2023). AI Risk Management Framework (AI RMF 1.0). NIST AI 100-1. In the discussion of the "MAP" function, the framework emphasizes measuring for bias: "Approaches to test, evaluate, verify, and validate (TEVV) AI systems for bias include... statistical and conditional statistical parity..." (p. 29). This directly supports the use of fairness metrics.
2. Verma, S., & Rubin, J. (2018). Fairness Definitions Explained. In Proceedings of the 2018 ACM/IEEE International Workshop on Software Fairness (FairWare). This paper provides a formal overview of fairness metrics, stating, "Statistical Parity (a.k.a. Demographic Parity)... requires that the prediction... be independent of the protected attribute" (Section 3.1, p. 2). It also defines Equalized Odds (Section 3.2). DOI: https://doi.org/10.1145/3194770.3194776
3. Stanford University. (2021). CS224N: Natural Language Processing with Deep Learning - Lecture 18: Fairness, Accountability, Transparency, and Ethics in NLP. The lecture notes explicitly discuss fairness metrics for bias evaluation, covering "Group Fairness: Equalized Odds" and "Group Fairness: Demographic Parity" as key methods to assess model bias across different populations (Slides 35-40). Available at: https://web.stanford.edu/class/cs224n/slides/cs224n-2021-lecture-18-FATE.pdf
Keep practicing
Take the free CSPAI practice test
Ten exam-style questions with answers and explanations, plus the exam facts and study guides.
More questions
Other CSPAI practice questions
- Question 1In a Retrieval-Augmented Generation (RAG) system, which key step is crucial for ensuring …
- Question 2In ISO 42001, what is required for AI risk treatment?
- Question 3Which of the following describes the scenario where an LLM is embedded 'As-is' into an ap…
- Question 4Which of the following is a potential use case of Generative AI specifically tailored for…
- Question 5Which of the following is a method in which simulation of various attack scenarios are ap…
- Question 6How does AI enhance customer experience in retail environments?
