CCAR-P practice question 3 of 10

An architect is reviewing a Claude-based candidate-screening tool prior to deployment. A stakeholder asserts that because the model was not trained on company data, no bias evaluation is necessary. Which two responses most accurately challenge this assertion? (Select two.)

Full set: 142 questions
Answer options
A: Transparency obligations are satisfied by disclosing that an AI system is in use, without further evaluation.
B: Fairness testing is required only when the training dataset is known to contain protected-class labels.
C: The model may carry demographic biases from pretraining that manifest in screening outcomes regardless of fine-tuning. Correct answer
D: The system should be evaluated on outcome-disparity metrics across protected groups before deployment. Correct answer
E: Bias evaluation is unnecessary when the model provider has published a responsible-use policy.
Correct Answer:
C. The model may carry demographic biases from pretraining that manifest in screening outcomes regardless of fine-tuning.; D. The system should be evaluated on outcome-disparity metrics across protected groups before deployment.
Explanation

Even if an LLM is not explicitly trained on a company's proprietary data, it inherits demographic and societal biases from its massive pretraining corpora. In high-stakes domains like employment screening, these latent biases can manifest as discriminatory outcomes against protected classes. Therefore, it is imperative to rigorously evaluate the integrated system using outcome-disparity metrics across protected groups before deployment, ensuring the application complies with fairness standards and ethical AI guidelines.

Why Incorrect

A. Transparency (disclosing AI use) is a separate ethical requirement and does not mitigate or measure the actual bias present in the system's decisions.
B. Bias can emerge from proxy variables and semantic associations in the pretraining data, even if explicit protected-class labels are absent from the prompt.
E. A vendor's responsible-use policy is a guideline, not a technical guarantee; the deploying organization remains responsible for evaluating fairness in their specific application context.

References

1. Anthropic Research (2023)

"Evaluating and Mitigating Discrimination in Language Model Decisions".

2. NIST Artificial Intelligence Risk Management Framework (AI RMF 1.0)

Section 4.1 (Fairness and Bias)

pp. 22-24. https://doi.org/10.6028/NIST.AI.100-1

Scroll to Top