NCP-AAI practice question 1 of 25

Which two design goals are MOST important for human-in-the-loop agent systems in regulated workflows?

Full set: 118 questions
Answer options
A: Review checkpoints for human approval Correct answer
B: Clear explanation of agent actions Correct answer
C: Complete removal of audit trails
D: Automatic execution without oversight in all cases
E: Hidden decision logic
Correct Answer:
A. Review checkpoints for human approval; B. Clear explanation of agent actions
Explanation

In regulated workflows (e.g., finance, healthcare), accountability, transparency, and safety are non-negotiable. A human-in-the-loop (HITL) system must therefore include "review checkpoints for human approval" (A) to ensure a human expert can verify and authorize critical decisions or actions before they are executed. For this review to be effective, the system must also provide a "clear explanation of agent actions" (B), detailing the reasoning and data used. This explainability is fundamental for trust, auditing, and regulatory compliance.

Why Incorrect

C. Complete removal of audit trails is the opposite of what is required for regulatory compliance and accountability.
D. Automatic execution without oversight contradicts the core principle of HITL and is unacceptable in high-risk, regulated environments.
E. Hidden decision logic prevents human oversight and auditing, making the system opaque and untrustworthy.

References

1. Stanford University Human-Centered AI Institute (HAI). (2021). Building Human-Centered AI: A Multidisciplinary Perspective. Section on "Explainability and Interpretability." The publication emphasizes that for AI systems to be trusted, especially in high-stakes domains, they must be able to explain their decisions to human users.

2. Doshi-Velez, F., & Kim, B. (2017). Towards A Rigorous Science of Interpretable Machine Learning. arXiv:1702.08608. This foundational paper on interpretability argues that in domains requiring safety and trust, such as regulated industries, explaining model decisions is a primary goal.

Scroll to Top