NCP-AAI practice question 4 of 25

You are designing an AI agent for summarizing medical documents that include images and text as well. It must extract key information and recognize dates. Which feature is most critical for ensuring the agent performs well across multiple input and output formats?

Full set: 118 questions
Answer options
A: Use of guardrails to filter out hallucinated content
B: Retry logic implementation to ensure robustness during API failures
C: Chain-of-thought prompting for reasoning accuracy
D: Multi-modal model integration to handle both text and vision inputs Correct answer
Correct Answer:
D. Multi-modal model integration to handle both text and vision inputs
Explanation

The core requirement is to process documents containing both images and text. A multi-modal model is specifically designed to understand and process information from multiple data types (modalities) simultaneously. Integrating such a model is the most critical and fundamental feature, as it enables the agent to comprehend the entire context of the medical document, including text-based reports and visual data like charts, scans, or diagrams. Without this capability, the agent cannot fulfill its primary function, making other features like guardrails or retry logic secondary.

Why Incorrect

A. Guardrails are for output validation and safety; they do not enable the agent to process the required multi-modal inputs in the first place.
B. Retry logic enhances robustness against network or API issues but is not a core feature for handling the specific data formats of the task.
C. Chain-of-thought prompting improves reasoning on textual data but does not address the fundamental need to process and understand image inputs.

References

1. Radford, A., et al. (2021). Learning Transferable Visual Models From Natural Language Supervision. Proceedings of the 38th International Conference on Machine Learning. (This paper introduces CLIP, a foundational model for connecting text and images, demonstrating the principles of multi-modal integration).

2. NVIDIA. (2024). NVIDIA NeMo Multimodal. NVIDIA Developer Documentation. (Official documentation describing NVIDIA's framework for building and customizing multi-modal AI models capable of processing vision, speech, and language).

3. MIT 6.S191: Introduction to Deep Learning. (2023). Lecture on Vision and Language. Massachusetts Institute of Technology: MIT OpenCourseWare. (Course materials explain the architectures and importance of multi-modal models for tasks that combine different data types).

Scroll to Top