AI-103 practice question 5 of 15

Note: This section contains one or more sets of questions with the same scenario and problem. Each question presents a unique solution to the…

Choose your answer, then check it against the explanation.

Note: This section contains one or more sets of questions with the same scenario and problem. Each question presents a unique solution to the problem. You must determine whether the solution meets the stated goals. More than one solution in the set might solve the problem. It is also possible that none of the solutions in the set solve the problem. After you answer a question in this section, you will NOT be able to return. As a result, these questions do not appear on the Review Screen. You have a multimodal AI generative model that accepts image uploads and uses extracted image text to generate responses. You discover that users can upload unsafe images and embed hidden instructions into images to manipulate the model. You need to implement controls to mitigate the risk. Solution: You configure image moderation to block unsafe content before processing the images. Does this meet the goal?

Answer options

Correct Answer:

Explanation

The proposed solution is incomplete. While configuring image moderation effectively addresses the risk of users uploading visually unsafe content (e.g., adult, violent, or gory images), it does not mitigate the second, equally critical risk of prompt injection. Prompt injection involves embedding hidden instructions as text within the image. Standard image moderation services are designed to analyze and classify the visual content of an image based on safety categories, not to parse and analyze the semantic meaning of embedded text for malicious instructions. Therefore, the model remains vulnerable to manipulation through this vector, and the solution does not fully meet the stated goal.

Why Incorrect

A. Yes: This is incorrect because the solution only addresses one of the two identified risks. It fails to protect against prompt injection attacks delivered via text within the images.

References

1. Microsoft Learn, Azure AI Content Safety, "Image moderation concepts." This document specifies that the image moderation service detects content in four categories: hate, self-harm, sexual, and violence. It makes no mention of detecting or mitigating prompt injection instructions embedded as text within an image. This confirms that image moderation is for visual safety, not instruction analysis. (Reference: learn.microsoft.com/en-us/azure/ai-services/content-safety/concepts/image-moderation, Section: "Categories")

2. Microsoft Learn, Azure OpenAI Service, "Prompt injection." This official documentation defines prompt injection as a user-driven vulnerability where the large language model is manipulated by malicious user input. The mitigations discussed, such as grounding and prompt engineering, are distinct from visual image moderation, highlighting that different controls are needed for this type of risk. (Reference: learn.microsoft.com/en-us/azure/ai-services/openai/concepts/prompt-injection, Section: "What is prompt injection?")

3. Microsoft, "Transparency Note for Azure OpenAI Service" (for GPT-4 Turbo with Vision). This document explicitly separates the risks of multimodal models. It discusses "Harmful content generation" and the use of an "image moderation filter" to detect unsafe visual content. Separately, it discusses "Jailbreak vulnerabilities" (a form of prompt injection) as a distinct risk that requires different mitigation strategies. This source directly supports that image moderation alone is insufficient to handle both risks. (Reference: learn.microsoft.com/en-us/legal/cognitive-services/openai/transparency-note-vision, Section: "Mitigating risks and responsible AI")

Question 5 of 15

Keep practicing

Take the free AI-103 practice test

Ten exam-style questions with answers and explanations, plus the exam facts and study guides.

Start the free practice test