When preparing to test agents in AI Agent Studio, how do you use evaluation test data?

In Oracle AI Agent Studio, evaluation test data is used for offline testing to measure an agent's performance. This process involves uploading a dataset, typically a CSV file, containing a collection of test inputs (e.g., user questions) and their corresponding ideal or "ground truth" reference answers. The studio then processes these inputs through the agent and compares the agent's generated responses against the provided reference answers. This comparison allows developers to quantitatively assess the agent's accuracy, relevance, and overall quality before deploying it, providing key metrics to guide improvements.

A. Evaluation data is used to measure performance, not to automatically fine-tune the underlying Large Language Model (LLM). Fine-tuning is a separate, explicit training process that uses a different dataset.

C. The business objects available to an agent at runtime are determined by its configuration, specifically the tools and data sources it is connected to, not by the evaluation test sets.

1. Oracle Digital Assistant Documentation - AI Agent Studio: In the section "Test and Evaluate Your Agent

" the documentation states: "You can evaluate your agent by uploading a CSV file with test inputs and reference answers. The evaluation process runs the test inputs through the agent and compares the agent's responses to the reference answers." This directly supports the process described in the correct answer. (Source: Oracle Help Center

Using Oracle Digital Assistant

Chapter: AI Agent Studio

Section: Test and Evaluate Your Agent).

2. Oracle Digital Assistant Documentation - AI Agent Studio: The documentation further clarifies the evaluation output: "After the evaluation is complete

you can view the results

which include a comparison of the agent's response to the reference answer for each test input." This confirms the purpose is performance comparison

not configuration or fine-tuning. (Source: Oracle Help Center

Using Oracle Digital Assistant

Chapter: AI Agent Studio

Section: Test and Evaluate Your Agent).