C1000-185 practice question 16 of 35

You are working with a Generative AI model to generate a summary of a large financial report. To reduce costs, you are exploring different model parameters such as minimum and maximum token limits. Which configuration would help minimize generation costs while ensuring an accurate summary of the document?

Domain Reporting and Auditing

Answer options

A: Set both the minimum and maximum token limits to 1,000 to ensure the entire report is captured in detail, with no important information left out.

B: Set the maximum token limit to 500 and the minimum token limit to 250 to ensure a balanced summary of key sections with some detailed

C: Set the maximum token limit to 300 and the minimum token limit to 0, allowing the model to generate a brief summary of the most relevant points while avoiding excessive verbosity. Correct answer

D: Set the maximum token limit to 700 and the minimum token limit to 600 to ensure a well-rounded summary with all necessary sections and detailed information included.

Correct Answer:

C. Set the maximum token limit to 300 and the minimum token limit to 0, allowing the model to generate a brief summary of the most relevant points while avoiding excessive verbosity.

Explanation

To minimize generation costs, the primary goal is to reduce the number of tokens the model generates. Setting the maximum token limit to a low value, such as 300, places a hard cap on the output length and, therefore, the maximum cost. Setting the minimum token limit to 0 is crucial for cost-effectiveness; it allows the model the flexibility to generate a summary that is as concise as possible. The model is not forced to produce unnecessary "filler" text to meet a minimum threshold, ensuring that you only pay for the most relevant and succinct output. This configuration directly supports the dual goals of cost minimization and accurate, brief summarization.

Why Incorrect

A. Forcing a fixed, high token count (1,000) is extremely expensive and contradicts the goal of creating a concise summary.
B. A minimum of 250 tokens may force the model to generate more content than necessary, increasing costs if a shorter summary is adequate.
D. This configuration mandates a very long summary (600-700 tokens), which is the most expensive option and opposes the objective of cost minimization.

References

1. IBM Cloud Documentation - watsonx.ai: In the documentation for foundation model inference parameters

the Min new tokens and Max new tokens parameters are defined. The default for Min new tokens is 0

allowing for variable-length

concise outputs. The Max new tokens parameter directly controls the upper limit of the generation. For cost-effective summarization

a low Max and a Min of 0 is the optimal strategy.

Source: IBM Cloud Docs

"Foundation model inference parameters"

Section: "Decoding parameters". (Specifically

the descriptions for Min new tokens and Max new tokens).

2. IBM Developer - Introduction to watsonx.ai and foundation models: Tutorials and introductory materials explain that the cost of using foundation models is often tied to the number of input and output tokens. Therefore

controlling the output length via parameters like maxnewtokens is a fundamental technique for managing expenses.

Source: IBM Developer

"Get started with watsonx.ai"

Section: "Prompt Lab". (This section discusses tuning parameters like Max tokens to control model output).

Keep practicing

Take the free C1000-185 practice test

Ten exam-style questions with answers and explanations, plus the exam facts and study guides.

Start the free practice test