CSPAI practice question 10 of 10

What is a common use of an LLM as a Secondary Chatbot?

Full set: 50 questions
Answer options
A: To serve as a fallback or supplementary AI assistant for more complex queries Correct answer
B: To replace the primary AI system
C: To handle tasks unrelated to the main application
D: To only manage user credentials
Correct Answer:
A. To serve as a fallback or supplementary AI assistant for more complex queries
Explanation

In a tiered or hybrid conversational AI architecture, a Large Language Model (LLM) is commonly used as a secondary system. The primary system, often a more specialized or rule-based bot, handles frequent and straightforward queries efficiently. When the primary bot encounters a query that is too complex, ambiguous, or outside its predefined scope, it escalates the interaction to the secondary LLM. This LLM then uses its broader knowledge and generative capabilities to provide a more nuanced or comprehensive answer, thus serving as a fallback or supplementary assistant to ensure a robust user experience and prevent conversation failure.

Why Incorrect

B. The term "secondary" explicitly defines a supporting or subordinate role, not a replacement for the primary system.
C. A secondary chatbot's function is to support the primary application's objectives, not to divert to unrelated tasks, which would degrade the user experience.
D. Managing user credentials is a highly sensitive security function that requires specialized, secure modules, not a general-purpose generative AI.

References

1. Gao

J.

Galley

M.

& Li

L. (Eds.). (2022). Neural Approaches to Conversational AI. Now Foundations and Trends. This text discusses hybrid systems where a task-oriented dialogue system (primary) can hand off to an open-domain chit-chat model like an LLM (secondary) for out-of-scope queries. (See Chapter 1

Section 1.2: "Task-Oriented Dialogue Systems vs. Open-Domain Chatbots").

2. Jurafsky

D.

& Martin

J. H. (2023). Speech and Language Processing (3rd ed. draft). Stanford University. Chapter 25

"Chatbots & Dialogue Systems

" describes architectures where simpler retrieval-based or frame-based systems can be augmented with generative models (like LLMs) to handle the "long tail" of more complex user utterances. This establishes the principle of a secondary

more powerful system.

3. Adamopoulou

E.

& Moussiades

L. (2020). An Overview of Chatbot Technology. In IFIP International Conference on Artificial Intelligence Applications and Innovations (pp. 373-383). Springer. DOI: https://doi.org/10.1007/978-3-030-49186-431. This paper discusses hybrid models (p. 378) that combine the strengths of different approaches

where a generative model can supplement a retrieval-based or rule-based one

aligning with the secondary/fallback use case.

Scroll to Top