CSPAI practice question 10 of 10
What is a common use of an LLM as a Secondary Chatbot?
Full set: 50 questionsIn a tiered or hybrid conversational AI architecture, a Large Language Model (LLM) is commonly used as a secondary system. The primary system, often a more specialized or rule-based bot, handles frequent and straightforward queries efficiently. When the primary bot encounters a query that is too complex, ambiguous, or outside its predefined scope, it escalates the interaction to the secondary LLM. This LLM then uses its broader knowledge and generative capabilities to provide a more nuanced or comprehensive answer, thus serving as a fallback or supplementary assistant to ensure a robust user experience and prevent conversation failure.
B. The term "secondary" explicitly defines a supporting or subordinate role, not a replacement for the primary system.
C. A secondary chatbot's function is to support the primary application's objectives, not to divert to unrelated tasks, which would degrade the user experience.
D. Managing user credentials is a highly sensitive security function that requires specialized, secure modules, not a general-purpose generative AI.
1. Gao
J.
Galley
M.
& Li
L. (Eds.). (2022). Neural Approaches to Conversational AI. Now Foundations and Trends. This text discusses hybrid systems where a task-oriented dialogue system (primary) can hand off to an open-domain chit-chat model like an LLM (secondary) for out-of-scope queries. (See Chapter 1
Section 1.2: "Task-Oriented Dialogue Systems vs. Open-Domain Chatbots").
2. Jurafsky
D.
& Martin
J. H. (2023). Speech and Language Processing (3rd ed. draft). Stanford University. Chapter 25
"Chatbots & Dialogue Systems
" describes architectures where simpler retrieval-based or frame-based systems can be augmented with generative models (like LLMs) to handle the "long tail" of more complex user utterances. This establishes the principle of a secondary
more powerful system.
3. Adamopoulou
E.
& Moussiades
L. (2020). An Overview of Chatbot Technology. In IFIP International Conference on Artificial Intelligence Applications and Innovations (pp. 373-383). Springer. DOI: https://doi.org/10.1007/978-3-030-49186-431. This paper discusses hybrid models (p. 378) that combine the strengths of different approaches
where a generative model can supplement a retrieval-based or rule-based one
aligning with the secondary/fallback use case.
Keep practicing
Take the free CSPAI practice test
Ten exam-style questions with answers and explanations, plus the exam facts and study guides.
More questions
Other CSPAI practice questions
- Question 1In a Retrieval-Augmented Generation (RAG) system, which key step is crucial for ensuring …
- Question 2In ISO 42001, what is required for AI risk treatment?
- Question 3Which of the following describes the scenario where an LLM is embedded 'As-is' into an ap…
- Question 4Which of the following is a potential use case of Generative AI specifically tailored for…
- Question 5Which of the following is a method in which simulation of various attack scenarios are ap…
- Question 6How does AI enhance customer experience in retail environments?
