What does the term "hallucination" refer to in the context of Large Language Models (LLMs)?

In the context of Large Language Models (LLMs), "hallucination" refers to the model generating content that is factually incorrect, nonsensical, or not grounded in the provided source data, yet presented with a high degree of confidence as if it were true. This phenomenon occurs because LLMs are probabilistic systems designed to predict the next most likely sequence of words based on their training data, rather than accessing a knowledge base to verify facts. As a result, they can invent details, fabricate sources, or create plausible-sounding but entirely false information. Mitigating hallucinations is a primary challenge in ensuring the reliability and trustworthiness of generative AI applications.

A. This describes creativity. While related, "hallucination" specifically refers to the undesirable generation of falsehoods, not desired imaginative output.
B. This is incorrect. Hallucination is a significant problem to be mitigated, not a technique used to improve model performance.
C. This describes a capability of multimodal models (e.g., image-to-text generation), not the definition of the term "hallucination."

1. Oracle Cloud Infrastructure (OCI) Documentation: In the official OCI Generative AI service FAQs, Oracle defines the term directly: "What is a hallucination? A hallucination is when a large language model (LLM) generates text that is nonsensical or not factually correct. Mitigating hallucinations is a key challenge in the field of generative AI."

Source: Oracle Cloud Infrastructure Documentation, "Generative AI - FAQs," Section: "What is a hallucination?".

2. Academic Publication: A comprehensive survey on the topic defines the phenomenon as follows: "Despite their remarkable capabilities, LLMs are prone to generating content that is nonsensical, unfaithful to the provided source, or otherwise untruthful. This phenomenon is commonly referred to as hallucination."

Source: Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., ... & Fung, P. (2023). Survey of Hallucination in Natural Language Generation. ACM Computing Surveys, 55(12), Article 357, p. 2. DOI: https://doi.org/10.1145/3571730

3. University Courseware: Stanford University's Human-Centered AI Institute (HAI) explains the concept in its foundational materials: "When a large language model (LLM) generates text that is nonsensical or untethered from reality, it is said to be hallucinating... The model is simply generating a statistically likely sequence of words, and sometimes that sequence doesn’t align with our reality."

Source: Stanford University Human-Centered AI (HAI), "How to Tame AI Hallucinations," Published May 16, 2023.