AI Hallucination

Creator

Creator

Seonglae Cho

Created

Created

2023 Mar 20 7:41

Editor

Editor

Seonglae Cho

Edited

Edited

2024 Dec 21 14:50

Refs

Refs

Contrastive Learning

LLMs hallucinate when fine-tuned with new factual knowledge, as they learn new information slower than consistent knowledge

notion image

AI Hallucination Notion

Hallucination Benchmark

Extrinsic hallucination

Intrinsic hallucination

LLMs Will Always Hallucinate, and We Need to Live With This

As Large Language Models become more ubiquitous across domains, it becomes important to examine their inherent limitations critically. This work argues that hallucinations in language models are...

LLMs Will Always Hallucinate, and We Need to Live With This

https://arxiv.org/abs/2409.05746

LLMs Will Always Hallucinate, and We Need to Live With This

The Internal State of an LLM Knows When It’s Lying

arXiv reCAPTCHA

arXiv reCAPTCHA

https://arxiv.org/pdf/2304.13734

https://arxiv.org/pdf/2310.07064.pdf

Bigger AI chatbots more inclined to spew nonsense

Bigger AI chatbots more inclined to spew nonsense — and people don't always realize

Nature - Artificial-intelligence models are improving overall but are more likely to answer every question, leading to wrong answers.

Bigger AI chatbots more inclined to spew nonsense — and people don't always realize

https://www.nature.com/articles/d41586-024-03137-3

Bigger AI chatbots more inclined to spew nonsense — and people don't always realize

Masking

Retrieval Head or relevant

Induction head could induce hallucinations

https://arxiv.org/pdf/2410.18860

Recommendations

/////////