Seonglae ChoSemantic entropy: Calculates entropy over "meaning clusters" rather than "token probabilities". Strong for hallucination detection
Semantic uncertainty, ICLR 2023 Lorenz
In natural language generation (NLG), measuring uncertainty properly requires looking beyond simple token-level probabilities to semantic-level uncertainty
Semantic Uncertainty: Linguistic Invariances for Uncertainty...
Semantic entropy is a novel uncertainty estimation method for natural language generation that captures uncertainty over meanings rather than sequences.
https://openreview.net/forum?id=VD-AYtP0dve
Semantic Entropy Nature 2024