SLED

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2025 Oct 28 0:2
Editor
Edited
Edited
2025 Oct 28 0:4

Self Logits Evolution Decoding

A new decoding method that improves factuality by utilizing logit information from all layers. It reduces hallucinations by aligning the model's internal knowledge without external data or additional fine-tuning. SLED reuses logits from all layers to obtain probability distributions for each, then combines them via weighted average to select more accurate tokens.
 
 
 
 
 
 

Recommendations