Min-p Sampling

Creator
Creator
Seonglae Cho
Created
Created
2025 Feb 16 12:20
Editor
Edited
Edited
2025 Feb 16 12:23
Refs
Refs

Dynamic selection for minimum p

When the model shows high confidence, it selects only high-probability tokens to maintain consistency, and when confidence is low, it includes more diverse candidates to ensure creativity
It can maintain both creativity and consistency even in high-temperature environments, and operates more flexibly than conventional top-p sampling

minimum probability threshold

pbase×pmax=thresholdp_{base} \times p_{max} = threshold
 
 
 
 
 

Recommendations