Nucleus Sampling

Creator
Creator
Seonglae Cho
Created
Created
2025 Feb 16 12:19
Editor
Edited
Edited
2025 Mar 6 12:32
Refs
Refs

Top-p sampling

At each step, select the top tokens until their cumulative probability reaches p or higher, then randomly choose one token from this selected set according to their probabilities
This method only includes tokens in the sampling that make up the top p percentile
 
 
 
 
 
 
 

Recommendations