Top-p sampling
At each step, select the top tokens until their cumulative probability reaches
p
or higher, then randomly choose one token from this selected set according to their probabilitiesThis method only includes tokens in the sampling that make up the top
p
percentile