Texonom
Texonom
/
Engineering
Engineering
/Data Engineering/Artificial Intelligence/Machine Learning/Neural Network/Neural Network Structure/Seq2Seq/Autoregressive Model/
Decoding Strategy
Search

Decoding Strategy

Creator
Creator
Seonglae Cho
Created
Created
2024 Oct 22 14:57
Editor
Editor
Seonglae Cho
Edited
Edited
2025 Feb 16 12:16
Refs
Refs
Attention Sink
Model Layer Scaling
Reasoning Model
Tokenizer Substitute
Distribution Sampling

Decoding Algorithm

Decoding Strategies
Multi Token Prediction
Beam search
Lookahead Decoding
Jacobi Decoding
Prompt lookup Decoding
Speculative Decoding
Nucleus Sampling
Min-p Sampling
 
 
 
 
 
 
 

Backlinks

Special TokenText TokenizerAI ScalingProbability DistributionLanguage Model

Recommendations

Texonom
Texonom
/
Engineering
Engineering
/Data Engineering/Artificial Intelligence/Machine Learning/Neural Network/Neural Network Structure/Seq2Seq/Autoregressive Model/
Decoding Strategy
Copyright Seonglae Cho