Decoding Strategy

Creator

Creator

Seonglae Cho

Created

Created

2024 Oct 22 14:57

Editor

Editor

Seonglae Cho

Edited

Edited

2025 Feb 16 12:16

Refs

Refs

Model Layer Scaling

Reasoning Model

Tokenizer Substitute

Distribution Sampling

Decoding Algorithm

Decoding Strategies

Multi Token Prediction

Lookahead Decoding

Jacobi Decoding

Prompt lookup Decoding

Speculative Decoding

Nucleus Sampling

Structured Output

Constrained Decoding

Recommendations

/////////