Next Token Prediction

Creator
Creator
Seonglae Cho
Created
Created
2023 Jul 17 9:40
Editor
Edited
Edited
2025 Jun 15 22:53

Text Generation, Token generation,
Causal language model

When we have conversations, we use context to predict and generate the next word. This process happens somewhere between consciousness and unconsciousness, sometimes we're aware of it and sometimes we're not.
Ilya Sutskever
realized the importance of next word prediction while working as an SEO expert analyzing search inputs. This process is an
AI Function Imitation
of human consciousness, just as
Back Propagation
is a functional imitation of
Neuroplasticity
.
Text Generation Notion
 
 
 
 

Trivial for inverse unavailable function

Multi Token Prediction

 
 

Recommendations