Text Generation, Token generation, Causal language model
When we have conversations, we use context to predict and generate the next word. This process happens somewhere between consciousness and unconsciousness, sometimes we're aware of it and sometimes we're not. Ilya Sutskever realized the importance of next word prediction while working as an SEO expert analyzing search inputs. This process is an AI Function Imitation of human consciousness, just as Back Propagation is a functional imitation of Neuroplasticity.
Text Generation Notion
Trivial for inverse unavailable function
Multi Token Prediction
facebook/multi-token-prediction · Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
https://huggingface.co/facebook/multi-token-prediction

Seonglae Cho