Seonglae ChoEach feature mutually increases the token probability, creating a feature loop which sometime breaks the model capability without repetition penalty (Halting Problem)
Types
Single node loop
Two-node system
- Unicode prefix, suffix predictors (Tamil, Chinese)
Complex multi-node Finite State Automata (HTML)
