Token type implemented by enum and specified as Regular Expression each types are easy to enum or hard to enum (e.g. finite keywords)subscriptexpressionAssign Expressionoperatorkeywordsspecial symbolsnumberidentifierwhitespace