Token Delimiter

Creator

Creator

Created

Created

2022 Sep 30 3:31

Editor

Editor

Edited

Edited

2022 Oct 5 3:13

Refs

Refs

token can be delimeter (all characters are composing tokens except whitespace)

A delimiter ends a token, but not part of that token

lookahead one char

Symbols: Delimiters

Delimiters are pairs of symbols used in the symbolic language either for enclosing expressions or as operators.

https://abstractmath.org/MM/MMDelimiters.htm

Tokens and Delimiters

Yes. This would be a nice exercise. After filling azBuffer with characters it could be examined to see if it reads the same forward and backward. This would be done in a for loop. Often an input String contains several groups of characters, where each group acts as a unit that has significance.

http://ibcomp.fis.edu/Reading/JavaTutor/Notes/chap49D/ch49D_13.html

Tokens and Delimiters

Recommendations

/////////