Compiler Token

Creator

Creator

Seonglae Cho

Created

Created

2022 Sep 28 3:30

Editor

Editor

Seonglae Cho

Edited

Edited

2023 Nov 10 13:28

Refs

Refs

Regular Expression

Minimum unit that container meaning

Compiler Symbol Table

normal state: copy a character to a token buffer

accept state: return a token & go back to intial state

“error” state: report an error & stop

Compiler Token Notion

Token Attribute

Token Specification

Tokens and Delimiters

Yes. This would be a nice exercise. After filling azBuffer with characters it could be examined to see if it reads the same forward and backward. This would be done in a for loop. Often an input String contains several groups of characters, where each group acts as a unit that has significance.

http://ibcomp.fis.edu/Reading/JavaTutor/Notes/chap49D/ch49D_13.html

Tokens and Delimiters

Recommendations

///////