Texonom
Texonom
/
Engineering
Engineering
/Software Engineering/Programming/Programming Language/Programming Language Structure/Compiler/
Compiler Token
Search

Compiler Token

Creator
Creator
Seonglae Cho
Created
Created
2022 Sep 28 3:30
Editor
Editor
Seonglae Cho
Edited
Edited
2023 Nov 10 13:28
Refs
Refs
Regular Expression
Finite State Automata

Minimum unit that container meaning

Compiler Symbol Table
  • normal state: copy a character to a token buffer
  • accept state: return a token & go back to intial state
  • “error” state: report an error & stop
 
 
 
 
Tokens and Delimiters
Yes. This would be a nice exercise. After filling azBuffer with characters it could be examined to see if it reads the same forward and backward. This would be done in a for loop. Often an input String contains several groups of characters, where each group acts as a unit that has significance.
http://ibcomp.fis.edu/Reading/JavaTutor/Notes/chap49D/ch49D_13.html
Tokens and Delimiters
 
 
 

Recommendations

Texonom
Texonom
/
Engineering
Engineering
/Software Engineering/Programming/Programming Language/Programming Language Structure/Compiler/
Compiler Token
Copyright Seonglae Cho