number of commands can be very largelength of each token like name (any token could be large)use dynamic memory allocation strategy