Token : The string representing a program can be partitioned at the lowest level into a sequence of sub-string called tokens. Each token is a sequence of characters whose significant is possessed collectively rather than individually.
Example : Generally, these are used as tokens -
- Constants, e.g. 1.2.3.4.
- Operator symbols, e.g. +,-,*.EQ,
- Identifiers e.g. A, H2035B, SPEED,
- Keywords e.g, IF, GOTO, SUBROUTINE.
- Punctuation symbols, e.g. parenthesis, brackets, coma & semicolon.
0 comments:
Post a Comment