What is Token?

Token : The string representing a program can be partitioned at the lowest level into a sequence of sub-string called tokens. Each token is a sequence of characters whose significant is possessed collectively rather than individually.

Example : Generally, these are used as tokens - 

1. Constants, e.g. 1.2.3.4.
2. Operator symbols, e.g. +,-,*.EQ,
3. Identifiers e.g. A, H2035B, SPEED,
4. Keywords e.g, IF, GOTO, SUBROUTINE.
5. Punctuation symbols, e.g. parenthesis, brackets, coma & semicolon.

If You want to learn about the technology, computer science & engineering, web programming, freelancing, earning please click here :CSE SOLVE