Wednesday, March 23, 2016

What is Token?

Token : The string representing a program can be partitioned at the lowest level into a sequence of sub-string called tokens. Each token is a sequence of characters whose significant is possessed collectively rather than individually.

Example : Generally, these are used as tokens - 

  1. Constants, e.g. 1.2.3.4.
  2. Operator symbols, e.g. +,-,*.EQ,
  3. Identifiers e.g. A, H2035B, SPEED,
  4. Keywords e.g, IF, GOTO, SUBROUTINE.
  5. Punctuation symbols, e.g. parenthesis, brackets, coma & semicolon.
If You want to learn about the technology, computer science & engineering, web programming, freelancing, earning please click here :CSE SOLVE

Related Posts:

  • What is R-Value? R-Value:  The term  "r-value"  refers to values that are appropriate on the right of an assignment/expression.That is, r-values are what we usually think of "values". Example:   i:=5;  &n… Read More
  • What are the advantages of generating intermediate code? The advantages of generating intermediate code  Intermediate Code Generation:   After syntax & semantic analysis the compiler generates an explicit intermediate representation of the source program. To… Read More
  • What is Assembler? Assembler: Assembly code is passed to an assembler for further procesing that is, if the source language is assembly language & the target language is machine language, then the trasnlator is called an assembler. If You… Read More
  • DAG(Directed acyclic graph) DAG(Directed acyclic graph):   A Directed acyclic graph is a graph with no cycles which gives a picture of how the value computed by each statement in a basic block is used in subsequent statement in the block . T… Read More
  • Basic Blocks Basic Blocks: A basic block is a sequence of consecutive statement in which flow of control enters at the beginning & leaves at the end without halt or possibility of branching except at the end of the basic block. … Read More

0 comments:

Post a Comment