1 votes 1 votes How tokens are assigned for a string having escape sequence in C lexical phase Eg.. printf ("this\" is a string\""); and what for printf ("this is""a string"); Programming in C compiler-tokenization + – admin asked Oct 15, 2015 admin 647 views answer comment Share Follow See all 0 reply Please log in or register to add a comment.
Best answer 0 votes 0 votes Token 1: this" is a string" Token 2: this isa string Adjacent string constants are concatenated. Arjun answered Oct 16, 2015 Arjun comment Share Follow See 1 comment See all 1 1 comment reply admin commented Oct 16, 2015 reply Follow Share So tokenizer does the concatenation itself or before tokenization the I/p string is interpreted I.e. it first removes white spaces and escape sequence and then forwards it to tonkenizer 0 votes 0 votes Please log in or register to add a comment.