test_input(1) : lexer error 3 :
1:1: Tokens : ( T__60 | T__61 | T__62 | T__63 | SELECT | FROM | WHERE | AS | DOTSTAR | DOT | AND | OR | XOR | NOT | EXISTS | TRUE | FALSE | NIL | BETWEEN | LIKE | ASTERISK | COMMA | DIVIDE | MODULO | PLUS | MINUS | EQ | NEQ | GT | ST | ID | INT | FLOAT ); at offset 6, near ' ' :
* FROM test
test_input(1) : lexer error 3 :
1:1: Tokens : ( T__60 | T__61 | T__62 | T__63 | SELECT | FROM | WHERE | AS | DOTSTAR | DOT | AND | OR | XOR | NOT | EXISTS | TRUE | FALSE | NIL | BETWEEN | LIKE | ASTERISK | COMMA | DIVIDE | MODULO | PLUS | MINUS | EQ | NEQ | GT | ST | ID | INT | FLOAT ); at offset 8, near ' ' :
FROM test
test_input(1) : lexer error 3 :
1:1: Tokens : ( T__60 | T__61 | T__62 | T__63 | SELECT | FROM | WHERE | AS | DOTSTAR | DOT | AND | OR | XOR | NOT | EXISTS | TRUE | FALSE | NIL | BETWEEN | LIKE | ASTERISK | COMMA | DIVIDE | MODULO | PLUS | MINUS | EQ | NEQ | GT | ST | ID | INT | FLOAT ); at offset 13, near ' ' :
test
I may have miscounted but it looks like the error occurs at the first space.
Also, have you considered just declaring the tokens with a simple 'SELECT' rather than one character at a time?
Angus