PyPgen: patch to replace the tokenizer

1 view
Skip to first unread message

Franck Pommereau

unread,
Jan 11, 2010, 4:46:43 AM1/11/10
to myt...@googlegroups.com
Attached please find a patch that replaces AbstractTokenizer by one that
supports adding new tokens.
Tokenizer.patch

Franck Pommereau

unread,
Jan 11, 2010, 6:37:53 AM1/11/10
to myt...@googlegroups.com
Here is an additional patch, fixing missing changes.
Tokenizer-2.patch
Reply all
Reply to author
Forward
0 new messages