Issue 45 in mappa: Replace PLY's lex with Plex?
ma...@googlecode.com
Owner: lars.heuer
Labels: Type-Task Priority-Low Component-LTM Component-CTM Component-Tolog
New issue 45 by lars.heuer: Replace PLY's lex with Plex?
http://code.google.com/p/mappa/issues/detail?id=45
Maybe it's worth to try Plex instead of the scanners generated by Ply since
Plex uses a DFA and seems to operate on a subset of a document while Ply
enforces that a document is read completely.
http://code.google.com/p/python-plex/
--
You received this message because you are listed in the owner
or CC fields of this issue, or because you starred this issue.
You may adjust your issue notification preferences at:
http://code.google.com/hosting/settings
ma...@googlecode.com
Status: WontFix
Comment #1 on issue 45 by lars.heuer: Replace PLY's lex with Plex?
http://code.google.com/p/mappa/issues/detail?id=45
Seems not to be worth to introduce another dependency. If reading the whole
file is
an issue we may provide a handwritten lexer
ma...@googlecode.com
Status: Accepted
Labels: -Component-LTM -Component-Tolog
Comment #2 on issue 45 by lars.heuer: Replace PLY's lex with Plex?
http://code.google.com/p/mappa/issues/detail?id=45
Using a handwritten lexer or Plex may make sense since the CTM lexer needs
more than 20min tokenize 5MB CTM source files (just tokenizing!). Regular
expressions do not work well with long strings.
ma...@googlecode.com
Labels: -Type-Task -Priority-Low Type-Defect Priority-Medium
Comment #3 on issue 45 by lars.heuer: Replace PLY's lex with Plex?
http://code.google.com/p/mappa/issues/detail?id=45
(No comment was entered for this change.)
ma...@googlecode.com
Status: Fixed
Comment #4 on issue 45 by lars.he...@gmail.com: Replace PLY's lex with Plex?
http://code.google.com/p/mappa/issues/detail?id=45
The long delay was caused by an ill-formed grammar. The current CTM lexer
(based on PLY) is much faster than the lexer which was responsible for this
issue.