Issue 45 in mappa: Replace PLY's lex with Plex?

6 views
Skip to first unread message

ma...@googlecode.com

unread,
Dec 14, 2009, 5:58:41 AM12/14/09
to ma...@googlegroups.com
Status: Accepted
Owner: lars.heuer
Labels: Type-Task Priority-Low Component-LTM Component-CTM Component-Tolog

New issue 45 by lars.heuer: Replace PLY's lex with Plex?
http://code.google.com/p/mappa/issues/detail?id=45

Maybe it's worth to try Plex instead of the scanners generated by Ply since
Plex uses a DFA and seems to operate on a subset of a document while Ply
enforces that a document is read completely.

http://code.google.com/p/python-plex/

--
You received this message because you are listed in the owner
or CC fields of this issue, or because you starred this issue.
You may adjust your issue notification preferences at:
http://code.google.com/hosting/settings

ma...@googlecode.com

unread,
Dec 25, 2009, 9:32:33 AM12/25/09
to ma...@googlegroups.com
Updates:
Status: WontFix

Comment #1 on issue 45 by lars.heuer: Replace PLY's lex with Plex?
http://code.google.com/p/mappa/issues/detail?id=45

Seems not to be worth to introduce another dependency. If reading the whole
file is
an issue we may provide a handwritten lexer

ma...@googlecode.com

unread,
Jan 6, 2011, 6:46:13 AM1/6/11
to ma...@googlegroups.com
Updates:
Status: Accepted
Labels: -Component-LTM -Component-Tolog

Comment #2 on issue 45 by lars.heuer: Replace PLY's lex with Plex?
http://code.google.com/p/mappa/issues/detail?id=45

Using a handwritten lexer or Plex may make sense since the CTM lexer needs
more than 20min tokenize 5MB CTM source files (just tokenizing!). Regular
expressions do not work well with long strings.

ma...@googlecode.com

unread,
Jan 6, 2011, 6:50:15 AM1/6/11
to ma...@googlegroups.com
Updates:
Labels: -Type-Task -Priority-Low Type-Defect Priority-Medium

Comment #3 on issue 45 by lars.heuer: Replace PLY's lex with Plex?
http://code.google.com/p/mappa/issues/detail?id=45

(No comment was entered for this change.)

ma...@googlecode.com

unread,
Apr 5, 2011, 6:53:50 PM4/5/11
to ma...@googlegroups.com
Updates:
Status: Fixed

Comment #4 on issue 45 by lars.he...@gmail.com: Replace PLY's lex with Plex?
http://code.google.com/p/mappa/issues/detail?id=45

The long delay was caused by an ill-formed grammar. The current CTM lexer
(based on PLY) is much faster than the lexer which was responsible for this
issue.


Reply all
Reply to author
Forward
0 new messages