tokenizer update

[Francis Leboutte]

Hello,

Attached is an update for the Montezuma tokenizer I'm using in CL!P (pronounced "clip") for a few months. CL!p is an application to search for laboratory products in catalogs:
http://www.labage.com/clip/search.html

To test type "dna" (without the quotes) or "dna ligase"
CL!P is still pre-release, especially regarding documentation.

Regards,

Francis