Location of sent_tokenize

[Julius Hamilton]

Hey,

In which file in the source code is sent_tokenize defined?

Thanks very much,

Julius

[Julius Hamilton]

I found it in __init__.py.

I see it loads the “Punkt” sentence tokenizer from a pickle file.

Why is the tokenizer a downloaded pickle file and not just part of the NLTK module internally?

Thanks very much,

Julius