Greetings.
Yes, this reader produces Paragraph and Sentence annotations, but not
Token ones. I don't recall why; perhaps we should update it so that it
produces Tokens as well. Should be a very easy change to make.
Regards,
Tristan
--
Tristan Miller, Research Scientist
Ubiquitous Knowledge Processing Lab (UKP-TUDA)
Department of Computer Science, Technische Universität Darmstadt
Tel:
+49 6151 16 6166 | Web:
http://www.ukp.tu-darmstadt.de/