FLEX crashing frequently when 'adding new text to the corpus' in "Texts & Words"

[Sargon Hasso]

This has been happening frequently as I began adding additional texts. At times, it crashed right at the beginning before adding any new text, which is not bad. However, when I have managed to add a couple without crashing, then adding additional text causes a crash and all the newly added text is lost. Crashing means program aborts, i.e. exits. Normally, I see Flex logs the state of the environment and giving user a chance to email the log report, but in this case, FLEX just exists.

*** AS A WORK AROUND ****​ which seems to work, somewhat, I am adding one text at a time, exit FLEX, come back and add additional text. Tedious, but seems to minimize losing too much work 🙂

Wondering, if there is a limitation on the amount of text, cumulatively, added here

While we are at it: 

1. is there a recommend text size per item? 
2. For example, I have a text from a book that has nearly 400 pages, pasting all 400 pages seemed to slow down switching from text to another text within "Texts & Words"; so, I resorted to segmenting the books into manageable chunks, not sure if it makes a difference on the performance. 
3. Does any one have any experience working with large text corpus?
4. Currently, in our project, we have been importing a subset of biblical texts, in Syriac, from Paratext. My goal is to import all of the text.
5. Also, I am planning to import a corpus data that may eventually grow in size. So, the question is: how does FLEX manage this text corpus? 
6. where is the text stored? 

Any feedback is greatly appreciated.

Thanks,

Sargon

[William Hanna]

I find a similar thing. When I add a text I have to restart FLEX before it will recognize that the text is really there. It sort of half knows and half doesn't. I can gloss words from the text, but they won't turn up in word totals until FLEX is restarted.

I have 530,000 words in 802 texts, so none of them is very large.

Bill

--
"FLEx list" messages are public. Only members can post.
flex_d...@sil.org
http://groups.google.com/group/flex-list.
---
You received this message because you are subscribed to the Google Groups "FLEx list" group.
To unsubscribe from this group and stop receiving emails from it, send an email to flex-list+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/flex-list/SJ2PR22MB4529033D302E7C383026EE4AF24C2%40SJ2PR22MB4529.namprd22.prod.outlook.com.

[jason_...@sil.org]

In the next stable release of FLEx there will be a bugfix in the code related to copying and pasting which may be responsible for the crash you are seeing.
Keep an eye out for 9.1.25 to be released and see if that fixes this issue.

FLEx keeps all the baseline text and analyses in its internal model file so that the analyses can be correlated to lexical entries. There may be performance issues for FieldWorks if the text corpus gets too large but the point when you see performance problems will depend on your system resources.

Regards,

Jason