TextDelimited using quote string causes job to fail.

14 views
Skip to first unread message

gc1888

unread,
Jun 17, 2020, 6:14:15 AM6/17/20
to cascading-user
Using the following new TextDelimited(fields, "\t", "\"") causes my job to fail with the following exception:

Caused by: java.lang.StackOverflowError
	at java.util.regex.Pattern$CharProperty.match(Pattern.java:3778)

If I remove the quote string parameter it runs successfully but without support for values containing a TAB. 

Is there something obvious I am missing here?


Chris K Wensel

unread,
Jun 17, 2020, 12:36:26 PM6/17/20
to cascadi...@googlegroups.com
Sounds like you have a record the regex used by TextDelimited can’t parse.

If you enable traps that capture the error messages, you can skip the bad record (maybe, StackOverflowError might be considered fatal) and capture the bad record data in another file.

We really need a OpenCSV version of the Scheme, but no one has submitted a patch.

ckw

--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/0caa4ab5-2280-4cb2-b867-623f060d47abo%40googlegroups.com.

Chris K Wensel



Reply all
Reply to author
Forward
0 new messages