IllegalStateException when trying to run flow

23 views
Skip to first unread message

andre...@tubemogul.com

unread,
Dec 23, 2015, 2:31:30 PM12/23/15
to cascading-user
Hey, we are running into the following error when trying to run our cascading flow

Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalStateException: may not mark as FAILED, is already PENDING
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:188)
at cascading.flow.BaseFlow.run(BaseFlow.java:1194)
at cascading.flow.BaseFlow.access$100(BaseFlow.java:81)
at cascading.flow.BaseFlow$1.run(BaseFlow.java:870)
... 1 more
Caused by: java.lang.IllegalStateException: may not mark as FAILED, is already PENDING
at cascading.stats.CascadingStats.markFailed(CascadingStats.java:494)
at cascading.stats.CascadingStats.markFailed(CascadingStats.java:478)
at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:194)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:146)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:48)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
... 1 more

Has anybody seen this or know why this might be happening?

Thanks,
Andrew

Chris K Wensel

unread,
Dec 23, 2015, 2:39:47 PM12/23/15
to cascadi...@googlegroups.com
would be good to know the Cascading version you are on (and in this case the jdk).

it looks like an exception is being throw before the flow is marked as started. this exception unfortunately is hiding the original.

for this to happen, something very fundamental is wrong.

like hdfs is unreachable so we can’t get at the file times etc. or there is missing logging classes from the CLASSPATH 

--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at https://groups.google.com/group/cascading-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/fdc9b355-9b6b-4aca-be96-cd3905c32729%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

—
Chris K Wensel




andre...@tubemogul.com

unread,
Dec 23, 2015, 3:01:02 PM12/23/15
to cascading-user
We are using Cascading 3.0.2 and jdk 1.7.

andre...@tubemogul.com

unread,
Dec 23, 2015, 3:03:54 PM12/23/15
to cascading-user
When we run the flow that is failing in isolation it runs perfectly fine, but when we try to run it as the starting flow to a series of flows, this error comes up. Also, when we try to run the whole series of flows locally, it runs fine as well.

Chris K Wensel

unread,
Dec 23, 2015, 3:11:13 PM12/23/15
to cascadi...@googlegroups.com
are you using a custom tap/scheme?


For more options, visit https://groups.google.com/d/optout.

Sarma Tangirala

unread,
Dec 23, 2015, 3:20:58 PM12/23/15
to cascadi...@googlegroups.com
On Wed, Dec 23, 2015 at 12:11 PM, Chris K Wensel <ch...@wensel.net> wrote:
are you using a custom tap/scheme?

No we aren't.
 

For more options, visit https://groups.google.com/d/optout.



--
Sarma Tangirala | Software Engineer
Inline image 1

Chris K Wensel

unread,
Dec 23, 2015, 3:29:16 PM12/23/15
to cascadi...@googlegroups.com
in about 4 hours there will be a 3.0.4-wip-153 in maven you can try, or you can build it yourself locally.


this should allow the error to propagate up without being hidden by the state error.

ckw

-- 
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at https://groups.google.com/group/cascading-user.



-- 
Sarma Tangirala | Software Engineer
<image.png>

-- 
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at https://groups.google.com/group/cascading-user.

For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages