Task fails with state "upstream failed" even though upstream executed successfully

Skip to first unread message


May 25, 2018, 3:26:29 AM5/25/18
to composer-dev
Hi there

I'm testing running several bigquery operator tasks (very basic queries writing to tables in this example) with one level of dependency. My DAG (bg_flatten_table_new3, attached) has been running on composer for a few days, mostly working 100%. However, every now and then it fails to execute a task with state "upstream failed" even though upstream executed successfully. 

Composer log (attached) for this task is empty and instance details (attached) also doesn't give much info. 

Any help would be much appreciated.  
log (1).png
task instance details (1).png
Example task failed (1).png
Reply all
Reply to author
0 new messages