Task fails with state "upstream failed" even though upstream executed successfully

7 views
Skip to first unread message

rich...@rezco.co.za

unread,
May 25, 2018, 3:26:29 AM5/25/18
to composer-dev
Hi there

I'm testing running several bigquery operator tasks (very basic queries writing to tables in this example) with one level of dependency. My DAG (bg_flatten_table_new3, attached) has been running on composer for a few days, mostly working 100%. However, every now and then it fails to execute a task with state "upstream failed" even though upstream executed successfully. 

Composer log (attached) for this task is empty and instance details (attached) also doesn't give much info. 

Any help would be much appreciated.  
log (1).png
task instance details (1).png
bq_flatten_table_new3.py
Example task failed (1).png
Reply all
Reply to author
Forward
0 new messages