string too long to generate flowchart

147 views
Skip to first unread message

Mark Schultz

unread,
Jan 22, 2017, 7:54:05 PM1/22/17
to ruffus_discuss
When trying to draw the flowchart in a pipeline that includes @mkdir, the initial cell is too long and the script falls over.  It works fine on a test set of just a few samples, but when running with 950 or so samples, the string is too long to generate the flowchart.  Here is the error:

Traceback (most recent call last):

  File "pando_ruffus.py", line 230, in <module>

    main()

  File "pando_ruffus.py", line 215, in main

    pipeline_printout_graph("flowchart.svg")

  File "/home/linuxbrew/.linuxbrew/Cellar/python/2.7.13/lib/python2.7/site-packages/ruffus/task.py", line 4659, in pipeline_printout_graph

    signal_callback=is_node_up_to_date)

  File "/home/linuxbrew/.linuxbrew/Cellar/python/2.7.13/lib/python2.7/site-packages/ruffus/graph.py", line 1175, in graph_printout

    raise subprocess.CalledProcessError(retcode, cmd + "\n" + "\n".join([str(result_str), str(error_str)]))

subprocess.CalledProcessError: Command 'dot -Gsize='(11,8)'  -Tsvg < /tmp/schultzm/tmpcfVYpd.dot


Error: <stdin>: syntax error in line 14 scanning a quoted string (missing endquote? longer than 16384?)

String starting:"mkdir(['results/2014-15452',

 'results/2016-19587',

 'results/2016-14638',

 'res

' returned non-zero exit status 1



I have attached a screenshot from a working flowchart generation, but when there are too many folders in the mkdir step at the start, that is when the above error occurs.  


Screen Shot 2017-01-17 at 18.18.30.png

Mark Schultz

unread,
Jan 22, 2017, 10:25:18 PM1/22/17
to ruffus_discuss
I guyess my question should be, how do I stop rendering of the 'mkdir' cell in the flowchart image (or how do I reduce it to just 'mkdir' in the text rather than showing all of the folder names)? 
Reply all
Reply to author
Forward
0 new messages