Pass external values to DAG

[Serega Sheypak]

Hi, I'm confused with "conf" and "adhoc" flags.

I have a dag:

https://gist.github.com/seregasheypak/2843f995ad6292d29bf42a1995628106

What is the right way:

1. pass input_path, output_path just before starting DAG (through backfill CLI command?)

2. pass input_path, output_path to Backfilljob during test?

There are tests realted to -c (--conf) in Airflow code, but they aimed to failed, because provided value is not json. I would liek to see how does Airflow allow to configure DAG

Thanks!

[Frank Wang]

I used --conf json value(key pair) with trigger_dag command to set my spark input/output path 

[Serega Sheypak]

And and what is the right way to get access to that json inside DAG?

[Frank Wang]

https://github.com/airbnb/airflow/blob/master/airflow/example_dags/example_trigger_target_dag.py

[Serega Sheypak]

Thanks, I saw that, anyway it doesn't work if you you are not in UTC timezone :(