GCS relative path for jinja2 .sql templates

[Filip Popić]

Hi guys, can somebody explain to me how to setup jinja2

`template_searchpath=[....]` and PostgresToGoogleCloudStorageOperator `sql` parametar

https://github.com/apache/incubator-airflow/blob/master/airflow/contrib/operators/postgres_to_gcs_operator.py#L46

```with DAG( template_searchpath=[XXX], ... ) as dag:

    psql_to_gcs = PostgresToGoogleCloudStorageOperator(sql=('YYY.sql'), ... )```

to be able to pick up all `.sql` files for the following GCS structure:

```/home/airflow/gcs/dags/my_project/dag/*.py

/home/airflow/gcs/dags/my_project/schema/*.schema

/home/ariflow/gcs/dags/my_project/sql/*.sql```

I see only solutions with `.sql` files inside DAG folder or as a subfolder in a DAG folder.

https://stackoverflow.com/questions/50512411/how-do-i-read-a-file-in-the-airflow-cloud-composer-bucket

https://stackoverflow.com/questions/50761084/using-airflow-template-files-and-template-searchpath-in-google-cloud-composer

Thanks!

(I asked on composer slack but this is better place I guess to ask)

[Guillaume Wibaux]

hi Filip

may be use something like template_searchpath = os.path.dirname(os.path.realpath(__file__) to get the path to the dag file and then add a dose of os.chdir to navigate relatively from your dag folder to your file with the sql files os.chdir('../sql')

Then for each task you can specify the files you want to run relatively to the template_searchpath.