schedule a daily load data in bigquery

[Y...@globalindustrial.com]

Hi,

I found a solution to load the data in a bigquery table daily:

https://shinesolutions.com/2018/01/21/scheduling-bigquery-jobs-this-time-using-cloud-storage-cloud-functions/

However, I can't reproduce the result.

when I run the transfer job, the query does run, but there's no table created for the query.

Could anyone advise if the method is still working, because I can't find the bigquery.createQueryJob in the cloud documentation.

If the method is not working, is there any other method I can use to schedule the daily load from a query?

Thanks,

Kara

[Katayoon (Cloud Platform Support)]

Hi,

Here you can find the documentation for createQueryJob. It is noted that “no results are immediately returned. Instead, your callback will be executed with a Job object that you must ping for the results.”

[Y...@globalindustrial.com]

Hi,

Thank you so much for the reply.

I created the cloud function. the function should be triggered when I have the file created in the folder call "trigger".

When it trigger, it should run the query and create a table to store the result in bigquery.dataset('email_test').table('test')

However, when I create a the folder, it does trigger the function, but I don't get the table created in bigquery.

Is that because of the "timeout" or is that because the function is not working?

Could you please check why? I have the code attached.

Thank you so much,

Kara

[Katayoon (Cloud Platform Support)]

Hi,

I should note that Issue Tracker is reserved for reporting Google Cloud Platform-end issues and feature requests. For technical questions, I recommend to post your full detailed question to Stack Overflow, using the supported Cloud tags.