Automate loading, ETL and export from Google cloud storage to BigQuery to FTP

2 views
Skip to first unread message

notcredibleyet via StackOverflow

unread,
Feb 3, 2017, 10:22:05 AM2/3/17
to google-appengin...@googlegroups.com

I'm pretty new to GCP but I would like to accomplish something that seems simple. Here are the steps:

  1. Take a CSV from one of my buckets
  2. Import it into BigQuery
  3. Perform ETL within BigQuery
  4. Export to FTP within GCP

My background is in ETL and SQL so I have been able to complete the ETL and uploading manually into BigQuery. Now I need to automate the process using jobs.

I've tried looking at a Java solution to see if I could use Automated File Loader Solution but it will not work for me.

Any help or guidance you could provide would be great.

Cheers, Eric



Please DO NOT REPLY directly to this email but go to StackOverflow:
http://stackoverflow.com/questions/42027386/automate-loading-etl-and-export-from-google-cloud-storage-to-bigquery-to-ftp
Reply all
Reply to author
Forward
0 new messages