Passing filename being processed in the context

23 views
Skip to first unread message

kader Ben Mati

unread,
Oct 9, 2022, 11:48:26 AM10/9/22
to CDAP User
Hi there,

I'm a new to Data fusion and I'm building pipeline like this:
GCS (Filepath/*) ->Wrangler -> BigQuery -> GCS Move 
 and I want at the end GCS move receives only file name that being processed by Wrangler.

Thanks,

Kader

Ramandeep primotech

unread,
Apr 23, 2024, 7:31:15 PMApr 23
to CDAP User
Hi everyone,
I'm still looking for the solution, Did anyone find it?

Regards,
Raman

Sanket Sahu

unread,
Apr 29, 2024, 8:32:01 AMApr 29
to CDAP User
Hi,

If in GCS Source you have the PATH  (Filepath/*) 
Then you can just use the same PATH in gcs move. 

All the path that you mention in GCS will be read and processed by gcs->wrangler. 
Reply all
Reply to author
Forward
0 new messages