Groups
Sign in
Groups
CDAP User
Conversations
About
Send feedback
Help
Passing filename being processed in the context
23 views
Skip to first unread message
kader Ben Mati
unread,
Oct 9, 2022, 11:48:26 AM
10/9/22
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to CDAP User
Hi there,
I'm a new to Data fusion and I'm building pipeline like this:
GCS (Filepath/*) ->Wrangler -> BigQuery -> GCS Move
and I want at the end GCS move receives only file name that being processed by Wrangler.
Thanks,
Kader
Ramandeep primotech
unread,
Apr 23, 2024, 7:31:15 PM
Apr 23
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to CDAP User
Hi everyone,
I'm still looking for the solution, Did anyone find it?
Regards,
Raman
Sanket Sahu
unread,
Apr 29, 2024, 8:32:01 AM
Apr 29
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to CDAP User
Hi,
If in GCS Source you have the PATH (Filepath/*)
Then you can just use the same PATH in gcs move.
All the path that you mention in GCS will be read and processed by gcs->wrangler.
Reply all
Reply to author
Forward
0 new messages