Overwrite files with GCS sink plug in

29 views
Skip to first unread message

Peter Hogue

unread,
Feb 23, 2024, 8:38:17 AM2/23/24
to CDAP User
Hi, I'm trying to build a pipeline that outputs json to cloud storage, and I would like the output to be written to the same file each day.  I've tried removing the path suffix so that the target file would be overwritten but when I do I get an error that the directory already exists.  I've tried to check if the plug in documentation but I don't see anything about a file overwrite property.  Does anyone know how overwriting files in GCS is possible?
Reply all
Reply to author
Forward
0 new messages