Unable to read text file from Streamsets S3 origin

12 views
Skip to first unread message

Sujata hs

unread,
Feb 16, 2022, 9:48:42 AM2/16/22
to sdc-user, sujat...@gmail.com
Hello everyone,

I am facing strange issue on Streamsets S3 origin.
I have a set of files with pattern "D_xyz_SourceXXX_yyyymmdd_hhmmss_MASKED.txt

but all files[800] are getting loaded except 2 files, even I tried with reset origin. I don't understand the reason behind it.

file patter given in Streamsets S3 origin is " *.txt"

below 2 files are not read/recognized by Streamsets 
D_xyz_Source040_20210714_215920060_MASKED.txt
D_xyz_Source040_20210713_204715590_MASKED.txt

Strange observation : It is not working with Reset Origin but working if I rename the file.



Reply all
Reply to author
Forward
0 new messages