Too many files created in an hour, unable to control the number of files created

26 views
Skip to first unread message

Avijeet

unread,
Apr 13, 2020, 5:31:34 AM4/13/20
to secor-users
I have set up secor in upload logs from a service (around 5 GB per day) in gzip format to Azure blob storage. I have configure the partitions to be 200 MB in size or age older than 60 seconds, still the files I see in the blob storage are of 120KB - 20KB in size. How can I correctly control the partition file sizes?
Secor version: 0.28
I have attached the files secor.prod.partition.properties, secor.common.properties, secor.prod.properties.
secor.prod.partition.properties
secor.common.properties
secor.prod.properties
Reply all
Reply to author
Forward
0 new messages