Reducing memory resource utilization of volume servers

[J R Sandesh Bhat]

I am experimenting with the use of SeaweedFS for storing video files on devices with a storage of 1TB but with memory restriction of 1GB (preferably lower). 

Writes are really rare and done in batches at large intervals, while reads are proportional to the number of volume servers. That is, each volume server exists on the same device as the one streaming it. Testing SeaweedFS, I see that the memory usage spikes to about twice the size of the file everytime I read or write it.

Is there any way to keep the memory restrictions low while reading the data? 

[Chris Lu]

Reduce the file chunk size should help.

--
You received this message because you are subscribed to the Google Groups "Seaweed File System" group.
To unsubscribe from this group and stop receiving emails from it, send an email to seaweedfs+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/seaweedfs/ccbf4f46-ad61-4729-bb72-affc6d7ce3bcn%40googlegroups.com.

[J R Sandesh Bhat]

Is there any way to not load the whole chunk into memory during read, but to stream it from disk?