Bulk PUT Job size - good practice recommendations?

[Stephen McConnachie]

Hi everyone,

I'm starting to explore making PUTs to Black Pearl using the Python3 SDK, which seems very straightforward (great SDK!)

Is there a good practice methodology around the max size of a single BULK PUT Job?

Should we be checking the cache's unused capacity each time using that function call, and limiting the size of a PUT to avoid maxxing the cache? 

Is there a %-of-cache-unused that we should be using?

Or should we simply create a bulk PUT with as many files as we have in scope at time of making the call, and let Black Pearl manage the implications for cache and tape?

All the best,

Stephen,

BFI National Archive