The partitionaer double the amount of memory required, as get_subset makes a copy. It'd be possible to delete the original data after the subsets are created. Ideally, this would happen in _partition_deterministic, before the acquisition models are created (as those will need additional memory). Suggested implementation by @PatrickFahy99 (I think) at
https://discord.com/channels/1242028164105109574/1252651306779152535/1451578169307037766
It'd have to be done as an option, and lifted to all methods.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you are subscribed to this thread.![]()