Hi Gabriel,
Saying this, I think 3FS is super interesting but I think we'll need a consensus on having enough contributors for this type of integration. As
3FS is designed to run on specific HW, the updates/changes may not be trivial.
From the 3FS site, the peak throughput was done on:
This cluster consists of 180 storage nodes, each equipped with 2×200Gbps InfiniBand NICs and sixteen 14TiB NVMe SSDs.
Saying this, I think the idea is extremely interesting. My key concern is the potential complexity and having enough experienced contributors for it. Saying this, why not create an issue in the Delta GitHub to help get community consensus around this?
Glad to chat more via Slack (hopefully the link works now) and/or continuing the conversation in this thread, eh?!
Thanks for bringing this up, Gabriel!
Denny