COSI sample application - not driver

[Chinna Pedda]

Hi All,

I have recently came across COSI initiative, I could find the details of example COSI drivers from https://container-object-storage-interface.github.io. But I am not able to find any sample applications (or real world applications) using the buckets created by COSI driver.

Here's my query in more detail.

• How are applications supposed to use the bucket credentials from the BucketAcceesResponse ?
• How do they create/delete objects in those buckets?
• Are applications supposed to use S3 clients (or equivalent) for object management?
• If applications are supposed to manage objects themselves then what's the value of COSI, only bucket management?

Thanks.

--

Rajesh

[Mateusz Urbanek]

Hi Rajesh,

> How are applications supposed to use the bucket credentials from the BucketAcceesResponse? 

Those credentials returned by the driver are put into the secret, which is created by COSI Sidecar. You can refer to Ceph COSI deployment manifests to see how the COSI Sidecar is deployed. Right now, the users are expected to either:
  a) Modify application code to parse the COSI secret;
  b) Use init container with custom logic to parse the COSI secret and create a configuration that can be read by the application;

> How do they create/delete objects in those buckets?

> Are applications supposed to use S3 clients (or equivalent) for object management?

Yes, exactly. Your application needs to be able to access object storage by internal logic. COSI provides only the Kubernetes-native object storage management.

> If applications are supposed to manage objects themselves then what's the value of COSI, only bucket management?

Buckets are a storage solution logically equivalent to Volumes. Most applications are not delegating writing data to disk to external programs, and this is also expected from applications making use of Buckets provisioned by COSI.

COSI provides a simplified solution to the management of object storage platforms, while providing standardised API for all vendors willing to integrate with it.

I hope my answers clarified your doubts a little bit. If you still have some more questions, don't be afraid to ask, I am more than happy to provide any additional information.

[Chinna Pedda]

Thanks for the response. Can you please let me know where I can find the details of the roadmap, progress towards GA, etc.?

> Buckets are a storage solution logically equivalent to Volumes. Most applications are not delegating writing data to disk to external programs, and this is also expected from applications making use of Buckets provisioned by COSI.

With CSI, once the volume is provisioned and mounted to a pod, application does need to know any vendor or protocol specifics to consume it. With COSI, if I understand correctly, application still needs to know protocol specifics (s3, azure, etc.) for object. So, am I correct in saying that an application will still not be portable across different object storage vendors?

--

Rajesh

[Mateusz Urbanek]

>  With COSI, if I understand correctly, application still needs to know protocol specifics (s3, azure, etc.) for object. So, am I correct in saying that an application will still not be portable across different object storage vendors?

Kind of both. Given S3 is not limited to AWS, if your application is able to use S3 protocol, then you are not tied to specific platform, but can use Ceph, AWS, Linode Object Storage, Garage, S3GW, MinIO or any other S3 compatible storage solution. The situation is little bit more complicated with Azure Blob Storage, OpenStack Swift and Google Cloud Storage. Those are not compatible with S3 protocol and require separate clients.

> Can you please let me know where I can find the details of the roadmap, progress towards GA, etc.?

Sure thing. Here are few links:

- Kanban project: https://github.com/orgs/kubernetes-sigs/projects/63

- #sig-storage-cosi channel on official Kubernetes slack: https://kubernetes.slack.com/archives/C017EGC1C6N

[Chinna Pedda]

Hi All,

Can you share details of any S3 applications which are integrated with COSI? I could only find a AWS CLI sample application which does not help much.

Thanks.

--
You received this message because you are subscribed to the Google Groups "container-object-storage-interface-wg" group.
To unsubscribe from this group and stop receiving emails from it, send an email to container-object-storage...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/container-object-storage-interface-wg/bc7b24ba-78c5-42bc-8350-5b3b787c4831n%40googlegroups.com.