File storage for course-associated files

[Sébastien Hinderer]

Dear all,

It seems that the files associated with courses are stored in an fs
mongo database. IS hat correct?
It also seems it has not always been so, and at some point in the past
the files were stored somewhere in the xcontent mongo database.

If all this is correct, is there an automated way to migrate the data
from their old to their new location / format?

Thanks,
Sébastien.

[Don-edX Mitchell]

Assets (file uploads) for Studio based courses are currently and have always been stored in GridFS which we identify as the xcontent mongo database but that name is just a string in the setup and has nothing to do with technology nor collection naming which have not changed. If your server is unable to find the content, then look at your configuration files for CONTENTSTORE. In one of your active configs, there should be a decl similar to this from lms.envs.cms.dev:

CONTENTSTORE = {
    'ENGINE': 'xmodule.contentstore.mongo.MongoContentStore',
    'DOC_STORE_CONFIG': {
        'host': 'localhost',
        'db': 'xcontent',
    }
}

You'll notice the db name in this config.

We are, however, preparing to remove assets completely from the app server and position them in the web server. I don't know if this proposal is accessible, but I'll put the link here. If it's not accessible yet, it will be very soon or will go out under separate cover (if it hasn't already).

[Don-edX Mitchell]

Ah, I forgot to add one more piece of info: assets for xml file-based courses come from the filesystem.

[Sébastien Hinderer]

Hi Don,

Many thanks for your response, it's very useul!!
Best wishes,
Sébastien.

[John Eskew]

The proposal to which Don refers is publicly accessible here:

https://openedx.atlassian.net/wiki/display/PLAT/GridFS+Replacement

On Mon, Aug 11, 2014 at 9:09 AM, Don-edX Mitchell <dmit...@edx.org> wrote:

[Ray Hooker]

Very interesting.  Thanks for posting.

--
Ray Hooker

[Camilo Aguilar]

What happen to that proposal? Is there a way of using S3 or Minio instead of GridFS? It is too expensive for us to store static assets in MongoDB.