Single collection vs Multiple dynamically created Collections through Java UI

[juhi bhatia]

Currently, I have a single collection, storing varied types of documents that grow by 20% everyday. Until now we have not faced any issues, but lately we have started thinking of various performance optimization options. One such though was on using multiple collections (having one collection for one type of document). Since I have multiple collections, I will have indexes on each collection. My queries are:

1. Will this model of having one collection for each document type help, since the single collection grows variably?
2. How will indexing optimize - as I think equal number of indexes will be loaded in memory in both cases.
3. Will it improve query performance?

Note: I have not considered using Sharding yet, both on single as well as multiple collection model.

[Asya Kamsky]

Juhi,

More information would help to give you an informed answer - what are the different types of documents in this collection and how are you using them other than updating them in a way that grows?   What does the data in them represent?   What about the updates that grow them?   Do you always use the full document that's there?

It's possible that there is a different way you can change your schema/approach - keeping documents in the same collection but storing things over time in different documents rather than updating existing documents with new information but I don't know if that might work without more details.

Asya

--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
 
For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user...@googlegroups.com.
To post to this group, send email to mongod...@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/ff3447a7-5026-442c-94fc-e896ad08b44b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[juhi bhatia]

Asya,

Answers Inline:

On Monday, November 17, 2014 2:53:30 PM UTC+5:30, Asya Kamsky wrote:

Juhi,

More information would help to give you an informed answer -

 

what are the different types of documents in this collection and how are you using them other than updating them in a way that grows?  

-- Documents are never updated, we just keep on writing new data to them. Here, by different types of document I mean different document structure.
 

What does the data in them represent?   What about the updates that grow them?   Do you always use the full document that's there?

-- Whole document is used always when read. These are text documents.

It's possible that there is a different way you can change your schema/approach - keeping documents in the same collection but storing things over time in different documents rather than updating existing documents with new information but I don't know if that might work without more details.

-- As said earlier, we don't update, we write.

[Asya Kamsky]

I'm sorry, maybe there is a terminology mix-up here.

There isn't a general "write" operation.  You can "insert" a document, you can "update" a document or you can "remove" a document.   Those are the available write operation.

You can only "insert" a document once - this is because once a document exists, to change its contents you can update it but you cannot insert it again.   If you are using the "save" operation (which is provided by most drivers) that does an insert if the _id of the document does not exist, or if the _id exists then it does an update of that document with the new value.    I guess one other possibility is removing the existing document and inserting a new version of it, but since that's not atomic there is no advantage to that and so I'm going to discount that sequence of writes.

Which of these are you doing?     And what are the different types of documents that you are considering separating into different collections?

Asya

To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/3017877e-ff1d-4a47-8d6f-17601e2b6fb1%40googlegroups.com.

[juhi bhatia]

Sorry. My bad. Only Inserts, no updates.

On Monday, November 17, 2014 2:53:30 PM UTC+5:30, Asya Kamsky wrote: