Account Options

  1. Sign in
The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Google Groups Home
« Groups Home
Adaptive indexing
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  5 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
deepthi shekar  
View profile  
 More options Oct 6 2012, 11:44 pm
From: deepthi shekar <deepth...@gmail.com>
Date: Sat, 6 Oct 2012 20:44:12 -0700 (PDT)
Local: Sat, Oct 6 2012 11:44 pm
Subject: Adaptive indexing

Can adaptive indexing help to improve the performance of inserts and
updates in MongoDB?


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Sam Millman  
View profile  
 More options Oct 7 2012, 6:27 am
From: Sam Millman <sam.mill...@gmail.com>
Date: Sun, 7 Oct 2012 11:27:14 +0100
Local: Sun, Oct 7 2012 6:27 am
Subject: Re: [mongodb-user] Adaptive indexing

Depends on your definition of adaptive indexing. Can you explain some more?

On 7 October 2012 04:44, deepthi shekar <deepth...@gmail.com> wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
deepthi shekar  
View profile  
 More options Oct 22 2012, 12:48 am
From: deepthi shekar <deepth...@gmail.com>
Date: Sun, 21 Oct 2012 21:48:01 -0700 (PDT)
Local: Mon, Oct 22 2012 12:48 am
Subject: Re: Adaptive indexing

since adaptive indexes work well with big data, do you think it is a good
idea to have it in a nosql db like mongo? Im planning to work on this as my
masters project and need some inputs and comments from readers.
I plan to use a genetic algorithm to create the index as a side effect of
the query execution. I also looked into other methods of adaptive indexing
like database cracking and adaptive merging. Which one would be better ?


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Sam Millman  
View profile  
 More options Oct 22 2012, 3:51 am
From: Sam Millman <sam.mill...@gmail.com>
Date: Mon, 22 Oct 2012 08:50:57 +0100
Local: Mon, Oct 22 2012 3:50 am
Subject: Re: [mongodb-user] Re: Adaptive indexing

Can you provide an example of what you mean cos my idea of storing genetic
material would not need "adaptive indexing" (still don't know exactly what
you mean by it)?

It would be good to outline your problem fully and what kind of structure
you are looking to store and how you imagine it to be stored.

On 22 October 2012 05:48, deepthi shekar <deepth...@gmail.com> wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Andre de Frere  
View profile  
 More options Oct 22 2012, 10:40 pm
From: Andre de Frere <andre.defr...@10gen.com>
Date: Mon, 22 Oct 2012 19:40:08 -0700 (PDT)
Local: Mon, Oct 22 2012 10:40 pm
Subject: Re: Adaptive indexing

Hi Deepthi,

To the best of my knowledge, there is no current plan to introduce adaptive
or auto tuning indexing to MongoDB.

I would be very interested in any discussion on the subject that might come
out of this post.

My reading on the subject has mostly been around column stores, rather than
document stores.  I've not yet seen adaptive merging or database cracking
done on a document basis.  I think a hurdle here might be the lack of
strict schema - since database cracking would attempt to 'crack' the data
structures on a per query basis, while there is no guarantee that the data
structure will be consistent per document.  I have yet to do any experiment
on this theory however.

From what I have read, adaptive merging tends to cost more but take fewer
queries to converge on an optimal index, while database cracking takes
longer to converge but is cheaper.  Initial queries in both schemes are as
expensive as full table scans (for less or more queries depending on the
scheme), you would need to measure this against the time it takes to
generate a full index.

Using a genetic algorithm to create an index as as side effect of query
execution sounds interesting.  Again I would be concerned that the document
structure could change on a per document basis, which could lead to a
difference in allele values and make comparisons harder between
generations, but you could overcome that hurdle by inserting only documents
with the same structure - or you may find that this is not a concern after
testing.

Hope this helps,
André


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »