Scatters with NDB

170 views
Skip to first unread message

Kaan Soral

unread,
May 19, 2012, 1:14:18 AM5/19/12
to google-a...@googlegroups.com
I am trying to rewrite my custom mapreduce with NDB
For the above code:
   gg=AModel.query()
   #gg=gg.order(ndb.GenericProperty('__scatter__'))
   logging.info(len(gg.fetch(5000,keys_only=True)))
The result is ~200

If you remove the comment and fetch only properties with __scatter__'s the result is ~100 (~50%)

I have wiped the DB, created it again several times and the results were consistent.

Normally the __scatter__ probability should be 0.2%

What could be the reason? [The experiment is on SDK]

Kaan Soral

unread,
May 22, 2012, 9:32:57 PM5/22/12
to google-a...@googlegroups.com
*below code*

Robert Kluin

unread,
May 22, 2012, 11:08:59 PM5/22/12
to google-a...@googlegroups.com
Have you done any testing with this on an appspot instance?

It has been a while since I last looked at the SDKs handling of this,
but it was a little different last I knew.



Robert
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/Wh7r-9vacQ8J.
> To post to this group, send email to google-a...@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengi...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.

Kaan Soral

unread,
May 22, 2012, 11:18:22 PM5/22/12
to google-a...@googlegroups.com
Unfortunately I didn't get the chance to, probably should set a dummy project and code etc for this kind of stuff

I decided to add my own scatter with custom probabilities, I guess It will work out better

Alfred Fuller

unread,
Dec 12, 2012, 1:51:59 PM12/12/12
to Google App Engine
The dev app server populates the scatter index at 50% as it is assumed to have much less data.


On Tue, May 22, 2012 at 8:18 PM, Kaan Soral <kaan...@gmail.com> wrote:
Unfortunately I didn't get the chance to, probably should set a dummy project and code etc for this kind of stuff

I decided to add my own scatter with custom probabilities, I guess It will work out better

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.
To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/h0qVptjCaYUJ.
Reply all
Reply to author
Forward
0 new messages