Re: extra fast sync?

[Joshua Kehn]

I'm guessing one is faster. Perhaps the one that is called “extra fast.”

Best,

–Josh

____________________________________

Joshua Kehn | @joshkehn

http://joshuakehn.com

On Aug 28, 2012, at 10:37 PM, Chris Bolton <c...@chrisbolton.me> wrote:

What is the exact difference between "normal" sync and "extra fast" sync?

--
You received this message because you are subscribed to the Google Groups "Singly API" group.
To view this discussion on the web visit https://groups.google.com/d/msg/singlyapi/-/VSVAcv1MDgoJ.
To post to this group, send email to sing...@googlegroups.com.
To unsubscribe from this group, send email to singlyapi+...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/singlyapi?hl=en.

[Joshua Kehn]

https://singly.com/features?extrafastsync=true

> All the data you need, delivered right when you need it. Singly's Extra Fast Sync option is for apps that need the most up-to-date data. 

I read this as Extra Fast sync gives you faster access to new data than normal sync. How much faster would be a better question.

[Chris Bolton]

That's exactly what I asked, what the exact difference is. Saying it gives "faster access" doesn't really give me any useful info in of itself.

[Joshua Kehn]

A better question might be what is the average latency between a post occurring on a network and it being available on the Singly API for normal and extra fast sync.

FWIW I'm curious as well.

Best,

–Josh

____________________________________

Joshua Kehn | @joshkehn

http://joshuakehn.com

[Kristján Pétursson]

Very good question. Honestly, we don't have hard numbers yet; we're going to have to see how things perform at scale and what kind of speed we can get after more optimization. It will depend on API rate limits, how much data your users produce, our own processing power, etc.

For now, I'd consider "normal" to be on the order of daily and "extra fast" to be more like 15-minute-ly. Really, the latter is "as fast as we can", and our workers should be able to expand so that Singly is a minimal bottleneck.

As examples, Ketchupp is perfectly happy with the normal rate, while Showw.Me wants closer to realtime data.

[Chris Bolton]

Hm.. really, should be something around 15 minutes? I have extra fast sync enabled and at the time of this post the last update it's giving me for my twitter timeline is just over a day ago.

[Justin Parker]

We're looking into it right now, Chris. Last I heard extra-fast syncing time should be around 1 hour at most, with plans to increase the speed shortly.

We'll get back to you on why you're seeing times that are longer than this.

[Justin Parker]

Just an update:

The issue was that, while our servers were continuously syncing, the scheduling wasn't perfect so some users were getting synced regularly while other users fell behind. Work is being done this week to make this better.

I'll be back with more updates, but you should see the syncing speed improve in a matter of days!

[Chris Bolton]

Some more things I noticed when checking back today:

- Facebook is five hours old.

- Twitter is about two weeks old =/.

- On the most recent fb post (only one I checked) it mentions the post has nine comments (which is correct) but only includes two of them.

[Chris Bolton]

Would like to use singly, but... seems to still be a lot of inconsistency all over the place.

[Justin Parker]

Sorry that you're running into these problems! Tomorrow I'll be able to determine why syncing is occurring so irregularly for your account. Expect an update in the morning hours.

Also, on a mostly unrelated note, thanks so much for choosing to give feedback rather than just walk away -- we really do use it to determine where to focus our efforts and where to make improvements.

The data is indeed not perfect. We're constantly improving our syncing ability and the consistency of the data: both hard problems because of the complexity of the systems and code required to interface with all of the APIs, which themselves sometimes return incomplete data.

I realize you're feeling some pain here, but it is my belief that not using something like Singly is even harder and more inconsistent. I promise that we're working as hard as we can to make your experience a good one!

Justin

On Thu, Sep 13, 2012 at 7:36 PM, Chris Bolton <c...@chrisbolton.me> wrote:

Would like to use singly, but... seems to still be a lot of inconsistency all over the place.

--

You received this message because you are subscribed to the Google Groups "Singly API" group.

To view this discussion on the web visit https://groups.google.com/d/msg/singlyapi/-/aqnvhlRq5o4J.

[Simon Murtha-Smith]

Hey Chris -

Which Facebook endpoint? Some endpoints only sync every 24hrs (friends). You can see the full list of service frequencies at: https://api.singly.com/services.

Do you have your own Twitter API keys set? For Twitter to work, you need have your own Twitter API keys set (this changed recently).

We will take a look at the FB comments issue. Can you email me (just me!) your Singly access token and the call you are making so I can check it out?


simon

To view this discussion on the web visit https://groups.google.com/d/msg/singlyapi/-/UfMCHHs23X8J.

[Jeremie Miller]

I've been working all morning to track down some competition between the part of our system that adaptively syncs (more often if the feed returns more data, slows down if it's less) with the fast sync feature that should disable that.  Fixes are getting deployed right now to force-lock into the fast time when any app has fast sync turned on, so that should most definitely improve.

On facebook, unfortunately their api only returns the latest two comments when you fetch a post (since there could be hundreds or thousands even), and they return pagination urls to go get all the comments as needed.  Do you have a need to have all those comments pulled down all the time?

We're all in the chatroom at http://support.singly.com all day if there's any quick questions we can help with too, thanks!

Jer

To view this discussion on the web visit https://groups.google.com/d/msg/singlyapi/-/UfMCHHs23X8J.

[Chris Bolton]

I'm still not getting any twitter posts past Aug. 30th. Any updates?

[Jeremie Miller]

Twitter's API isn't returning for your account (we're working on a better dashboard and api endpoints to show these kinds of error cases), I'll email you directly with more detail :)

Jer

--

You received this message because you are subscribed to the Google Groups "Singly API" group.

To view this discussion on the web visit https://groups.google.com/d/msg/singlyapi/-/8h4GabIl9GAJ.