Is there a limit to the size of what can be stored in a given key?

Showing 1-5 of 5 messages
Is there a limit to the size of what can be stored in a given key? Gitted 2/23/11 12:24 PM
What is the limit to what can be stored in a key?

i.e. is storing an article appropriate? (so it would be of type string
UTF-8 I would presume)
Re: [project-voldemort] Is there a limit to the size of what can be stored in a given key? Alex Feinberg 2/23/11 1:50 PM
There is no limit in Voldemort itself. That said, there's a practical
limit: since the values are stored on disk and retrieved in a single
operation, rather than streamed. Storing whole article makes sense and
is reasonable. At LinkedIn, we have several values that exceed a few
mb (but they're very rare "one-offs") and routinely use values that
are 15kb in size (e.g., when you share an article on LinkedIn, a
thumbnail picture from that article is stored in Voldemort). On the
other hand, if you're looking to store full size photographs or video,
Voldemort is not the right tool (Amazon's S3, MogileFS or something
like Facebook's "Haystack" would be the right solution).

Thanks,
- Alex

> --
> You received this message because you are subscribed to the Google Groups "project-voldemort" group.
> To post to this group, send email to project-...@googlegroups.com.
> To unsubscribe from this group, send email to project-voldem...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/project-voldemort?hl=en.
>
>

Re: [project-voldemort] Is there a limit to the size of what can be stored in a given key? Gitted 2/23/11 2:19 PM
Say I wanted to create an application like google groups, and store each forum message/post in voldermort, would that be suitable?

I guess 'yes' since you said an article would be a good fit.

in this case, your reply to my quesiton was about .6kb in size, but ofcourse some replies may be much larger....
Re: [project-voldemort] Is there a limit to the size of what can be stored in a given key? Liam 2/24/11 1:27 AM
We have a V cluster of nearly 5 million protobuf objects with an avg
object size of around 18k.  Works extremely well, even in our heavy
write environment.

liam

> --
> You received this message because you are subscribed to the Google Groups
> "project-voldemort" group.
> To post to this group, send email to project-...@googlegroups.com.
> To unsubscribe from this group, send email to
> project-voldem...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/project-voldemort?hl=en.
>

Re: [project-voldemort] Is there a limit to the size of what can be stored in a given key? Alex Feinberg 2/24/11 12:57 PM
Yes,

That configuration would work very well. We have number of use cases
where average value is small, but with some outliers.

Thanks,
- Alex

On Wed, Feb 23, 2011 at 2:19 PM, Gitted <sahme...@gmail.com> wrote:
> --
> You received this message because you are subscribed to the Google Groups
> "project-voldemort" group.
> To post to this group, send email to project-...@googlegroups.com.
> To unsubscribe from this group, send email to
> project-voldem...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/project-voldemort?hl=en.
>