Youporn.com is now a 100% Redis Site - Redis DB

The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Message from discussion Youporn.com is now a 100% Redis Site
Received-SPF: pass (google.com: best guess record for domain of Eric.Pic...@manwin.com designates 206.162.131.147 as permitted sender) client-ip=206.162.131.147;
From: Eric Pickup <Eric.Pic...@manwin.com>
To: "redis-db@googlegroups.com" <redis-db@googlegroups.com>
Subject: RE: Youporn.com is now a 100% Redis Site
Thread-Topic: Youporn.com is now a 100% Redis Site
Thread-Index: AQHM7E5nQFdTnp0jeUaSJpmlyfFiMpY/jjoAgAAZ3nA=
Date: Thu, 16 Feb 2012 18:04:55 +0000
Message-ID: <A1055304917AC044A0984D88F99DD9A408270B@NAYUL-EX3.na.manwin.local>
References: <a91b97a7-73c6-4c72-bb18-472afc5c2aa4@w1g2000vbg.googlegroups.com>
 <CA+XzkVdwGh+=X=mvCps1vCn9QJMLC3=Qzd3ceY7ZG1VEB1u+Nw@mail.gmail.com>
In-Reply-To: <CA+XzkVdwGh+=X=mvCps1vCn9QJMLC3=Qzd3ceY7ZG1VEB1u+Nw@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Thanks for the logos.  I'll be posting the slides online after the talk and=
 will be working on some articles.

The talk won't cover much of anything in depth.  It is only an hour long an=
d will serve as a high-level overview of all techs used (strengths, weaknes=
ses, etc).  I'll be doing future talks and articles about the specific tech=
s used.

Most of our data itself is found in hashes with ordered sets used to know w=
hat data to show.   A typical lookup would be an zInterStore on:

videos:filters:released
Videos:filters:orientation:straight
Videos:filters:categories:{category_id}
Videos:ordering:rating

We would then do a zRange to get the pages we want and get the list of vide=
o_ids back.  We then start a pipeline and get all the videos from hashes.

We do use some key/value lookups and some lists but the majority of our ope=
rations are using the above pattern.

Eric Pickup
YouPorn Lead Developer
Manwin Canada
Office: +1.514.359.3555
Fax: +1.514.359.3556
Email: eric.pic...@manwin.com




-----Original Message-----
From: redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] On Behal=
f Of Salvatore Sanfilippo
Sent: February-16-12 4:01 AM
To: redis-db@googlegroups.com
Subject: Re: Youporn.com is now a 100% Redis Site

Hello Eric, these are serious numbers indeed! Very cool.

I would love to see the slides after your talk, don't want you to reveal to=
o much things before the event ;) But I'm super curious about what kind of =
operatons you use!

Thanks for sharing, if you happen to have issues with Redis we are here to =
help.

On Thu, Feb 16, 2012 at 2:57 AM, Eric Pickup <eric.pic...@manwin.com> wrote=
:
> I just want to let the devs know that Youporn.com relaunched two weeks
> ago with Redis as our primary database.  With @100 million page views
> per day, our cluster of Redis slaves are handling over 300k queries
> per second.
>
> After the switchover we had to add some additional Redis nodes but not
> because Redis was overworked but because the network cards couldn't
> keep up with Redis.
>
> Everyone involved has been more than impressed with Redis'
> performance.
>
> All reads come from Redis;  we are maintaining MySQL just to allow us
> to build new sorted sets as our requirement change.
>
> I'm going to be doing the keynote a major Canadian tech conference
> (confoo.ca) about the youporn.com rewrite and one of the major topics
> will be Redis and how much it helped us.
>
> Do you guys have a logo that would look good on a white background?  I
> want to make you guys stand out.
>
> Thanks for the great software!
>
> ~Eric
>
> --
> You received this message because you are subscribed to the Google Groups=
 "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to redis-db+unsubscribe@google=
groups.com.
> For more options, visit this group at http://groups.google.com/group/redi=
s-db?hl=3Den.
>



--
Salvatore 'antirez' Sanfilippo
open source developer - VMware

http://invece.org
"We are what we repeatedly do. Excellence, therefore, is not an act, but a =
habit." -- Aristotele

--
You received this message because you are subscribed to the Google Groups "=
Redis DB" group.
To post to this group, send email to redis-db@googlegroups.com.
To unsubscribe from this group, send email to redis-db+unsubscribe@googlegr=
oups.com.
For more options, visit this group at http://groups.google.com/group/redis-=
db?hl=3Den.

This e-mail may be privileged and/or confidential, and the sender does not =
waive any related rights and obligations. Any distribution, use or copying =
of this e-mail or the information it contains by other than an intended rec=
ipient is unauthorized. If you received this e-mail in error, please advise=
 me (by return e-mail or otherwise) immediately. Ce courrier =E9lectronique=
 est confidentiel et prot=E9g=E9. L'exp=E9diteur ne renonce pas aux droits =
et obligations qui s'y rapportent. Toute diffusion, utilisation ou copie de=
 ce message ou des renseignements qu'il contient par une personne autre que=
 le (les) destinataire(s) d=E9sign=E9(s) est interdite. Si vous recevez ce =
courrier =E9lectronique par erreur, veuillez m'en aviser imm=E9diatement, p=
ar retour de courrier =E9lectronique ou par un autre moyen.
Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
Account Options
