Re: redis on YCSB

559 views
Skip to first unread message

Syed Kewaan Ejaz

unread,
Nov 30, 2012, 2:36:38 PM11/30/12
to redi...@googlegroups.com
Hi,

I had some experience running YCSB with Redis. You got to configure the right amount of threads (if you haven't) while trying to achieve X ops/sec. At least, that's how I solved my problem. Hope that helps! :)

On Fri, Nov 30, 2012 at 6:58 PM, Alex Wang <csimpl...@gmail.com> wrote:

Hello, everyone, I am benchmarking Redis by using YCSB(yahoo cloud system benchmark).
I configure 100 clients to insert 20000000 rows data to one Redis server, At first, Redis works
well and its throughput is about 10000 ops/sec. However, after several minutes, throughput decreased to about 100 ops/sec !

Has anybody encountered this problem before and know why ?
Thanks advanced. :-)

Best regards

--
You received this message because you are subscribed to the Google Groups "Redis DB" group.
To view this discussion on the web visit https://groups.google.com/d/msg/redis-db/-/HNzYEvd2bPMJ.
To post to this group, send email to redi...@googlegroups.com.
To unsubscribe from this group, send email to redis-db+u...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/redis-db?hl=en.



--
Best Regards, 
Kewaan.

Yiftach Shoolman

unread,
Nov 30, 2012, 2:39:02 PM11/30/12
to Alex Wang, redi...@googlegroups.com
Please send more details on your setup, and the Redis.conf file you
ised, there could be various of reasons for that, such as a wrong data
persistence configuration and many others.

One more thing, which Redis data type do you use ? It is hard to
understand what do you mean by 'rows data'

Sent from my iPhone

Salvatore Sanfilippo

unread,
Nov 30, 2012, 2:52:14 PM11/30/12
to Redis DB
From the "20000000" rows I guess you just go out of memory and the
system starts swapping.

Also 10k IOPS with Redis is too low unless you are using a Raspberry
PI, so something is wrong with the benchmark itself.
I don't trust the YCSB benchmark at all btw, because the only way to
benchmark N databases if you want some true number is:

1) Select an use case.
2) Write a DB-specific implementation for every DB that implements the
use case with the best construct available.
3) Benchmark with a persistence configuration that offers similar guarantees.

Without to mention all the variables like library client
implementation and so forth.

Cheers,
Salvatore

On Fri, Nov 30, 2012 at 6:58 PM, Alex Wang <csimpl...@gmail.com> wrote:
>
> Hello, everyone, I am benchmarking Redis by using YCSB(yahoo cloud system
> benchmark).
> I configure 100 clients to insert 20000000 rows data to one Redis server, At
> first, Redis works
> well and its throughput is about 10000 ops/sec. However, after several
> minutes, throughput decreased to about 100 ops/sec !
>
> Has anybody encountered this problem before and know why ?
> Thanks advanced. :-)
>
> Best regards
>
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/redis-db/-/HNzYEvd2bPMJ.
> To post to this group, send email to redi...@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+u...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.



--
Salvatore 'antirez' Sanfilippo
open source developer - VMware
http://invece.org

Beauty is more important in computing than anywhere else in technology
because software is so complicated. Beauty is the ultimate defence
against complexity.
— David Gelernter

Felix Gallo

unread,
Nov 30, 2012, 3:00:03 PM11/30/12
to redi...@googlegroups.com
YCSB is beyond terrible; Yahoo should be embarrassed that they let that one get out into the community with their name on it.  The particular redis test setup boggles the mind, and pretty much had to be done by a bored summer intern...

F.

Syed Kewaan Ejaz

unread,
Dec 10, 2012, 2:06:43 AM12/10/12
to redi...@googlegroups.com
Hi,

try this;

 prompt$ ycsb-0.1.4/bin/ycsb run redis -P ycsb-0.1.4/workloads/workloada -p redis.host=localhost -p redis.port=6379


On Mon, Dec 10, 2012 at 4:32 AM, Cornelius Lee <super....@gmail.com> wrote:

Hi everyone,

I am trying to run ./bin/ycsb shell redis to check I can connect to my RedisDB server through the shell.

However, I encounter this error message.

Exception in thread "main" java.lang.IllegalArgumentException: hostname can't be null
at java.net.InetSocketAddress.(InetSocketAddress.java:139)
at redis.clients.jedis.Connection.connect(Connection.java:119)
at redis.clients.jedis.BinaryClient.connect(BinaryClient.java:54)
at redis.clients.jedis.BinaryJedis.connect(BinaryJedis.java:1657)
at com.yahoo.ycsb.db.RedisClient.init(RedisClient.java:49)
at com.yahoo.ycsb.CommandLine.main(CommandLine.java:210)

any ideas?

Thank you.

Kind regards,
Cornelius

--
You received this message because you are subscribed to the Google Groups "Redis DB" group.
To view this discussion on the web visit https://groups.google.com/d/msg/redis-db/-/BWkWl2iM0wwJ.

To post to this group, send email to redi...@googlegroups.com.
To unsubscribe from this group, send email to redis-db+u...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/redis-db?hl=en.



--
Best Regards, 
Kewaan.

Reply all
Reply to author
Forward
0 new messages