Redis is slow while loop

[Mohan Raj]

Hi Guys,

I am having a use case where i have a loop and read redis based on keys.

On an avg to loop size of 30000, it is taking more than 30 secs from Java Jedis Library.

Any thoughts or suggestions please.

[sundb]

Hi, How do you do a loop through all the keys in any way?

[Greg Andrews]

"KEYS *" will return the list of key names to the client, then the client can iterate over the list, sending a command for each key (perhaps 'TTL keyname' or 'EXPIRETIME keyname').

My suggestion to the original poster is an echo of the warning message found in the description of the KEYS command at:  https://redis.io/commands/keys

    It may ruin performance when it is executed against large databases. This command is intended for debugging and special operations,

    such as changing your keyspace layout. Don't use KEYS in your regular application code. If you're looking for a way to find keys

    in a subset of your keyspace, consider using SCAN or sets.

[Mohan Raj]

Hey,

We form the key from the client and get it from redis using get keys.

Which is taking time even if I set the no of client connections to the maximum.

--
You received this message because you are subscribed to the Google Groups "Redis DB" group.
To unsubscribe from this group and stop receiving emails from it, send an email to redis-db+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/redis-db/ea309503-aa9c-4514-a928-dad2c0b3efe5n%40googlegroups.com.

[sundb]

If you're sending 30,000 get commands, it's really going to be slow.

You might consider using the redis pipeline to send all your commands to redis at once.

[sundb]

If all keys are string, you can use mget command.

[Mohan Raj]

Sure let me try that.

To view this discussion on the web visit https://groups.google.com/d/msgid/redis-db/1bb6faa1-c532-41c5-8145-ffc57157e1a9n%40googlegroups.com.

[Mehedi Hasan]

Keys is a blocking command. You can try scan if you know the naming patters of your redis keys beforehand.  

To view this discussion on the web visit https://groups.google.com/d/msgid/redis-db/CAAhJiL-m7dxQZk%3D-qCv2Ba%2BFGNaPFQY4SrwQyu5%3DAJ5%3DPR_OjQ%40mail.gmail.com.

[Mohan Raj]

That makes sense thanks.

To view this discussion on the web visit https://groups.google.com/d/msgid/redis-db/CANVNL6dZsjGVRnv-0JiL2eqpEkUX%3DSeroioCydeQoTwo4QCiwQ%40mail.gmail.com.