Redis Get key takes 250 milliseconds with aioredis

[raghavan p]

I connect to redis using aioredis as below and measure the GET time.

    conn = await aioredis.create_connection(
        os.getenv('REDIS_URI'), password=os.getenv('REDIS_PASSWORD')
    )
    t1 = time.time()
    val = await conn.execute('GET', 'testkey') #value is b'Hello'
    print(time.time() -t1) # prints 0.2516293525695801

Everytime, I get response as around 250 milliseconds. Whereas, if I execute below in redis-cli, I see the result in 3 microseconds

 

  redis redis-PORT.*-centrMULTI
    OK
    redis redis-PORT.*-centrTIME
    QUEUED
    redis redis-PORT.*-centrGET testkey
    QUEUED
    redis redis-PORT.*-centrTIME
    QUEUED
    redis redis-PORT.*-centrEXEC
    1) 1) "1590701669"
       2) "54837"
    2) "Hello"
    3) 1) "1590701669"
       2) "54840"

Is 250 ms just network latency? Is there any way to reduce it?

[Itamar Haber]

Hello Raghavan,

It may be that the connection in your snippet isn't actually opened until it is first used (I'm not familiar w/ aioredis personally) - to assert that/work around you can add a call to `PING` just before you start timing and getting the key.

Cheers,

--
You received this message because you are subscribed to the Google Groups "Redis DB" group.
To unsubscribe from this group and stop receiving emails from it, send an email to redis-db+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/redis-db/c9f592d7-1cec-4397-a92f-a9ef0ed6df81%40googlegroups.com.

--

Itamar Haber Technicalist Evangely Phone: +972.54.567.9692

Disclaimer

The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.

This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more Click Here.

[raghavan p]

Hi Itamar,

I do not have ping attribute in conn object. I added conn.address and that prints ('x.x.x.x', PORT) - connected host and port which shows its connected before it GETs the key.

    conn = await aioredis.create_connection(
        os.getenv('REDIS_URI'), password=os.getenv('REDIS_PASSWORD')
    )


    print(conn.address) 
    t1 = time.time()

[Itamar Haber]

> I do not have ping attribute in conn object

I believe there is one actaully: https://aioredis.readthedocs.io/en/v1.3.0/mixins.html#aioredis.Redis.ping

In any case, I can't reproduce this:

❯ python test.py
('::1', 6379)
0.00026106834411621094
❯ cat test.py
import time
import asyncio
import aioredis

async def go():
    conn = await aioredis.create_connection('redis://localhost')

    print(conn.address)
    t1 = time.time()
    val = await conn.execute('GET', 'testkey') #value is b'Hello'
    print(time.time() -t1) # prints 0.2516293525695801

asyncio.run(go())

--
You received this message because you are subscribed to the Google Groups "Redis DB" group.
To unsubscribe from this group and stop receiving emails from it, send an email to redis-db+u...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/redis-db/ed99d497-1658-4b1c-9a5f-1db862ccc492%40googlegroups.com.

[Benjamin Sergeant]

Shameless plug for my client library, with another asyncio python library (the library does the connection in the timing)

But it's nowhere near 250ms

https://github.com/machinezone/rcc/

(venv) examples$ python connect_and_get_key.py

0.006410121917724609

(venv) examples$ python connect_and_get_key.py

0.006173372268676758

'''Connect and get a key

Copyright (c) 2020 Machine Zone, Inc. All rights reserved.

'''

import asyncio

import time

from rcc.client import RedisClient

async def getKey():

    client = RedisClient()

    start = time.time()

    res = await client.send('GET', 'testkey')

    print(time.time() - start)

if __name__ == '__main__':

    asyncio.get_event_loop().run_until_complete(getKey())

To view this discussion on the web visit https://groups.google.com/d/msgid/redis-db/CAFWLiegRk572BMUsuRp372%3DVy7Xir0L6Tq4L0HxbCMU0KpwNyw%40mail.gmail.com.

[Itamar Haber]

Nothing to be ashamed about, the exact opposite in fact @bsergean

To view this discussion on the web visit https://groups.google.com/d/msgid/redis-db/D1EB98E6-8F38-4A6F-A604-1D6DDAD0C210%40gmail.com.

[Benjamin Sergeant]

Thanks :)

The real reason for writing this was that aioredis still doesn't support redis cluster, and it has been that way for a long time. It's a shame because the library is good quality, but lately the activity is a quite dormant.

To view this discussion on the web visit https://groups.google.com/d/msgid/redis-db/CAFWLieifv7GD2_rEWN6nQMSAPeGB9nUaGhPxrJm%3DEBQvuj-1uw%40mail.gmail.com.