Our redis server can spike up its io usage from time to time. And when that happens we tend to have more connection problems to redis.
If possible I would like to try to reduce redis's io usage. checking the conf file. The following configuration looks like it could help reduce io usage: -CONFIG set save "900 1 300 50000 60 100000" -"append only file" is already turned off.
How about other options?
For instance: Would setting linux's overcommit_memory to 1 help reduce redis's io usage?
On Sun, Sep 30, 2012 at 3:47 PM, Haluk AKIN <haluka...@gmail.com> wrote:
> Hello,
> Our redis server can spike up its io usage from time to time. And when
> that happens we tend to have more connection problems to redis.
> If possible I would like to try to reduce redis's io usage.
> checking the conf file. The following configuration looks like it could
> help reduce io usage:
> -CONFIG set save "900 1 300 50000 60 100000"
> -"append only file" is already turned off.
> How about other options?
> For instance:
> Would setting linux's overcommit_memory to 1 help reduce redis's io usage?
> Thanks,
> Haluk
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/redis-db/-/ggd815PGsScJ.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.
I hadn't thought of (config set save ""). I now pushed this configuration to
production.
I'll post an update probably tomorrow on how the results are. Maybe this
could also reduce connection problems.
Thanks,
Haluk
From: redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] On Behalf
Of Dvir Volk
Sent: Sunday, September 30, 2012 5:09 PM
To: redis-db@googlegroups.com
Subject: Re: How to reduce redis io usage
do the IO spikes occur when redis is dumping to disk?
have you tried not persisting at all (CONFIG SET SAVE "")?
BTW is this an AWS instance?
On Sun, Sep 30, 2012 at 3:47 PM, Haluk AKIN <haluka...@gmail.com> wrote:
Hello,
Our redis server can spike up its io usage from time to time. And when that
happens we tend to have more connection problems to redis.
If possible I would like to try to reduce redis's io usage.
checking the conf file. The following configuration looks like it could help
reduce io usage:
-CONFIG set save "900 1 300 50000 60 100000"
-"append only file" is already turned off.
How about other options?
For instance:
Would setting linux's overcommit_memory to 1 help reduce redis's io usage?
Thanks,
Haluk
-- You received this message because you are subscribed to the Google Groups
"Redis DB" group.
To view this discussion on the web visit
https://groups.google.com/d/msg/redis-db/-/ggd815PGsScJ.
To post to this group, send email to redis-db@googlegroups.com.
To unsubscribe from this group, send email to
redis-db+unsubscribe@googlegroups.com
<mailto:redis-db%2Bunsubscribe@googlegroups.com> .
For more options, visit this group at
http://groups.google.com/group/redis-db?hl=en.
-- You received this message because you are subscribed to the Google Groups
"Redis DB" group.
To post to this group, send email to redis-db@googlegroups.com.
To unsubscribe from this group, send email to
redis-db+unsubscribe@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/redis-db?hl=en.
On Sun, Sep 30, 2012 at 7:46 AM, Haluk AKIN <haluka...@gmail.com> wrote:
> Dvir,
> This is not AWS. It is a dedicated server.
> I hadn’t thought of (config set save “”). I now pushed this configuration to
> production.
> I’ll post an update probably tomorrow on how the results are. Maybe this
> could also reduce connection problems.
> Thanks,
> Haluk
> From: redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] On Behalf
> Of Dvir Volk
> Sent: Sunday, September 30, 2012 5:09 PM
> To: redis-db@googlegroups.com
> Subject: Re: How to reduce redis io usage
> do the IO spikes occur when redis is dumping to disk?
> have you tried not persisting at all (CONFIG SET SAVE "")?
> BTW is this an AWS instance?
> On Sun, Sep 30, 2012 at 3:47 PM, Haluk AKIN <haluka...@gmail.com> wrote:
> Hello,
> Our redis server can spike up its io usage from time to time. And when that
> happens we tend to have more connection problems to redis.
> If possible I would like to try to reduce redis's io usage.
> checking the conf file. The following configuration looks like it could help
> reduce io usage:
> -CONFIG set save "900 1 300 50000 60 100000"
> -"append only file" is already turned off.
> How about other options?
> For instance:
> Would setting linux's overcommit_memory to 1 help reduce redis's io usage?
> Thanks,
> Haluk
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/redis-db/-/ggd815PGsScJ.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.
> Note that when you disable saving, you have no persistence.
> Regards,
> - Josiah
> On Sun, Sep 30, 2012 at 7:46 AM, Haluk AKIN <haluka...@gmail.com> wrote:
> > Dvir,
> > This is not AWS. It is a dedicated server.
> > I hadn’t thought of (config set save “”). I now pushed this
> configuration to
> > production.
> > I’ll post an update probably tomorrow on how the results are. Maybe this
> > could also reduce connection problems.
> > Thanks,
> > Haluk
> > From: redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] On
> Behalf
> > Of Dvir Volk
> > Sent: Sunday, September 30, 2012 5:09 PM
> > To: redis-db@googlegroups.com
> > Subject: Re: How to reduce redis io usage
> > do the IO spikes occur when redis is dumping to disk?
> > have you tried not persisting at all (CONFIG SET SAVE "")?
> > BTW is this an AWS instance?
> > On Sun, Sep 30, 2012 at 3:47 PM, Haluk AKIN <haluka...@gmail.com> wrote:
> > Hello,
> > Our redis server can spike up its io usage from time to time. And when
> that
> > happens we tend to have more connection problems to redis.
> > If possible I would like to try to reduce redis's io usage.
> > checking the conf file. The following configuration looks like it could
> help
> > reduce io usage:
> > -CONFIG set save "900 1 300 50000 60 100000"
> > -"append only file" is already turned off.
> > How about other options?
> > For instance:
> > Would setting linux's overcommit_memory to 1 help reduce redis's io
> usage?
> > Thanks,
> > Haluk
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Redis DB" group.
> > To view this discussion on the web visit
> > https://groups.google.com/d/msg/redis-db/-/ggd815PGsScJ.
> > To post to this group, send email to redis-db@googlegroups.com.
> > To unsubscribe from this group, send email to
> > redis-db+unsubscribe@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/redis-db?hl=en.
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Redis DB" group.
> > To post to this group, send email to redis-db@googlegroups.com.
> > To unsubscribe from this group, send email to
> > redis-db+unsubscribe@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/redis-db?hl=en.
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Redis DB" group.
> > To post to this group, send email to redis-db@googlegroups.com.
> > To unsubscribe from this group, send email to
> > redis-db+unsubscribe@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/redis-db?hl=en.
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.
No problem here. I think it is a solid advice. We do not need persistence on
this server. We have over 30GB of data, but it can totally rebuild itself
from scratch in case of failure. So this could even be a production
configuration for us.
So far we are definitely seeing significantly less io usage.
Tomorrow, I would like to try isolating redis to a new harddrive and observe
a bit more before I share the results.
Thanks,
Haluk
From: redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] On Behalf
Of Dvir Volk
Sent: Monday, October 01, 2012 1:03 AM
To: redis-db@googlegroups.com
Subject: Re: How to reduce redis io usage
Yeah, just to clarify: I offered it as a debugging/testing measure, not a
solution.
sent from my Sinclair ZX48
On Sep 30, 2012 10:47 PM, "Josiah Carlson" <josiah.carl...@gmail.com> wrote:
Note that when you disable saving, you have no persistence.
On Sun, Sep 30, 2012 at 7:46 AM, Haluk AKIN <haluka...@gmail.com> wrote:
> Dvir,
> This is not AWS. It is a dedicated server.
> I hadn't thought of (config set save ""). I now pushed this configuration
to
> production.
> I'll post an update probably tomorrow on how the results are. Maybe this
> could also reduce connection problems.
> Thanks,
> Haluk
> From: redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] On
Behalf
> Of Dvir Volk
> Sent: Sunday, September 30, 2012 5:09 PM
> To: redis-db@googlegroups.com
> Subject: Re: How to reduce redis io usage
> do the IO spikes occur when redis is dumping to disk?
> have you tried not persisting at all (CONFIG SET SAVE "")?
> BTW is this an AWS instance?
> On Sun, Sep 30, 2012 at 3:47 PM, Haluk AKIN <haluka...@gmail.com> wrote:
> Hello,
> Our redis server can spike up its io usage from time to time. And when
that
> happens we tend to have more connection problems to redis.
> If possible I would like to try to reduce redis's io usage.
> checking the conf file. The following configuration looks like it could
help
> reduce io usage:
> -CONFIG set save "900 1 300 50000 60 100000"
> -"append only file" is already turned off.
> How about other options?
> For instance:
> Would setting linux's overcommit_memory to 1 help reduce redis's io usage?
> Thanks,
> Haluk
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/redis-db/-/ggd815PGsScJ.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com
--
You received this message because you are subscribed to the Google Groups
"Redis DB" group.
To post to this group, send email to redis-db@googlegroups.com.
To unsubscribe from this group, send email to
redis-db+unsubscribe@googlegroups.com
<mailto:redis-db%2Bunsubscribe@googlegroups.com> .
For more options, visit this group at
http://groups.google.com/group/redis-db?hl=en.
-- You received this message because you are subscribed to the Google Groups
"Redis DB" group.
To post to this group, send email to redis-db@googlegroups.com.
To unsubscribe from this group, send email to
redis-db+unsubscribe@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/redis-db?hl=en.
On Mon, Oct 1, 2012 at 12:14 AM, Haluk AKIN <haluka...@gmail.com> wrote:
> No problem here. I think it is a solid advice. We do not need persistence
> on this server. We have over 30GB of data, but it can totally rebuild
> itself from scratch in case of failure. So this could even be a production
> configuration for us.****
> ** **
> So far we are definitely seeing significantly less io usage. ****
> Tomorrow, I would like to try isolating redis to a new harddrive and
> observe a bit more before I share the results.****
> ** **
> Thanks,****
> Haluk****
> ** **
> *From:* redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] *On
> Behalf Of *Dvir Volk
> *Sent:* Monday, October 01, 2012 1:03 AM
> *To:* redis-db@googlegroups.com
> *Subject:* Re: How to reduce redis io usage****
> ** **
> Yeah, just to clarify: I offered it as a debugging/testing measure, not a
> solution. ****
> Note that when you disable saving, you have no persistence.
> Regards,
> - Josiah
> On Sun, Sep 30, 2012 at 7:46 AM, Haluk AKIN <haluka...@gmail.com> wrote:
> > Dvir,
> > This is not AWS. It is a dedicated server.
> > I hadn’t thought of (config set save “”). I now pushed this
> configuration to
> > production.
> > I’ll post an update probably tomorrow on how the results are. Maybe this
> > could also reduce connection problems.
> > Thanks,
> > Haluk
> > From: redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] On
> Behalf
> > Of Dvir Volk
> > Sent: Sunday, September 30, 2012 5:09 PM
> > To: redis-db@googlegroups.com
> > Subject: Re: How to reduce redis io usage
> > do the IO spikes occur when redis is dumping to disk?
> > have you tried not persisting at all (CONFIG SET SAVE "")?
> > BTW is this an AWS instance?
> > On Sun, Sep 30, 2012 at 3:47 PM, Haluk AKIN <haluka...@gmail.com> wrote:
> > Hello,
> > Our redis server can spike up its io usage from time to time. And when
> that
> > happens we tend to have more connection problems to redis.
> > If possible I would like to try to reduce redis's io usage.
> > checking the conf file. The following configuration looks like it could
> help
> > reduce io usage:
> > -CONFIG set save "900 1 300 50000 60 100000"
> > -"append only file" is already turned off.
> > How about other options?
> > For instance:
> > Would setting linux's overcommit_memory to 1 help reduce redis's io
> usage?
> > Thanks,
> > Haluk
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Redis DB" group.
> > To view this discussion on the web visit
> > https://groups.google.com/d/msg/redis-db/-/ggd815PGsScJ.
> > To post to this group, send email to redis-db@googlegroups.com.
> > To unsubscribe from this group, send email to
> > redis-db+unsubscribe@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/redis-db?hl=en.
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Redis DB" group.
> > To post to this group, send email to redis-db@googlegroups.com.
> > To unsubscribe from this group, send email to
> > redis-db+unsubscribe@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/redis-db?hl=en.
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Redis DB" group.
> > To post to this group, send email to redis-db@googlegroups.com.
> > To unsubscribe from this group, send email to
> > redis-db+unsubscribe@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/redis-db?hl=en.
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.****
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.****
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.
Dvir, I haven't kept up-to-date on this particular behavior with versions
after 2.2.x. Does a Redis instance with persistence disabled still perform
a AOF creation and write when a slave is attached and sends the SYNC
command?
On Sun, Sep 30, 2012 at 3:41 PM, Dvir Volk <dvir...@gmail.com> wrote:
> if you disable persistence, redis does not touch the hard drive at all,
> and all IO is just network.
> On Mon, Oct 1, 2012 at 12:14 AM, Haluk AKIN <haluka...@gmail.com> wrote:
>> No problem here. I think it is a solid advice. We do not need persistence
>> on this server. We have over 30GB of data, but it can totally rebuild
>> itself from scratch in case of failure. So this could even be a production
>> configuration for us.****
>> ** **
>> So far we are definitely seeing significantly less io usage. ****
>> Tomorrow, I would like to try isolating redis to a new harddrive and
>> observe a bit more before I share the results.****
>> ** **
>> Thanks,****
>> Haluk****
>> ** **
>> *From:* redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] *On
>> Behalf Of *Dvir Volk
>> *Sent:* Monday, October 01, 2012 1:03 AM
>> *To:* redis-db@googlegroups.com
>> *Subject:* Re: How to reduce redis io usage****
>> ** **
>> Yeah, just to clarify: I offered it as a debugging/testing measure, not a
>> solution. ****
>> Note that when you disable saving, you have no persistence.
>> Regards,
>> - Josiah
>> On Sun, Sep 30, 2012 at 7:46 AM, Haluk AKIN <haluka...@gmail.com> wrote:
>> > Dvir,
>> > This is not AWS. It is a dedicated server.
>> > I hadn’t thought of (config set save “”). I now pushed this
>> configuration to
>> > production.
>> > I’ll post an update probably tomorrow on how the results are. Maybe this
>> > could also reduce connection problems.
>> > Thanks,
>> > Haluk
>> > From: redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] On
>> Behalf
>> > Of Dvir Volk
>> > Sent: Sunday, September 30, 2012 5:09 PM
>> > To: redis-db@googlegroups.com
>> > Subject: Re: How to reduce redis io usage
>> > do the IO spikes occur when redis is dumping to disk?
>> > have you tried not persisting at all (CONFIG SET SAVE "")?
>> > BTW is this an AWS instance?
>> > On Sun, Sep 30, 2012 at 3:47 PM, Haluk AKIN <haluka...@gmail.com>
>> wrote:
>> > Hello,
>> > Our redis server can spike up its io usage from time to time. And when
>> that
>> > happens we tend to have more connection problems to redis.
>> > If possible I would like to try to reduce redis's io usage.
>> > checking the conf file. The following configuration looks like it could
>> help
>> > reduce io usage:
>> > -CONFIG set save "900 1 300 50000 60 100000"
>> > -"append only file" is already turned off.
>> > How about other options?
>> > For instance:
>> > Would setting linux's overcommit_memory to 1 help reduce redis's io
>> usage?
>> > Thanks,
>> > Haluk
>> > --
>> > You received this message because you are subscribed to the Google
>> Groups
>> > "Redis DB" group.
>> > To view this discussion on the web visit
>> > https://groups.google.com/d/msg/redis-db/-/ggd815PGsScJ.
>> > To post to this group, send email to redis-db@googlegroups.com.
>> > To unsubscribe from this group, send email to
>> > redis-db+unsubscribe@googlegroups.com.
>> > For more options, visit this group at
>> > http://groups.google.com/group/redis-db?hl=en.
>> > --
>> > You received this message because you are subscribed to the Google
>> Groups
>> > "Redis DB" group.
>> > To post to this group, send email to redis-db@googlegroups.com.
>> > To unsubscribe from this group, send email to
>> > redis-db+unsubscribe@googlegroups.com.
>> > For more options, visit this group at
>> > http://groups.google.com/group/redis-db?hl=en.
>> > --
>> > You received this message because you are subscribed to the Google
>> Groups
>> > "Redis DB" group.
>> > To post to this group, send email to redis-db@googlegroups.com.
>> > To unsubscribe from this group, send email to
>> > redis-db+unsubscribe@googlegroups.com.
>> > For more options, visit this group at
>> > http://groups.google.com/group/redis-db?hl=en.
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Redis DB" group.
>> To post to this group, send email to redis-db@googlegroups.com.
>> To unsubscribe from this group, send email to
>> redis-db+unsubscribe@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/redis-db?hl=en.****
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Redis DB" group.
>> To post to this group, send email to redis-db@googlegroups.com.
>> To unsubscribe from this group, send email to
>> redis-db+unsubscribe@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/redis-db?hl=en.****
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Redis DB" group.
>> To post to this group, send email to redis-db@googlegroups.com.
>> To unsubscribe from this group, send email to
>> redis-db+unsubscribe@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/redis-db?hl=en.
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.
oh, I forgot about that one :) yeah, it's not AOF but RDB dump when a slave
connects to it. for 30GB of data, even on a physical server this can cause
the redis instance to halt a bit while we fork. but that's far more rare
(hopefully!) than forking for BGSAVE or rewriting AOFs every few minutes.
On Mon, Oct 1, 2012 at 1:29 AM, Greg Andrews <hvar...@gmail.com> wrote:
> Dvir, I haven't kept up-to-date on this particular behavior with versions
> after 2.2.x. Does a Redis instance with persistence disabled still perform
> a AOF creation and write when a slave is attached and sends the SYNC
> command?
> -Greg
> On Sun, Sep 30, 2012 at 3:41 PM, Dvir Volk <dvir...@gmail.com> wrote:
>> if you disable persistence, redis does not touch the hard drive at all,
>> and all IO is just network.
>> On Mon, Oct 1, 2012 at 12:14 AM, Haluk AKIN <haluka...@gmail.com> wrote:
>>> No problem here. I think it is a solid advice. We do not need
>>> persistence on this server. We have over 30GB of data, but it can totally
>>> rebuild itself from scratch in case of failure. So this could even be a
>>> production configuration for us.****
>>> ** **
>>> So far we are definitely seeing significantly less io usage. ****
>>> Tomorrow, I would like to try isolating redis to a new harddrive and
>>> observe a bit more before I share the results.****
>>> ** **
>>> Thanks,****
>>> Haluk****
>>> ** **
>>> *From:* redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] *On
>>> Behalf Of *Dvir Volk
>>> *Sent:* Monday, October 01, 2012 1:03 AM
>>> *To:* redis-db@googlegroups.com
>>> *Subject:* Re: How to reduce redis io usage****
>>> ** **
>>> Yeah, just to clarify: I offered it as a debugging/testing measure, not
>>> a solution. ****
>>> Note that when you disable saving, you have no persistence.
>>> Regards,
>>> - Josiah
>>> On Sun, Sep 30, 2012 at 7:46 AM, Haluk AKIN <haluka...@gmail.com> wrote:
>>> > Dvir,
>>> > This is not AWS. It is a dedicated server.
>>> > I hadn’t thought of (config set save “”). I now pushed this
>>> configuration to
>>> > production.
>>> > I’ll post an update probably tomorrow on how the results are. Maybe
>>> this
>>> > could also reduce connection problems.
>>> > Thanks,
>>> > Haluk
>>> > From: redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] On
>>> Behalf
>>> > Of Dvir Volk
>>> > Sent: Sunday, September 30, 2012 5:09 PM
>>> > To: redis-db@googlegroups.com
>>> > Subject: Re: How to reduce redis io usage
>>> > do the IO spikes occur when redis is dumping to disk?
>>> > have you tried not persisting at all (CONFIG SET SAVE "")?
>>> > BTW is this an AWS instance?
>>> > On Sun, Sep 30, 2012 at 3:47 PM, Haluk AKIN <haluka...@gmail.com>
>>> wrote:
>>> > Hello,
>>> > Our redis server can spike up its io usage from time to time. And when
>>> that
>>> > happens we tend to have more connection problems to redis.
>>> > If possible I would like to try to reduce redis's io usage.
>>> > checking the conf file. The following configuration looks like it
>>> could help
>>> > reduce io usage:
>>> > -CONFIG set save "900 1 300 50000 60 100000"
>>> > -"append only file" is already turned off.
>>> > How about other options?
>>> > For instance:
>>> > Would setting linux's overcommit_memory to 1 help reduce redis's io
>>> usage?
>>> > Thanks,
>>> > Haluk
>>> > --
>>> > You received this message because you are subscribed to the Google
>>> Groups
>>> > "Redis DB" group.
>>> > To view this discussion on the web visit
>>> > https://groups.google.com/d/msg/redis-db/-/ggd815PGsScJ.
>>> > To post to this group, send email to redis-db@googlegroups.com.
>>> > To unsubscribe from this group, send email to
>>> > redis-db+unsubscribe@googlegroups.com.
>>> > For more options, visit this group at
>>> > http://groups.google.com/group/redis-db?hl=en.
>>> > --
>>> > You received this message because you are subscribed to the Google
>>> Groups
>>> > "Redis DB" group.
>>> > To post to this group, send email to redis-db@googlegroups.com.
>>> > To unsubscribe from this group, send email to
>>> > redis-db+unsubscribe@googlegroups.com.
>>> > For more options, visit this group at
>>> > http://groups.google.com/group/redis-db?hl=en.
>>> > --
>>> > You received this message because you are subscribed to the Google
>>> Groups
>>> > "Redis DB" group.
>>> > To post to this group, send email to redis-db@googlegroups.com.
>>> > To unsubscribe from this group, send email to
>>> > redis-db+unsubscribe@googlegroups.com.
>>> > For more options, visit this group at
>>> > http://groups.google.com/group/redis-db?hl=en.
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "Redis DB" group.
>>> To post to this group, send email to redis-db@googlegroups.com.
>>> To unsubscribe from this group, send email to
>>> redis-db+unsubscribe@googlegroups.com.
>>> For more options, visit this group at
>>> http://groups.google.com/group/redis-db?hl=en.****
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "Redis DB" group.
>>> To post to this group, send email to redis-db@googlegroups.com.
>>> To unsubscribe from this group, send email to
>>> redis-db+unsubscribe@googlegroups.com.
>>> For more options, visit this group at
>>> http://groups.google.com/group/redis-db?hl=en.****
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "Redis DB" group.
>>> To post to this group, send email to redis-db@googlegroups.com.
>>> To unsubscribe from this group, send email to
>>> redis-db+unsubscribe@googlegroups.com.
>>> For more options, visit this group at
>>> http://groups.google.com/group/redis-db?hl=en.
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Redis DB" group.
>> To post to this group, send email to redis-db@googlegroups.com.
>> To unsubscribe from this group, send email to
>> redis-db+unsubscribe@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/redis-db?hl=en.
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.
On Sun, Sep 30, 2012 at 04:29:50PM -0700, Greg Andrews wrote:
> Dvir, I haven't kept up-to-date on this particular behavior with versions
> after 2.2.x. Does a Redis instance with persistence disabled still perform
> a AOF creation and write when a slave is attached and sends the SYNC
> command?
It's an RDB, but yes, connecting a slave triggers an RDB creation on the
master, and that RDB will be copied to disk on the slave before being
loaded into memory.
Wow, the copy to disk on the slave side is a new one to me. Maybe that's
how recent versions prevent the slave from blocking all querys during the
SYNC.
On Sun, Sep 30, 2012 at 4:38 PM, Matthew Palmer <mpal...@hezmatt.org> wrote:
> On Sun, Sep 30, 2012 at 04:29:50PM -0700, Greg Andrews wrote:
> > Dvir, I haven't kept up-to-date on this particular behavior with versions
> > after 2.2.x. Does a Redis instance with persistence disabled still
> perform
> > a AOF creation and write when a slave is attached and sends the SYNC
> > command?
> It's an RDB, but yes, connecting a slave triggers an RDB creation on the
> master, and that RDB will be copied to disk on the slave before being
> loaded into memory.
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.
Redis has been able to not block on requests during sync for quite a
while (maybe since 2.0). Somewhere around version 2.0 is also when
Redis got the option to serve stale data when sync had been lost (the
default in pre-2.0 versions), or to return an error (the new default).
And I am pretty sure that writing the incoming rdb to disk and being
able to serve requests prior to complete startup are independent and
unrelated. Redis should have always been writing incoming dumps to
disk, it's just that returning something during load was something
that would be useful to know (instead of blocking on startup).
On Sun, Sep 30, 2012 at 4:43 PM, Greg Andrews <hvar...@gmail.com> wrote:
> Wow, the copy to disk on the slave side is a new one to me. Maybe that's
> how recent versions prevent the slave from blocking all querys during the
> SYNC.
> -Greg
> On Sun, Sep 30, 2012 at 4:38 PM, Matthew Palmer <mpal...@hezmatt.org> wrote:
>> On Sun, Sep 30, 2012 at 04:29:50PM -0700, Greg Andrews wrote:
>> > Dvir, I haven't kept up-to-date on this particular behavior with
>> > versions
>> > after 2.2.x. Does a Redis instance with persistence disabled still
>> > perform
>> > a AOF creation and write when a slave is attached and sends the SYNC
>> > command?
>> It's an RDB, but yes, connecting a slave triggers an RDB creation on the
>> master, and that RDB will be copied to disk on the slave before being
>> loaded into memory.
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Redis DB" group.
>> To post to this group, send email to redis-db@googlegroups.com.
>> To unsubscribe from this group, send email to
>> redis-db+unsubscribe@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/redis-db?hl=en.
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.
This worked just fine. Once I set "save" configuration to nothing, io usage
drops to zero.
Thank you,
Haluk
From: redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] On Behalf
Of Dvir Volk
Sent: Monday, October 01, 2012 1:03 AM
To: redis-db@googlegroups.com
Subject: Re: How to reduce redis io usage
Yeah, just to clarify: I offered it as a debugging/testing measure, not a
solution.
sent from my Sinclair ZX48
On Sep 30, 2012 10:47 PM, "Josiah Carlson" <josiah.carl...@gmail.com> wrote:
Note that when you disable saving, you have no persistence.
On Sun, Sep 30, 2012 at 7:46 AM, Haluk AKIN <haluka...@gmail.com> wrote:
> Dvir,
> This is not AWS. It is a dedicated server.
> I hadn't thought of (config set save ""). I now pushed this configuration
to
> production.
> I'll post an update probably tomorrow on how the results are. Maybe this
> could also reduce connection problems.
> Thanks,
> Haluk
> From: redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] On
Behalf
> Of Dvir Volk
> Sent: Sunday, September 30, 2012 5:09 PM
> To: redis-db@googlegroups.com
> Subject: Re: How to reduce redis io usage
> do the IO spikes occur when redis is dumping to disk?
> have you tried not persisting at all (CONFIG SET SAVE "")?
> BTW is this an AWS instance?
> On Sun, Sep 30, 2012 at 3:47 PM, Haluk AKIN <haluka...@gmail.com> wrote:
> Hello,
> Our redis server can spike up its io usage from time to time. And when
that
> happens we tend to have more connection problems to redis.
> If possible I would like to try to reduce redis's io usage.
> checking the conf file. The following configuration looks like it could
help
> reduce io usage:
> -CONFIG set save "900 1 300 50000 60 100000"
> -"append only file" is already turned off.
> How about other options?
> For instance:
> Would setting linux's overcommit_memory to 1 help reduce redis's io usage?
> Thanks,
> Haluk
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/redis-db/-/ggd815PGsScJ.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com
--
You received this message because you are subscribed to the Google Groups
"Redis DB" group.
To post to this group, send email to redis-db@googlegroups.com.
To unsubscribe from this group, send email to
redis-db+unsubscribe@googlegroups.com
<mailto:redis-db%2Bunsubscribe@googlegroups.com> .
For more options, visit this group at
http://groups.google.com/group/redis-db?hl=en.
-- You received this message because you are subscribed to the Google Groups
"Redis DB" group.
To post to this group, send email to redis-db@googlegroups.com.
To unsubscribe from this group, send email to
redis-db+unsubscribe@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/redis-db?hl=en.
> Note that when you disable saving, you have no persistence.
> Regards,
> - Josiah
> On Sun, Sep 30, 2012 at 7:46 AM, Haluk AKIN <haluka...@gmail.com> wrote:
> > Dvir,
> > This is not AWS. It is a dedicated server.
> > I hadn’t thought of (config set save “”). I now pushed this
> configuration to
> > production.
> > I’ll post an update probably tomorrow on how the results are. Maybe this
> > could also reduce connection problems.
> > Thanks,
> > Haluk
> > From: redis-db@googlegroups.com [mailto:redis-db@googlegroups.com] On
> Behalf
> > Of Dvir Volk
> > Sent: Sunday, September 30, 2012 5:09 PM
> > To: redis-db@googlegroups.com
> > Subject: Re: How to reduce redis io usage
> > do the IO spikes occur when redis is dumping to disk?
> > have you tried not persisting at all (CONFIG SET SAVE "")?
> > BTW is this an AWS instance?
> > On Sun, Sep 30, 2012 at 3:47 PM, Haluk AKIN <haluka...@gmail.com> wrote:
> > Hello,
> > Our redis server can spike up its io usage from time to time. And when
> that
> > happens we tend to have more connection problems to redis.
> > If possible I would like to try to reduce redis's io usage.
> > checking the conf file. The following configuration looks like it could
> help
> > reduce io usage:
> > -CONFIG set save "900 1 300 50000 60 100000"
> > -"append only file" is already turned off.
> > How about other options?
> > For instance:
> > Would setting linux's overcommit_memory to 1 help reduce redis's io
> usage?
> > Thanks,
> > Haluk
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Redis DB" group.
> > To view this discussion on the web visit
> > https://groups.google.com/d/msg/redis-db/-/ggd815PGsScJ.
> > To post to this group, send email to redis-db@googlegroups.com.
> > To unsubscribe from this group, send email to
> > redis-db+unsubscribe@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/redis-db?hl=en.
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Redis DB" group.
> > To post to this group, send email to redis-db@googlegroups.com.
> > To unsubscribe from this group, send email to
> > redis-db+unsubscribe@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/redis-db?hl=en.
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Redis DB" group.
> > To post to this group, send email to redis-db@googlegroups.com.
> > To unsubscribe from this group, send email to
> > redis-db+unsubscribe@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/redis-db?hl=en.
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.****
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.****
> --
> You received this message because you are subscribed to the Google Groups
> "Redis DB" group.
> To post to this group, send email to redis-db@googlegroups.com.
> To unsubscribe from this group, send email to
> redis-db+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/redis-db?hl=en.
On Wed, Oct 3, 2012 at 3:54 PM, Dvir Volk <dvir...@gmail.com> wrote:
> cool. if you want to avoid this AND keep some persistence, you might want to
> keep a slave process that does that but no one will ever talk to.
Ah, but then you have the network I/O to the slave, which might be a
bigger bottleneck than the disk I/O on the master. Your mileage may
vary, as the saying goes. ;-)
