                                                                                                                                                                                                                                                                
Received-SPF: pass (google.com: domain of erlang-questions-boun...@erlang.org designates 192.121.151.104 as permitted sender) client-ip=192.121.151.104;
MIME-Version: 1.0
In-Reply-To: <50753381.1050...@ninenines.eu>
References: <CANZWjw6NNpPjUERzdKe1oSW2ui+Rdjds8FxVtJKmUvXFRdH...@mail.gmail.com>
 <50753381.1050...@ninenines.eu>
Date: Wed, 10 Oct 2012 06:32:42 -0400
Message-ID: <CANZWjw6VBx6bH_DG+Z3FrvX51O+shcaeWF5ALKJiWpUHfwR...@mail.gmail.com>
From: AD <straightfl...@gmail.com>
To: =?ISO-8859-1?Q?Lo=EFc_Hoguin?= <es...@ninenines.eu>
Cc: erlang-questi...@erlang.org
Subject: Re: [erlang-questions] Cowboy , Concurrency , Tuning
Precedence: list
Content-Type: multipart/mixed; boundary="===============4164778154857667200=="
Errors-To: erlang-questions-boun...@erlang.org
Sender: erlang-questions-boun...@erlang.org

--===============4164778154857667200==
Content-Type: multipart/alternative; boundary=e89a8ff1c5548a705b04cbb1f9e7

--e89a8ff1c5548a705b04cbb1f9e7
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Thanks Loic.  Any reason why websocket connections are not counted ?  is
there a separate pool for max_connections for websockets?

On Wed, Oct 10, 2012 at 4:36 AM, Lo=C3=AFc Hoguin <es...@ninenines.eu> wrot=
e:

> On 10/10/2012 04:02 AM, AD wrote:
>
>> hello,
>>
>
> Hey,
>
>
>    I currently have a SockJS websocket implementation sitting on top of
>> cowboy.  We have been going through some tuning/concurrency testing and
>> we have improved our results drastically by increasing
>>
>> ERL_MAX_PORTS to 64000
>> +P parameter to a very high number , around 128000
>> Kernel tuning
>>
>>   With this config on a medium VM we have been able to successfully get
>> to around 60,000 connections, up from 4096 so we are headed in the right
>> direction :-)
>>
>
> Well then with the above configuration you're at about the maximum
> concurrent connections you can get. If you increase ERL_MAX_PORTS and +P
> even more Cowboy shouldn't have any trouble giving you even better result=
s.
>
>
>    MY next question is with Cowboy tuning.  I notice that the default
>> max_connections parameter on the TCP transport is 1024 if not set, but I
>> am not hitting this issue.  What is the right way to tune NBAcceptor
>> pool and the the max_connections setting for the acceptor ?
>>
>
> NBAcceptor shouldn't be too low but shouldn't be too high either. I found
> 100 to be a good values but it really depends on how many connections com=
e
> at once, how many cores you have, how many concurrent connections you
> expect, and so on.
>
>    Right now my start_listener is simply
>>
>> cowboy:start_listener(my_http_**listener, 200,
>>       cowboy_tcp_transport, [{port, ?COWBOY_HTTP_PORT}],
>>       cowboy_http_protocol, [{dispatch, Routes}]
>>      ).
>>
>> but i have seen some examples with
>>
>> cowboy:start_listener(my_http_**listener, 200,
>>       cowboy_tcp_transport, [{port, ?COWBOY_HTTP_PORT},
>> */{max_connections, infinity}/* ],
>>       cowboy_http_protocol, [{dispatch, Routes}]
>>      ).
>>
>
> If you're using Cowboy 0.6.1 or below and looking for performance, you
> should set max_connections to infinity. If you're using master, you can l=
et
> it at the default value.
>
> Websocket connections are not counted in that number. All HTTP connection=
s
> are though, so you might want to look at cowboy_listener to see how to
> remove the connection from the count (varies depending on your version).
>
> --
> Lo=C4=8Fc Hoguin
> Erlang Cowboy
> Nine Nines
> http://ninenines.eu
>

--e89a8ff1c5548a705b04cbb1f9e7
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Thanks Loic. =C2=A0Any reason why websocket connections are not counted ? =
=C2=A0is there a separate pool for max_connections for websockets?<br><br><=
div class=3D"gmail_quote">On Wed, Oct 10, 2012 at 4:36 AM, Lo=C3=AFc Hoguin=
 <span dir=3D"ltr">&lt;<a href=3D"mailto:es...@ninenines.eu" target=3D"_bla=
nk">es...@ninenines.eu</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">On 10/10/2012 04:02 AM, AD wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
hello,<br>
</blockquote>
<br>
Hey,<div class=3D"im"><br>
<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
=C2=A0 I currently have a SockJS websocket implementation sitting on top of=
<br>
cowboy. =C2=A0We have been going through some tuning/concurrency testing an=
d<br>
we have improved our results drastically by increasing<br>
<br>
ERL_MAX_PORTS to 64000<br>
+P parameter to a very high number , around 128000<br>
Kernel tuning<br>
<br>
=C2=A0 With this config on a medium VM we have been able to successfully ge=
t<br>
to around 60,000 connections, up from 4096 so we are headed in the right<br=
>
direction :-)<br>
</blockquote>
<br></div>
Well then with the above configuration you&#39;re at about the maximum conc=
urrent connections you can get. If you increase ERL_MAX_PORTS and +P even m=
ore Cowboy shouldn&#39;t have any trouble giving you even better results.<d=
iv class=3D"im">
<br>
<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
=C2=A0 MY next question is with Cowboy tuning. =C2=A0I notice that the defa=
ult<br>
max_connections parameter on the TCP transport is 1024 if not set, but I<br=
>
am not hitting this issue. =C2=A0What is the right way to tune NBAcceptor<b=
r>
pool and the the max_connections setting for the acceptor ?<br>
</blockquote>
<br></div>
NBAcceptor shouldn&#39;t be too low but shouldn&#39;t be too high either. I=
 found 100 to be a good values but it really depends on how many connection=
s come at once, how many cores you have, how many concurrent connections yo=
u expect, and so on.<br>

<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div class=3D"im">
=C2=A0 Right now my start_listener is simply<br>
<br>
cowboy:start_listener(my_http_<u></u>listener, 200,<br>
=C2=A0 =C2=A0 =C2=A0 cowboy_tcp_transport, [{port, ?COWBOY_HTTP_PORT}],<br>
=C2=A0 =C2=A0 =C2=A0 cowboy_http_protocol, [{dispatch, Routes}]<br>
=C2=A0 =C2=A0 =C2=A0).<br>
<br>
but i have seen some examples with<br>
<br>
cowboy:start_listener(my_http_<u></u>listener, 200,<br>
=C2=A0 =C2=A0 =C2=A0 cowboy_tcp_transport, [{port, ?COWBOY_HTTP_PORT},<br><=
/div>
*/{max_connections, infinity}/* ],<br>
=C2=A0 =C2=A0 =C2=A0 cowboy_http_protocol, [{dispatch, Routes}]<br>
=C2=A0 =C2=A0 =C2=A0).<br>
</blockquote>
<br>
If you&#39;re using Cowboy 0.6.1 or below and looking for performance, you =
should set max_connections to infinity. If you&#39;re using master, you can=
 let it at the default value.<br>
<br>
Websocket connections are not counted in that number. All HTTP connections =
are though, so you might want to look at cowboy_listener to see how to remo=
ve the connection from the count (varies depending on your version).<span c=
lass=3D"HOEnZb"><font color=3D"#888888"><br>

<br>
-- <br>
Lo=C4=8Fc Hoguin<br>
Erlang Cowboy<br>
Nine Nines<br>
<a href=3D"http://ninenines.eu" target=3D"_blank">http://ninenines.eu</a><b=
r>
</font></span></blockquote></div><br>

--e89a8ff1c5548a705b04cbb1f9e7--

--===============4164778154857667200==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
erlang-questions mailing list
erlang-questi...@erlang.org
http://erlang.org/mailman/listinfo/erlang-questions

--===============4164778154857667200==--