OT squid 3.0 stable 26 problem

[Massimo S.]

Hi Paul,

sorry fot the OT

but newer squid has this problem, when i recreate the cache dir tree
it exit in this way:

2013/11/19 12:38:18| Creating Swap Directories
2013/11/19 12:38:18| Making directories in /squid/var/cache/00
2013/11/19 12:38:19| Making directories in /squid/var/cache/01
2013/11/19 12:38:19| Making directories in /squid/var/cache/02
2013/11/19 12:38:20| Making directories in /squid/var/cache/03
2013/11/19 12:38:20| Making directories in /squid/var/cache/04
2013/11/19 12:38:20| Making directories in /squid/var/cache/05
2013/11/19 12:38:21| Making directories in /squid/var/cache/06
2013/11/19 12:38:21| Making directories in /squid/var/cache/07
2013/11/19 12:38:22| Making directories in /squid/var/cache/08
2013/11/19 12:38:22| Making directories in /squid/var/cache/09
2013/11/19 12:38:22| Making directories in /squid/var/cache/0A
2013/11/19 12:38:23| Making directories in /squid/var/cache/0B
2013/11/19 12:38:23| Making directories in /squid/var/cache/0C
2013/11/19 12:38:23| Making directories in /squid/var/cache/0D
2013/11/19 12:38:24| Making directories in /squid/var/cache/0E
2013/11/19 12:38:24| Making directories in /squid/var/cache/0F

no crashes no errors
but after it refuse any connection
(old squid had more dirs and also .state files)


another time recreating directories i got this error:

2013/11/19 10:58:30| setMaxFD: Cannot increase: setrlimit() not supported on thi
s system



massimo

[Massimo S.]

sorry for the mistake
it don't refuse the connections

but sometimes i've this errorin the logs:

[Lewis G Rosenthal]

Hi...

On 11/19/13 07:56 am, Massimo S. thus wrote :

> Il 19/11/2013 12:51, Massimo S. ha scritto:
>> Hi Paul,
>>
>> sorry fot the OT
>>
>> but newer squid has this problem, when i recreate the cache dir tree
>> it exit in this way:
>>
>> 2013/11/19 12:38:18| Creating Swap Directories
>> 2013/11/19 12:38:18| Making directories in /squid/var/cache/00
>> 2013/11/19 12:38:19| Making directories in /squid/var/cache/01
>> 2013/11/19 12:38:19| Making directories in /squid/var/cache/02
>> 2013/11/19 12:38:20| Making directories in /squid/var/cache/03
>> 2013/11/19 12:38:20| Making directories in /squid/var/cache/04
>> 2013/11/19 12:38:20| Making directories in /squid/var/cache/05
>> 2013/11/19 12:38:21| Making directories in /squid/var/cache/06
>> 2013/11/19 12:38:21| Making directories in /squid/var/cache/07
>> 2013/11/19 12:38:22| Making directories in /squid/var/cache/08
>> 2013/11/19 12:38:22| Making directories in /squid/var/cache/09
>> 2013/11/19 12:38:22| Making directories in /squid/var/cache/0A
>> 2013/11/19 12:38:23| Making directories in /squid/var/cache/0B
>> 2013/11/19 12:38:23| Making directories in /squid/var/cache/0C
>> 2013/11/19 12:38:23| Making directories in /squid/var/cache/0D
>> 2013/11/19 12:38:24| Making directories in /squid/var/cache/0E
>> 2013/11/19 12:38:24| Making directories in /squid/var/cache/0F
>>

This seems normal to me (I run squid on several platforms).

<snip>

> but sometimes i've this errorin the logs:
>
> 2013/11/19 10:58:30| setMaxFD: Cannot increase: setrlimit() not
> supported on this system
>

Also not unexpected.

The squid.conf tag "max_filedescriptors" was ported from 2.7 to 3.1, but
not to 3.0:

http://www.squid-cache.org/Doc/config/max_filedescriptors/

Also, the build info (squid -v) does not indicate that the max fd was
set at compile time. I'm not sure what the value was in Paul's build. See:

http://www.squid-cache.org/Versions/v3/3.0/RELEASENOTES.html

for more info on this, as well as:

http://mantis.smedley.id.au/view.php?id=559


--
Lewis
-------------------------------------------------------------
Lewis G Rosenthal, CNA, CLP, CLE, CWTS, EA
Rosenthal & Rosenthal, LLC www.2rosenthals.com
Need a managed Wi-Fi hotspot? www.hautspot.com
visit my IT blog www.2rosenthals.net/wordpress
-------------------------------------------------------------

[Lewis G Rosenthal]

On 11/19/13 12:06 pm, Lewis G Rosenthal thus wrote :

Massimo, at random times, try running:

[c:\squid\bin] squidclient mgr:info

At the tail end of the output, you';ll get a report of your available
file descriptors. I just restarted my squid recently (not much browsing):

[...]
Memory accounted for:
Total accounted: 2173 KB
memPoolAlloc calls: 27041
memPoolFree calls: 12235
File descriptor usage for squid:
Maximum number of file descriptors: 2048
Largest file desc currently in use: 16
Number of file desc currently in use: 14
Files queued for open: 0
Available number of file descriptors: 2034
Reserved number of file descriptors: 100
Store Disk files open: 0
Internal Data Structures:
4582 StoreEntries
26 StoreEntries with MemObjects
25 Hot Object Cache Items
4556 on-disk objects

Curious if around the time you see the setMaxFD notice in the log
whether the number of file desc currently in use is really approaching
the 2048 hard limit.

[Massimo S.]

i agree with this:

Instead of spending time troubleshooting 3.0, I suggest moving up to latest stable (3.2.6 at
the time of this writing, released yesterday, 8 Jan, 2013)

i guess a rebuilding with the new gcc will also fix something "automatically"

i've also this *very strange* problem

i've about 15 firewall (injoy) + proxy (squid) with content filtering (squid acl)
when there is some heavy storm (with these damned climatic changes here in italy we are
becoming a tropical country like india or philippines, even 19 deaths also yesterday
due to heavy storms!) internet has (of course) problems (goes up and down), standard adsl *die*
completely, but (lucklily) Wadsl (hiperlan2 or the "new" hiperlan ofdm have only just some "up
and down" (i mean some small disconnections) after this disconnections squid crash and
sometimes i have to clear the cache and rebuild them (-z) since they get corrupted

dunno if this cache corruption and crash is a problem only with squid on eCS
or also of other builds/OSes too

massimo

[Massimo S.]

Lewis i've lans with also 30 desktops as clients
i guess i could reach some limits easly

massimo

[Steven Levine]

In <528B5FFE...@ecomstation.it>, on 11/19/13
at 01:56 PM, "Massimo S." <m...@ecomstation.it> said:

Hi guys,

>but sometimes i've this errorin the logs:

> 2013/11/19 10:58:30| setMaxFD: Cannot increase: setrlimit() not
>supported on this system

Looks like a porting nit to me. We can easily emulate setrlimit() with
DosSetRelMaxFH().

Steven

--
----------------------------------------------------------------------
"Steven Levine" <ste...@earthlink.net> eCS/Warp/DIY etc.
www.scoug.com www.ecomstation.com
----------------------------------------------------------------------