quick squid.conf tweaks for LiquidGalaxy

40 views
Skip to first unread message

Andrew Leahy

unread,
Oct 21, 2010, 6:35:15 AM10/21/10
to liquid-galaxy
For those using a Squid cache with your LG rig, some suggested changes
to the LG/SVN squid.conf.

Remove '?' from hierarchy_stoplist so it's "hierarchy_stoplist cgi-bin"
Important if you want your squids talking to each other when there's a
'?" in the URL!
eg. http://kh.google.com/flatfile?f1-012201330133-i.33.4+f1c-0122013302102-t.207+f1....

Save some file I/O - "cache_store_log none"

I don't think anyone cares about per client stats - "client_db off"

And if you're not analyzing the access_log (say, after things are
confirmed working) turn it off with "cache_access_log none"

The cache_log doesn't get a lot of activity and is worthwhile leaving
around for capturing catastrophic errors.

Also I've noticed HTTP requests for kh2.google.com and mw1.google.com
mw2.google.com (eg. cloud layers) so I just proxy all HTTP from the
clients. GE seems to work fine with
HTTP proxies set. I haven't done any benchmarking to determine if
there's any penalty vs faking a local kh.google.com.

PS I like to test "proxy setups" in a firewalled environment. It's a
good way to know if things are really being proxied and hence
potentially cached.

Cheers, Andrew

IT Research Support / ITS / University of Western Sydney

Andrew Leahy

unread,
Oct 21, 2010, 6:53:18 AM10/21/10
to liquid-galaxy
ooops these are all lines to ADD to the minimal SVN squid.conf
Or if you are working with a full squid.conf find the line and comment/
replace.

Andrew

On Oct 21, 9:35 pm, Andrew Leahy <alf...@gmail.com> wrote:
> For those using a Squid cache with your LG rig, some suggested changes
> to the LG/SVN squid.conf.
>
> Remove '?' from hierarchy_stoplist so it's "hierarchy_stoplist cgi-bin"
> Important if you want your squids talking to each other when there's a
> '?" in the URL!
> eg.http://kh.google.com/flatfile?f1-012201330133-i.33.4+f1c-012201330210.......

Andrew Leahy

unread,
Oct 22, 2010, 1:13:23 AM10/22/10
to liquid-galaxy
More Squid things...

Sending 'via' HTTP headers just adds to the outgoing request-size, so
turn them off with

via off

Now this one may cause the google guys to whince. But, if you've gone
to the trouble of setting up cache you probably want the content to
hang around for longer than the default 24hours that kh.google.com
places in it's Expires headers. Sure, it probably just sends an IMS
"has this content changed" request, but if you don't mind delivering
potentially stale texture/model data then....

refresh_pattern ^http://kh\.google\.com/ 14400 99%
43200 override-expire reload-into-ims

Add that before the line:

refresh_pattern . 0 20% 4320

All the numbers are in minutes, so that's 24days "minimum", rather than 24hrs.

If you monitor your access log you should see a change in the number
of TCP_REFRESH_ compared to TCP_HIT

Of course if your cache is full the content will get aged out. Your
mileage may vary.

Cheers, Andrew

--
"There is no one so great as the one who does not try to accomplish
anything." (Masanobu Fukuoka)

My household GHG emissions from energy & transport ~4kg CO2e/day or
~1.4tonnes/year
Household daily use of Water 120L, Electricity 4.0kWh, Petrol 1.2L, Gas 0MJ

Jason Holt

unread,
Oct 22, 2010, 3:24:33 AM10/22/10
to liquid...@googlegroups.com

This is great news, especially the proxy environment variable part.

sent from my android

Reply all
Reply to author
Forward
0 new messages