Pagspeed as a Plugin for ATS Proxy

40 views
Skip to first unread message

kapil kumar

unread,
May 3, 2016, 7:06:07 AM5/3/16
to mod-pagespeed-discuss
Hello all,

I have just started working on the Pagespeed and my intention is to use pagespeed as a plugin in the ATS.
I can see ATS/plugins/experimental/ats_pagespeed. I followed the instructions :
->Build and install using make and make install.
->Added the plugin entry in plugin.conf
->Mentioned the cache/log files (with 777 permissions too)
->i can see plugin is being loaded when i start ATS.

But it doesnt seems to be working :(
for e.g, combine_css.html is still having 3 different CSS.

When i send Curl request,
curl -i http://local_server_ip/combine_css.html --proxy "ats_proxy_ip"

i see "x-page-speed 1.9.32.3-4488" only for the first time.
After second attempt, i dont see this header in response.


Any suggestion on how to debug this will be helpful.
Thanks and regards.
Kapil Kumar




Otto van der Schaaf

unread,
May 3, 2016, 7:53:06 AM5/3/16
to mod-pagespeed-discuss
The disappearing x-page-speed header is odd. Perhaps that is something specific to a forward proxy setup.

Could you perform these steps?:

- if trafficserver is running as a service, stop it  (sudo trafficserver stop)
- run traffic_server directly from the terminal like this:
   sudo traffic_server -T .*pagespeed.*
- Run the two requests you mentioned once more
- Post the output you see here or email it to me?

Otto


--
You received this message because you are subscribed to the Google Groups "mod-pagespeed-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-di...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mod-pagespeed-discuss/df777ee6-9595-4f34-8a5b-2f74a366ca04%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

kapil kumar

unread,
May 3, 2016, 8:36:36 AM5/3/16
to mod-pagespeed-discuss
Thanks a lot for quick reply.

Here is logs from the terminal:
kapil.kumar@kapilkumar-ubuntu:~$ sudo /opt/ts/bin/traffic_server
traffic_server: using root directory '/opt/ts'
[May  3 18:02:22.224] Server {0x7f17921bf780} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] No threading detected. Own threads: 1 Rewrite, 1 Expensive Rewrite.
[May  3 18:02:22.224] Server {0x7f17921bf780} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] global default options:
[Version: 13: on

Filters
ah Add Head
cc Combine Css
jc Combine Javascript
gp Convert Gif to Png
jp Convert Jpeg to Progressive
jw Convert Jpeg To Webp
mc Convert Meta Tags
pj Convert Png to Jpeg
ec Cache Extend Css
ei Cache Extend Images
es Cache Extend Scripts
fc Fallback Rewrite Css 
if Flatten CSS Imports
hw Flushes html
ci Inline Css
ii Inline Images
il Inline @import to Link
ji Inline Javascript
js Jpeg Subsampling
rj Recompress Jpeg
rp Recompress Png
rw Recompress Webp
ri Resize Images
cf Rewrite Css
jm Rewrite External Javascript
jj Rewrite Inline Javascript
cu Rewrite Style Attributes With Url
cp Strip Image Color Profiles
md Strip Image Meta Data

Options
  AvoidRenamingIntrospectiveJavascript (aris)  True
  BeaconUrl (bu)                               /home/kapil.kumar/Desktop/CAB/tmp/ats_pagespeed_beacon
  EnableRewriting (e)                          1
  FileCacheCleanIntervalMs (afcci)             500000
  FileCachePath (afcp)                         /home/kapil.kumar/Desktop/CAB/tmp/ats_ps/
  FlushHtml (fh)                               True
  LogDir (ald)                                 /home/kapil.kumar/Desktop/CAB/tmp/ps_log/
  LRUCacheByteLimit (alcb)                     10240000
  LRUCacheKbPerProcess (alcp)                  163840
  RateLimitBackgroundFetches (rlbf)            True
  RewriteLevel (l)                             Core Filters
  StatisticsLogging (asle)                     True
  StatisticsLoggingIntervalMs (asli)           512000

Domain Lawyer

Invalidation Timestamp: (none)]
[May  3 18:02:22.224] Server {0x7f17921bf780} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] server ctx default options:
[Version: 13: on

Filters
ah Add Head
cc Combine Css
jc Combine Javascript
gp Convert Gif to Png
jp Convert Jpeg to Progressive
jw Convert Jpeg To Webp
mc Convert Meta Tags
pj Convert Png to Jpeg
ec Cache Extend Css
ei Cache Extend Images
es Cache Extend Scripts
fc Fallback Rewrite Css 
if Flatten CSS Imports
hw Flushes html
ci Inline Css
ii Inline Images
il Inline @import to Link
ji Inline Javascript
js Jpeg Subsampling
rj Recompress Jpeg
rp Recompress Png
rw Recompress Webp
ri Resize Images
cf Rewrite Css
jm Rewrite External Javascript
jj Rewrite Inline Javascript
cu Rewrite Style Attributes With Url
cp Strip Image Color Profiles
md Strip Image Meta Data

Options
  AvoidRenamingIntrospectiveJavascript (aris)  True
  BeaconUrl (bu)                               /home/kapil.kumar/Desktop/CAB/tmp/ats_pagespeed_beacon
  EnableRewriting (e)                          1
  FileCacheCleanIntervalMs (afcci)             500000
  FileCachePath (afcp)                         /home/kapil.kumar/Desktop/CAB/tmp/ats_ps/
  FlushHtml (fh)                               True
  LogDir (ald)                                 /home/kapil.kumar/Desktop/CAB/tmp/ps_log/
  LRUCacheByteLimit (alcb)                     10240000
  LRUCacheKbPerProcess (alcp)                  163840
  RateLimitBackgroundFetches (rlbf)            True
  RewriteLevel (l)                             Core Filters
  StatisticsLogging (asle)                     True
  StatisticsLoggingIntervalMs (asli)           512000

Domain Lawyer

Invalidation Timestamp: (none)]
[May  3 18:02:22.234] Server {0x7f17921bf780} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] SharedMemCache: pagespeed_default_shm/metadata_cache, sectors = 128, entries/sector = 2226,  64-byte blocks/sector = 4452, total footprint: 52445184
[May  3 18:02:22.234] Server {0x7f17921bf780} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Initializing shared memory for path: /home/kapil.kumar/Desktop/CAB/tmp/ats_ps/.
[May  3 18:02:22.235] Server {0x7f17921bf780} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Reusing shared memory for path: /home/kapil.kumar/Desktop/CAB/tmp/ats_ps/.
[May  3 18:02:22.236] Server {0x7f17921bf780} DIAG: (ats_pagespeed) Created new QueuedWorkerPool of type 0 named 'html' of size 8
[May  3 18:02:22.236] Server {0x7f17921bf780} DIAG: (ats_pagespeed) Created new QueuedWorkerPool of type 1 named 'rewrite' of size 8
[May  3 18:02:22.236] Server {0x7f17921bf780} DIAG: (ats_pagespeed) Created new QueuedWorkerPool of type 2 named 'slow_rewrite' of size 8
[May  3 18:02:22.236] Server {0x7f17921bf780} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Process context constructed
parse [/home/kapil.kumar/Desktop/CAB/tmp/psol/pagespeed.conf]
Update configuration
[May  3 18:02:22.237] Server {0x7f17921bf780} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] TSPluginInit OK






Here is the output of Curl request:
kapil.kumar@kapilkumar-ubuntu:~/Desktop/CAB/mod_pagespeed/src$ curl -I http://107.109.155.97/combine_css.html --proxy 107.109.153.156:8080
HTTP/1.1 200 OK
Date: Tue, 03 May 2016 12:30:31 GMT
Server: ATS/6.1.1
Last-Modified: Tue, 03 May 2016 09:56:48 GMT
ETag: "e095d-1b3-531ed20ad7bde"
Accept-Ranges: bytes
Content-Length: 435
Content-Type: text/html; charset=UTF-8
Cache-Control: public, max-age=3600
Age: 122
Proxy-Connection: keep-alive

FYI : in the plugin interface, i have changed the directory for cache / logs and plugin.conf.

Please let me know if i misunderstood anything (as just started understanding PS)
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-discuss+unsub...@googlegroups.com.

kapil kumar

unread,
May 3, 2016, 8:57:27 AM5/3/16
to mod-pagespeed-discuss
+ These are the logs when header was attached for the first time:

 First request logs
[May  3 18:24:36.979] Server {0x7f178d6d8700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  3 18:24:36.980] Server {0x7f178d6d8700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Trying to serve rewritten resource in-place: http://107.109.155.97/rewrite_images.html
[May  3 18:24:36.991] Server {0x7f178d6d8700} DIAG: (ats_pagespeed_transform) Will optimize [http://107.109.155.97/rewrite_images.html]
[May  3 18:24:36.991] Server {0x7f178d6d8700} DIAG: (ats-speed) transform added
[May  3 18:24:36.993] Server {0x7f177b964700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Cache entry is expired: http://107.109.155.97/rewrite_images.html (fragment=foo.com)
[May  3 18:24:36.993] Server {0x7f177b964700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0503/182436:VERBOSE1:cache_url_async_fetcher.cc(345)] Did not find in cache: http://107.109.155.97/rewrite_images.html (foo.com)
[May  3 18:24:36.993] Server {0x7f177b964700} DIAG: (ats-speed) HeadersComplete()!
[May  3 18:24:36.993] Server {0x7f177b964700} DIAG: (ats-speed) ipro forwarddata: HTTP/1.0 501 (null)
Connection: Close


[May  3 18:24:36.993] Server {0x7f177b964700} DIAG: (ats-speed) ipro lookup base fetch done()
[May  3 18:24:36.993] Server {0x7f177b964700} DIAG: (ats-speed) ipro lookup base fetch -> not found in cache
[May  3 18:24:37.004] Server {0x7f178d4d6700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  3 18:24:37.004] Server {0x7f178d4d6700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] request options found 

[May  3 18:24:37.005] Server {0x7f178d4d6700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] request options:
  FlushHtml (fh)                               True
  LogDir (ald)                                 /home/kapil.kumar/Desktop/CAB/tmp/ps_log/
  LRUCacheByteLimit (alcb)                     10240000
  LRUCacheKbPerProcess (alcp)                  163840
  RateLimitBackgroundFetches (rlbf)            True
  RewriteLevel (l)                             Core Filters
  StatisticsLogging (asle)                     True
  StatisticsLoggingIntervalMs (asli)           512000

Domain Lawyer

Invalidation Timestamp: (none)]
[May  3 18:24:37.006] Server {0x7f178d4d6700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0503/182437:VERBOSE1:proxy_fetch.cc(550)] Attaching RewriteDriver 0x7f174c00cea0 to HtmlRewriter 0x7f174c0133a0
[May  3 18:24:37.007] Server {0x7f178d4d6700} DIAG: (ats-speed) proxy fetch finished
[May  3 18:24:37.007] Server {0x7f178d4d6700} DIAG: (ats-speed) HeadersComplete()!
[May  3 18:24:37.007] Server {0x7f178d4d6700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0503/182437:VERBOSE1:proxy_fetch.cc(990)] Fetch result:1 http://107.109.155.97/rewrite_images.html : 200
[May  3 18:24:37.007] Server {0x7f178d4d6700} DIAG: (ats-speed) Done()!
[May  3 18:24:37.017] Server {0x7f178dee0700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  3 18:24:37.038] Server {0x7f178dcde700} DIAG: (ats-speed) ats_pagespeed_transform()


second request logs when no header was observed
[May  3 18:24:51.722] Server {0x7f178dbdd700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  3 18:24:51.723] Server {0x7f178dbdd700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Trying to serve rewritten resource in-place: http://107.109.155.97/rewrite_images.html
[May  3 18:24:51.723] Server {0x7f178dbdd700} DIAG: (ats_pagespeed_transform) Will optimize [http://107.109.155.97/rewrite_images.html]
[May  3 18:24:51.723] Server {0x7f178dbdd700} DIAG: (ats-speed) transform added
[May  3 18:24:51.723] Server {0x7f178dadc700} DIAG: (ats-speed) ats_pagespeed_transform()

 here are respective curl's output:
kapil.kumar@kapilkumar-ubuntu:~/Desktop/CAB/mod_pagespeed/src$ curl -I http://107.109.155.97/rewrite_images.html --proxy 107.109.153.156:8080
HTTP/1.1 200 OK
Date: Tue, 03 May 2016 12:54:36 GMT
Server: Apache/2.2.15 (CentOS)
Last-Modified: Tue, 03 May 2016 09:56:48 GMT
ETag: "e099f-30b-531ed20ad7fc6"
Accept-Ranges: bytes
Content-Type: text/html; charset=UTF-8
Cache-Control: max-age=3600
Content-Length: 0
Age: 1
Proxy-Connection: keep-alive
X-Page-Speed: 1.9.32.3-4448

kapil.kumar@kapilkumar-ubuntu:~/Desktop/CAB/mod_pagespeed/src$ curl -I http://107.109.155.97/rewrite_images.html --proxy 107.109.153.156:8080
HTTP/1.1 200 OK
Date: Tue, 03 May 2016 12:54:36 GMT
Server: ATS/6.1.1
Last-Modified: Tue, 03 May 2016 09:56:48 GMT
ETag: "e099f-30b-531ed20ad7fc6"
Accept-Ranges: bytes
Content-Length: 779
Content-Type: text/html; charset=UTF-8
Cache-Control: public, max-age=3600
Age: 15
Proxy-Connection: keep-alive

kapil.kumar@kapilkumar-ubuntu:~/Desktop/CAB/mod_pagespeed/src$ 

Otto van der Schaaf

unread,
May 3, 2016, 9:04:47 AM5/3/16
to mod-pagespeed-discuss
I suspect you are hitting a bug in the plugin when using ATS in forward-proxy-mode, when ats uses conditional revalidation with the origin (web)server for the html.

To confirm, would it be possible to:
- Serve the html without Last-modified and ETag headers from the webserver
- Clear trafficserver's cache
- Try again?

If that solves the problem, I have an idea where I may have to take a look to address this in the plugin's code.
Could you file an issue for this at https://issues.apache.org/jira/browse/TS ?

Otto

To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-di...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "mod-pagespeed-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-di...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mod-pagespeed-discuss/64bfb882-37e3-47d6-aae5-542eed8bcc84%40googlegroups.com.

kapil kumar

unread,
May 3, 2016, 9:37:24 AM5/3/16
to mod-pagespeed-discuss
Sure , i will try the same.
But i observed one strange behaviour just now:

For e.g this is original request without proxy:
kapil.kumar@kapilkumar-ubuntu:~/Desktop/CAB/mod_pagespeed/src$ curl -I http://107.109.155.97/outline_css.html
HTTP/1.1 200 OK
Date: Tue, 03 May 2016 13:33:01 GMT
Server: Apache/2.2.15 (CentOS)
Accept-Ranges: bytes
X-Mod-Pagespeed: 1.9.32.14-0
Vary: Accept-Encoding
Cache-Control: max-age=0, no-cache
Content-Length: 4442
Connection: close
Content-Type: text/html; charset=UTF-8


And then with proxy, first and second time  (which seems working)
kapil.kumar@kapilkumar-ubuntu:~/Desktop/CAB/mod_pagespeed/src$ curl -I http://107.109.155.97/outline_css.html --proxy 107.109.153.156:8080
HTTP/1.1 200 OK
Date: Tue, 03 May 2016 13:32:47 GMT
Server: ATS/6.1.1
Last-Modified: Tue, 03 May 2016 09:56:48 GMT
ETag: "e0995-15c4-531ed20ad7fc6"
Accept-Ranges: bytes
Content-Type: text/html; charset=UTF-8
Cache-Control: public, max-age=3600
Age: 0
Proxy-Connection: keep-alive

kapil.kumar@kapilkumar-ubuntu:~/Desktop/CAB/mod_pagespeed/src$ 
kapil.kumar@kapilkumar-ubuntu:~/Desktop/CAB/mod_pagespeed/src$ curl -I http://107.109.155.97/outline_css.html --proxy 107.109.153.156:8080
HTTP/1.1 200 OK
Date: Tue, 03 May 2016 13:32:49 GMT
Server: Apache/2.2.15 (CentOS)
Last-Modified: Tue, 03 May 2016 09:56:48 GMT
ETag: "e0995-15c4-531ed20ad7fc6"
Accept-Ranges: bytes
Content-Type: text/html; charset=UTF-8
Cache-Control: max-age=3600
Content-Length: 0
Age: 0
Proxy-Connection: keep-alive
X-Page-Speed: 1.9.32.3-4448

 But once i load the same page in the mozilla browser and then send Curl request, PS header disappear :(
kapil.kumar@kapilkumar-ubuntu:~/Desktop/CAB/mod_pagespeed/src$ curl -I http://107.109.155.97/outline_css.html --proxy 107.109.153.156:8080
HTTP/1.1 200 OK
Date: Tue, 03 May 2016 13:34:52 GMT
Server: ATS/6.1.1
Last-Modified: Tue, 03 May 2016 09:56:48 GMT
ETag: "e0995-15c4-531ed20ad7fc6"
Accept-Ranges: bytes
Content-Length: 5572
Content-Type: text/html; charset=UTF-8
Cache-Control: public, max-age=3600
Age: 2 (i see this is changing now)
Proxy-Connection: keep-alive

And i am clueless about whats happening here. 
Thanks again.

To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-discuss+unsub...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "mod-pagespeed-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-discuss+unsub...@googlegroups.com.

Otto van der Schaaf

unread,
May 3, 2016, 4:30:06 PM5/3/16
to mod-pagespeed-discuss
Could you clear the cache of the Mozilla browser and try again?

Otto

To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-di...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "mod-pagespeed-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-di...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "mod-pagespeed-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-di...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mod-pagespeed-discuss/a635c7f4-1bdd-4495-8585-0af8d32d8def%40googlegroups.com.

kapil kumar

unread,
May 4, 2016, 1:08:12 AM5/4/16
to mod-pagespeed-discuss
Dear Otto,
Thanks for your suggestions.

->I tried clearing the Mozilla Cache , but this issue still exist.
Once i load the page in Mozilla , page speed header is not seen in CURL response .

I will try the other suggestion and let you know the outcome.
Thanks again
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-discuss+unsub...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "mod-pagespeed-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-discuss+unsub...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "mod-pagespeed-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-discuss+unsub...@googlegroups.com.

kapil kumar

unread,
May 4, 2016, 1:48:34 AM5/4/16
to mod-pagespeed-discuss
Hello again,
I tried the steps as you mentioned:
 
->adding these in httpd.conf in my origin web server.
Header unset ETag
FileETag None
Header unset Last-Modified
->delete ats_ps directory
->try again the steps.

But still no luck. I tried combine_js test case and still i can see two JS instead of one.
I created the issue also as you suggest.  https://issues.apache.org/jira/browse/TS-4415

Do you have any other suggestions for debugging this problem ?


These are the logs when i load the page in mozilla multiple times (after clearing cache for the second time too)

[May  4 11:15:16.579] Server {0x7f7c396d5780} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  4 11:15:16.580] Server {0x7f7c396d5780} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Trying to serve rewritten resource in-place: http://107.108.50.106/ps/insert_ga.html
[May  4 11:15:16.580] Server {0x7f7c26ef3700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111516:VERBOSE1:cache_url_async_fetcher.cc(345)] Did not find in cache: http://107.108.50.106/ps/insert_ga.html (foo.com)
[May  4 11:15:16.580] Server {0x7f7c26ef3700} DIAG: (ats-speed) HeadersComplete()!
[May  4 11:15:16.580] Server {0x7f7c26ef3700} DIAG: (ats-speed) ipro forwarddata: HTTP/1.0 501 (null)
Connection: Close


[May  4 11:15:16.580] Server {0x7f7c26ef3700} DIAG: (ats-speed) ipro lookup base fetch done()
[May  4 11:15:16.580] Server {0x7f7c26ef3700} DIAG: (ats-speed) ipro lookup base fetch -> not found in cache
[May  4 11:15:16.583] Server {0x7f7c349ec700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Could not rewrite resource in-place because URL is not in cache: http://107.108.50.106/ps/insert_ga.html
[May  4 11:15:16.583] Server {0x7f7c349ec700} DIAG: (ats_pagespeed_transform) Will record in place: [http://107.108.50.106/ps/insert_ga.html]
[May  4 11:15:16.583] Server {0x7f7c349ec700} DIAG: (ats-speed) transform added
[May  4 11:15:16.584] Server {0x7f7c396d5780} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:16.584] Server {0x7f7c396d5780} DIAG: (ats-speed) transform_one()
[May  4 11:15:16.584] Server {0x7f7c396d5780} DIAG: (ats-speed) transform!
[May  4 11:15:16.584] Server {0x7f7c396d5780} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111516:VERBOSE1:in_place_resource_recorder.cc(120)] IPRO: MaxResponseBytes exceeded while recording http://107.108.50.106/ps/insert_ga.html
[May  4 11:15:16.584] Server {0x7f7c396d5780} DIAG: (ats-speed) ipro recording finished
[May  4 11:15:16.585] Server {0x7f7c353f6700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:16.595] Server {0x7f7c352f5700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:16.625] Server {0x7f7c34cef700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:44.024] Server {0x7f7c396d5780} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  4 11:15:44.025] Server {0x7f7c396d5780} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Trying to serve rewritten resource in-place: http://107.108.50.106/ps/combine_javascript.html
[May  4 11:15:44.025] Server {0x7f7c26ef3700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111544:VERBOSE1:cache_url_async_fetcher.cc(345)] Did not find in cache: http://107.108.50.106/ps/combine_javascript.html (foo.com)
[May  4 11:15:44.025] Server {0x7f7c26ef3700} DIAG: (ats-speed) HeadersComplete()!
[May  4 11:15:44.025] Server {0x7f7c26ef3700} DIAG: (ats-speed) ipro forwarddata: HTTP/1.0 501 (null)
Connection: Close


[May  4 11:15:44.025] Server {0x7f7c26ef3700} DIAG: (ats-speed) ipro lookup base fetch done()
[May  4 11:15:44.025] Server {0x7f7c26ef3700} DIAG: (ats-speed) ipro lookup base fetch -> not found in cache
[May  4 11:15:44.033] Server {0x7f7c351f4700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Could not rewrite resource in-place because URL is not in cache: http://107.108.50.106/ps/combine_javascript.html
[May  4 11:15:44.033] Server {0x7f7c351f4700} DIAG: (ats_pagespeed_transform) Will record in place: [http://107.108.50.106/ps/combine_javascript.html]
[May  4 11:15:44.033] Server {0x7f7c351f4700} DIAG: (ats-speed) transform added
[May  4 11:15:44.033] Server {0x7f7c350f3700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:44.033] Server {0x7f7c350f3700} DIAG: (ats-speed) transform_one()
[May  4 11:15:44.033] Server {0x7f7c350f3700} DIAG: (ats-speed) transform!
[May  4 11:15:44.034] Server {0x7f7c350f3700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111544:VERBOSE1:in_place_resource_recorder.cc(120)] IPRO: MaxResponseBytes exceeded while recording http://107.108.50.106/ps/combine_javascript.html
[May  4 11:15:44.034] Server {0x7f7c350f3700} DIAG: (ats-speed) ipro recording finished
[May  4 11:15:44.034] Server {0x7f7c34ef1700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:44.044] Server {0x7f7c34ff2700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:44.045] Server {0x7f7c396d5780} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:44.067] Server {0x7f7c396d5780} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  4 11:15:44.067] Server {0x7f7c396d5780} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Trying to serve rewritten resource in-place: http://107.108.50.106/ps/combine_javascript1.js
[May  4 11:15:44.067] Server {0x7f7c353f6700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  4 11:15:44.067] Server {0x7f7c353f6700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Trying to serve rewritten resource in-place: http://107.108.50.106/ps/combine_javascript2.js
[May  4 11:15:44.067] Server {0x7f7c26ef3700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111544:VERBOSE1:cache_url_async_fetcher.cc(345)] Did not find in cache: http://107.108.50.106/ps/combine_javascript1.js (foo.com)
[May  4 11:15:44.067] Server {0x7f7c26ef3700} DIAG: (ats-speed) HeadersComplete()!
[May  4 11:15:44.067] Server {0x7f7c26ef3700} DIAG: (ats-speed) ipro forwarddata: HTTP/1.0 501 (null)
Connection: Close


[May  4 11:15:44.067] Server {0x7f7c26ef3700} DIAG: (ats-speed) ipro lookup base fetch done()
[May  4 11:15:44.067] Server {0x7f7c26ef3700} DIAG: (ats-speed) ipro lookup base fetch -> not found in cache
[May  4 11:15:44.068] Server {0x7f7c2656c700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111544:VERBOSE1:cache_url_async_fetcher.cc(345)] Did not find in cache: http://107.108.50.106/ps/combine_javascript2.js (foo.com)
[May  4 11:15:44.068] Server {0x7f7c2656c700} DIAG: (ats-speed) HeadersComplete()!
[May  4 11:15:44.068] Server {0x7f7c2656c700} DIAG: (ats-speed) ipro forwarddata: HTTP/1.0 501 (null)
Connection: Close


[May  4 11:15:44.068] Server {0x7f7c2656c700} DIAG: (ats-speed) ipro lookup base fetch done()
[May  4 11:15:44.068] Server {0x7f7c2656c700} DIAG: (ats-speed) ipro lookup base fetch -> not found in cache
[May  4 11:15:44.119] Server {0x7f7c351f4700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Could not rewrite resource in-place because URL is not in cache: http://107.108.50.106/ps/combine_javascript2.js
[May  4 11:15:44.119] Server {0x7f7c351f4700} DIAG: (ats_pagespeed_transform) Will record in place: [http://107.108.50.106/ps/combine_javascript2.js]
[May  4 11:15:44.119] Server {0x7f7c351f4700} DIAG: (ats-speed) transform added
[May  4 11:15:44.120] Server {0x7f7c350f3700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:44.120] Server {0x7f7c350f3700} DIAG: (ats-speed) transform_one()
[May  4 11:15:44.120] Server {0x7f7c350f3700} DIAG: (ats-speed) transform!
[May  4 11:15:44.121] Server {0x7f7c350f3700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111544:VERBOSE1:in_place_resource_recorder.cc(120)] IPRO: MaxResponseBytes exceeded while recording http://107.108.50.106/ps/combine_javascript2.js
[May  4 11:15:44.121] Server {0x7f7c350f3700} DIAG: (ats-speed) ipro recording finished
[May  4 11:15:44.121] Server {0x7f7c34ff2700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:44.121] Server {0x7f7c352f5700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Could not rewrite resource in-place because URL is not in cache: http://107.108.50.106/ps/combine_javascript1.js
[May  4 11:15:44.121] Server {0x7f7c352f5700} DIAG: (ats_pagespeed_transform) Will record in place: [http://107.108.50.106/ps/combine_javascript1.js]
[May  4 11:15:44.122] Server {0x7f7c352f5700} DIAG: (ats-speed) transform added
[May  4 11:15:44.122] Server {0x7f7c34aed700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:44.122] Server {0x7f7c34aed700} DIAG: (ats-speed) transform_one()
[May  4 11:15:44.122] Server {0x7f7c34aed700} DIAG: (ats-speed) transform!
[May  4 11:15:44.123] Server {0x7f7c34aed700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111544:VERBOSE1:in_place_resource_recorder.cc(120)] IPRO: MaxResponseBytes exceeded while recording http://107.108.50.106/ps/combine_javascript1.js
[May  4 11:15:44.123] Server {0x7f7c34aed700} DIAG: (ats-speed) ipro recording finished
[May  4 11:15:44.123] Server {0x7f7c349ec700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:44.132] Server {0x7f7c34bee700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:44.133] Server {0x7f7c396d5780} DIAG: (ats-speed) ats_pagespeed_transform()
















[May  4 11:15:53.950] Server {0x7f7c396d5780} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  4 11:15:53.951] Server {0x7f7c396d5780} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Trying to serve rewritten resource in-place: http://107.108.50.106/ps/combine_javascript.html
[May  4 11:15:53.951] Server {0x7f7c396d5780} DIAG: (ats_pagespeed_transform) Will optimize [http://107.108.50.106/ps/combine_javascript.html]
[May  4 11:15:53.951] Server {0x7f7c396d5780} DIAG: (ats-speed) transform added
[May  4 11:15:53.951] Server {0x7f7c34aed700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:53.951] Server {0x7f7c34aed700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] request options found 

[May  4 11:15:53.951] Server {0x7f7c34aed700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] request options:
[May  4 11:15:53.953] Server {0x7f7c34aed700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111553:VERBOSE1:proxy_fetch.cc(550)] Attaching RewriteDriver 0x7f7c1400d490 to HtmlRewriter 0x7f7c14013a00
[May  4 11:15:53.953] Server {0x7f7c34aed700} DIAG: (ats-speed) transform_one()
[May  4 11:15:53.953] Server {0x7f7c34aed700} DIAG: (ats-speed) transform!
[May  4 11:15:53.953] Server {0x7f7c34aed700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111553:VERBOSE1:proxy_fetch.cc(595)] Parse successfully started.
[May  4 11:15:53.953] Server {0x7f7c34aed700} DIAG: (ats-speed) proxy fetch finished
[May  4 11:15:53.953] Server {0x7f7c34aed700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111553:VERBOSE1:proxy_fetch.cc(990)] Fetch result:1 http://107.108.50.106/ps/combine_javascript.html : 200
[May  4 11:15:53.953] Server {0x7f7c349ec700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:53.957] Server {0x7f7c2656c700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] HTTPCache key=http://107.108.50.106/ps/combine_javascript1.js fragment=foo.com: remembering not-cacheable status for 290 seconds.
[May  4 11:15:53.957] Server {0x7f7c2656c700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] HTTPCache key=http://107.108.50.106/ps/combine_javascript2.js fragment=foo.com: remembering not-cacheable status for 290 seconds.
[May  4 11:15:53.959] Server {0x7f7c2656c700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] HTTPCache key=http://107.108.50.106/ps/combine_javascript1.js fragment=foo.com: remembering not-cacheable status for 290 seconds.
[May  4 11:15:53.959] Server {0x7f7c2656c700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] HTTPCache key=http://107.108.50.106/ps/combine_javascript2.js fragment=foo.com: remembering not-cacheable status for 290 seconds.
[May  4 11:15:53.961] Server {0x7f7c2656c700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] HTTPCache key=http://107.108.50.106/ps/combine_javascript1.js fragment=foo.com: remembering not-cacheable status for 290 seconds.
[May  4 11:15:53.961] Server {0x7f7c2656c700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] HTTPCache key=http://107.108.50.106/ps/combine_javascript2.js fragment=foo.com: remembering not-cacheable status for 290 seconds.
[May  4 11:15:53.962] Server {0x7f7c2656c700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] HTTPCache key=http://107.108.50.106/ps/combine_javascript1.js fragment=foo.com: remembering not-cacheable status for 290 seconds.
[May  4 11:15:53.962] Server {0x7f7c2656c700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] HTTPCache key=http://107.108.50.106/ps/combine_javascript2.js fragment=foo.com: remembering not-cacheable status for 290 seconds.
[May  4 11:15:53.963] Server {0x7f7c2556a700} DIAG: (ats-speed) HeadersComplete()!
[May  4 11:15:53.963] Server {0x7f7c2556a700} DIAG: (ats-speed) Done()!
[May  4 11:15:53.966] Server {0x7f7c353f6700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:53.976] Server {0x7f7c34df0700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:15:53.979] Server {0x7f7c396d5780} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  4 11:15:53.980] Server {0x7f7c396d5780} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Trying to serve rewritten resource in-place: http://107.108.50.106/ps/combine_javascript1.js
[May  4 11:15:53.980] Server {0x7f7c353f6700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  4 11:15:53.980] Server {0x7f7c353f6700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Trying to serve rewritten resource in-place: http://107.108.50.106/ps/combine_javascript2.js
[May  4 11:16:08.804] Server {0x7f7c34cef700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  4 11:16:08.805] Server {0x7f7c34cef700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Trying to serve rewritten resource in-place: http://107.108.50.106/ps/combine_javascript.html
[May  4 11:16:08.805] Server {0x7f7c34cef700} DIAG: (ats_pagespeed_transform) Will optimize [http://107.108.50.106/ps/combine_javascript.html]
[May  4 11:16:08.805] Server {0x7f7c34cef700} DIAG: (ats-speed) transform added
[May  4 11:16:08.805] Server {0x7f7c34bee700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.805] Server {0x7f7c34bee700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] request options found 

[May  4 11:16:08.805] Server {0x7f7c34bee700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] request options:
[May  4 11:16:08.806] Server {0x7f7c34bee700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111608:VERBOSE1:proxy_fetch.cc(550)] Attaching RewriteDriver 0x7f7c1800d130 to HtmlRewriter 0x7f7c18012950
[May  4 11:16:08.806] Server {0x7f7c34bee700} DIAG: (ats-speed) transform_one()
[May  4 11:16:08.806] Server {0x7f7c34bee700} DIAG: (ats-speed) transform!
[May  4 11:16:08.806] Server {0x7f7c34bee700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111608:VERBOSE1:proxy_fetch.cc(595)] Parse successfully started.
[May  4 11:16:08.806] Server {0x7f7c34bee700} DIAG: (ats-speed) proxy fetch finished
[May  4 11:16:08.806] Server {0x7f7c34bee700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111608:VERBOSE1:proxy_fetch.cc(990)] Fetch result:1 http://107.108.50.106/ps/combine_javascript.html : 200
[May  4 11:16:08.806] Server {0x7f7c34aed700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.807] Server {0x7f7c25d6b700} DIAG: (ats-speed) HeadersComplete()!
[May  4 11:16:08.808] Server {0x7f7c25d6b700} DIAG: (ats-speed) Done()!
[May  4 11:16:08.808] Server {0x7f7c396d5780} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.808] Server {0x7f7c34ef1700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.821] Server {0x7f7c34cef700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  4 11:16:08.822] Server {0x7f7c34df0700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  4 11:16:08.822] Server {0x7f7c34cef700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Trying to serve rewritten resource in-place: http://107.108.50.106/ps/combine_javascript1.js
[May  4 11:16:08.822] Server {0x7f7c34df0700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Trying to serve rewritten resource in-place: http://107.108.50.106/ps/combine_javascript2.js
[May  4 11:16:08.846] Server {0x7f7c34cef700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  4 11:16:08.846] Server {0x7f7c34cef700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Trying to serve rewritten resource in-place: http://107.108.50.106/favicon.ico
[May  4 11:16:08.887] Server {0x7f7c2656c700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111608:VERBOSE1:cache_url_async_fetcher.cc(345)] Did not find in cache: http://107.108.50.106/favicon.ico (foo.com)
[May  4 11:16:08.887] Server {0x7f7c2656c700} DIAG: (ats-speed) HeadersComplete()!
[May  4 11:16:08.887] Server {0x7f7c2656c700} DIAG: (ats-speed) ipro forwarddata: HTTP/1.0 501 (null)
Connection: Close


[May  4 11:16:08.887] Server {0x7f7c2656c700} DIAG: (ats-speed) ipro lookup base fetch done()
[May  4 11:16:08.887] Server {0x7f7c2656c700} DIAG: (ats-speed) ipro lookup base fetch -> not found in cache
[May  4 11:16:08.980] Server {0x7f7c34cef700} DIAG: (ats-speed) [ats_pagespeed 1.9.32.3-4448] Could not rewrite resource in-place because URL is not in cache: http://107.108.50.106/favicon.ico
[May  4 11:16:08.980] Server {0x7f7c34cef700} DIAG: (ats_pagespeed_transform) Will record in place: [http://107.108.50.106/favicon.ico]
[May  4 11:16:08.980] Server {0x7f7c34cef700} DIAG: (ats-speed) transform added
[May  4 11:16:08.980] Server {0x7f7c34bee700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.981] Server {0x7f7c34bee700} DIAG: (ats-speed) transform_one()
[May  4 11:16:08.981] Server {0x7f7c34bee700} DIAG: (ats-speed) transform!
[May  4 11:16:08.981] Server {0x7f7c34bee700} DIAG: (ats-speed-vlog) [1.9.32.3-4448] [0504/111608:VERBOSE1:in_place_resource_recorder.cc(120)] IPRO: MaxResponseBytes exceeded while recording http://107.108.50.106/favicon.ico
[May  4 11:16:08.981] Server {0x7f7c349ec700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.981] Server {0x7f7c349ec700} DIAG: (ats-speed) transform_one()
[May  4 11:16:08.981] Server {0x7f7c349ec700} DIAG: (ats-speed) transform!
[May  4 11:16:08.982] Server {0x7f7c351f4700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.982] Server {0x7f7c351f4700} DIAG: (ats-speed) transform_one()
[May  4 11:16:08.982] Server {0x7f7c351f4700} DIAG: (ats-speed) transform!
[May  4 11:16:08.982] Server {0x7f7c350f3700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.982] Server {0x7f7c350f3700} DIAG: (ats-speed) transform_one()
[May  4 11:16:08.982] Server {0x7f7c350f3700} DIAG: (ats-speed) transform!
[May  4 11:16:08.982] Server {0x7f7c34ff2700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.982] Server {0x7f7c34ff2700} DIAG: (ats-speed) transform_one()
[May  4 11:16:08.982] Server {0x7f7c34ff2700} DIAG: (ats-speed) transform!
[May  4 11:16:08.982] Server {0x7f7c34ef1700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.982] Server {0x7f7c34ef1700} DIAG: (ats-speed) transform_one()
[May  4 11:16:08.982] Server {0x7f7c34ef1700} DIAG: (ats-speed) transform!
[May  4 11:16:08.982] Server {0x7f7c34df0700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.982] Server {0x7f7c34df0700} DIAG: (ats-speed) transform_one()
[May  4 11:16:08.982] Server {0x7f7c34df0700} DIAG: (ats-speed) transform!
[May  4 11:16:08.982] Server {0x7f7c34cef700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.982] Server {0x7f7c34cef700} DIAG: (ats-speed) transform_one()
[May  4 11:16:08.982] Server {0x7f7c34cef700} DIAG: (ats-speed) transform!
[May  4 11:16:08.983] Server {0x7f7c34bee700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.983] Server {0x7f7c34bee700} DIAG: (ats-speed) transform_one()
[May  4 11:16:08.983] Server {0x7f7c34bee700} DIAG: (ats-speed) transform!
[May  4 11:16:08.983] Server {0x7f7c34aed700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.983] Server {0x7f7c34aed700} DIAG: (ats-speed) transform_one()
[May  4 11:16:08.983] Server {0x7f7c34aed700} DIAG: (ats-speed) transform!
[May  4 11:16:08.983] Server {0x7f7c349ec700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.983] Server {0x7f7c349ec700} DIAG: (ats-speed) transform_one()
[May  4 11:16:08.983] Server {0x7f7c349ec700} DIAG: (ats-speed) transform!
[May  4 11:16:08.983] Server {0x7f7c396d5780} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.983] Server {0x7f7c396d5780} DIAG: (ats-speed) transform_one()
[May  4 11:16:08.983] Server {0x7f7c396d5780} DIAG: (ats-speed) transform!
[May  4 11:16:08.983] Server {0x7f7c353f6700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.983] Server {0x7f7c353f6700} DIAG: (ats-speed) transform_one()
[May  4 11:16:08.983] Server {0x7f7c353f6700} DIAG: (ats-speed) transform!
[May  4 11:16:08.983] Server {0x7f7c353f6700} DIAG: (ats-speed) ipro recording finished
[May  4 11:16:08.983] Server {0x7f7c352f5700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.993] Server {0x7f7c396d5780} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:08.993] Server {0x7f7c353f6700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  4 11:16:09.004] Server {0x7f7c352f5700} DIAG: (ats-speed) ats_pagespeed_transform()
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-discuss+unsub...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "mod-pagespeed-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-discuss+unsub...@googlegroups.com.

kapil kumar

unread,
May 4, 2016, 9:53:01 AM5/4/16
to mod-pagespeed-discuss
Hello,
-I am curious to know if its a bug in the plugin or problem in my test setup ?
-Will this plugin works with ATS running in non-forward proxy mode ?

Thank and regards,
Kapil Kumar
...

Otto van der Schaaf

unread,
May 4, 2016, 10:02:50 AM5/4/16
to mod-pagespeed-discuss
On Wed, May 4, 2016 at 3:53 PM, kapil kumar <kapil...@gmail.com> wrote:
-I am curious to know if its a bug in the plugin or problem in my test setup ?

I'm trying to reproduce your problem, no luck yet. Perhaps I need to test on the latest ATS version, I'll get back on this when I know more.

-Will this plugin works with ATS running in non-forward proxy mode ?

It works for well for us in reverse proxy mode at https://www.iispeed.com/pagespeed/service, where ATS+ats_pagespeed are building blocks for this demo service.
I also know there are others running it with the proper behavior.
However, I'm not 100% sure that the behavior you are seeing is attributable to running in forward proxy mode yet.

Otto





kapil kumar

unread,
May 5, 2016, 1:51:16 AM5/5/16
to mod-pagespeed-discuss
Thanks again for your continuous support.

- i am using ATS 6.1 and ubuntu 14.04 64 bit machine for running ATS. i used two different Apache web server on my Windows machine and Cent Os machine (for testing purpose) 
Could you please let me know the working ATS version for your setup?

-i changed the proxy mode to reverse proxy mode just for testing. (cleared the mozilla and ATS cache also)
But i am still observing that, combine_css and combine_js test cases are not working :(
Al tough i can see remove_comments.html or add_head worked fine. 

Otto van der Schaaf

unread,
May 5, 2016, 6:02:14 AM5/5/16
to mod-pagespeed-discuss

On Thu, May 5, 2016 at 7:51 AM, kapil kumar <kapil...@gmail.com> wrote:
combine_css and combine_js t

Could you turn on the debug filter?

pagespeed EnableFilters debug

The debug filter will write helpful html comments around optimization decisions pagespeed makes right after the involved elements. One common reason for not rewriting resources is when they are served as non-cacheable.

Otto

 

kapil kumar

unread,
May 5, 2016, 6:25:29 AM5/5/16
to mod-pagespeed-discuss
Sure. i have tried the same for combine_css and it added these comments in the HTML itself:
<!--
#NumFlushes            0
#EndDocument after     482us
#Total Parse duration  366us
#Total Render duration 1123us
#Total Idle duration   116us
-->


These are the logs on first and second time loading the page in Mozilla.
[May  5 15:49:39.416] Server {0x7f630da57700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  5 15:49:39.429] Server {0x7f630da57700} DIAG: (ats_pagespeed_transform) Will optimize [http://107.109.155.97/combine_css.html]
[May  5 15:49:39.429] Server {0x7f630da57700} DIAG: (ats-speed) transform added
[May  5 15:49:39.429] Server {0x7f630d956700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  5 15:49:39.430] Server {0x7f630d956700} DIAG: (ats-speed-vlog) [1.8.31.4-4009] [0505/154939:VERBOSE1:proxy_fetch.cc(516)] Attaching RewriteDriver 0x7f62d8010d70 to HtmlRewriter 0x7f62d8016190
[May  5 15:49:39.430] Server {0x7f630d956700} DIAG: (ats-speed) transform_one()
[May  5 15:49:39.430] Server {0x7f630d956700} DIAG: (ats-speed) transform!
[May  5 15:49:39.431] Server {0x7f630d956700} DIAG: (ats-speed-vlog) [1.8.31.4-4009] [0505/154939:VERBOSE1:proxy_fetch.cc(561)] Parse successfully started.
[May  5 15:49:39.431] Server {0x7f630d956700} DIAG: (ats-speed) proxy fetch finished
[May  5 15:49:39.431] Server {0x7f630d956700} DIAG: (ats-speed-vlog) [1.8.31.4-4009] [0505/154939:VERBOSE1:proxy_fetch.cc(946)] Fetch result:1 http://107.109.155.97/combine_css.html : 200
[May  5 15:49:39.431] Server {0x7f630d855700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  5 15:49:39.436] Server {0x7f62f63fa700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] http://127.0.0.1/styles/yellow.css:0:serf_context_run error status=111 (Connection refused)
[May  5 15:49:39.436] Server {0x7f62f63fa700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] Fetch failed to start: http://127.0.0.1/styles/yellow.css
[May  5 15:49:39.437] Server {0x7f62f63fa700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] http://127.0.0.1/styles/blue.css:0:serf_context_run error status=111 (Connection refused)
[May  5 15:49:39.437] Server {0x7f62f63fa700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] Fetch failed to start: http://127.0.0.1/styles/blue.css
[May  5 15:49:39.438] Server {0x7f62f63fa700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] http://127.0.0.1/styles/big.css:0:serf_context_run error status=111 (Connection refused)
[May  5 15:49:39.438] Server {0x7f62f63fa700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] Fetch failed to start: http://127.0.0.1/styles/big.css
[May  5 15:49:39.439] Server {0x7f62f63fa700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] http://127.0.0.1/styles/bold.css:0:serf_context_run error status=111 (Connection refused)
[May  5 15:49:39.439] Server {0x7f62f63fa700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] Fetch failed to start: http://127.0.0.1/styles/bold.css
[May  5 15:49:39.440] Server {0x7f62f6bfb700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] HTTPCache key=http://107.109.155.97/styles/yellow.css fragment=foo.com: remembering not-found status for 299 seconds.
[May  5 15:49:39.440] Server {0x7f62f6bfb700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] HTTPCache key=http://107.109.155.97/styles/blue.css fragment=foo.com: remembering not-found status for 299 seconds.
[May  5 15:49:39.440] Server {0x7f62f6bfb700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] HTTPCache key=http://107.109.155.97/styles/big.css fragment=foo.com: remembering not-found status for 299 seconds.
[May  5 15:49:39.440] Server {0x7f62f6bfb700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] HTTPCache key=http://107.109.155.97/styles/bold.css fragment=foo.com: remembering not-found status for 299 seconds.
[May  5 15:49:39.441] Server {0x7f62f6bfb700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] HTTPCache key=http://107.109.155.97/styles/yellow.css fragment=foo.com: remembering not-found status for 299 seconds.
[May  5 15:49:39.441] Server {0x7f62f6bfb700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] HTTPCache key=http://107.109.155.97/styles/blue.css fragment=foo.com: remembering not-found status for 299 seconds.
[May  5 15:49:39.442] Server {0x7f62f6bfb700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] HTTPCache key=http://107.109.155.97/styles/big.css fragment=foo.com: remembering not-found status for 299 seconds.
[May  5 15:49:39.442] Server {0x7f62f6bfb700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] HTTPCache key=http://107.109.155.97/styles/bold.css fragment=foo.com: remembering not-found status for 299 seconds.
[May  5 15:49:39.443] Server {0x7f62f6bfb700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] HTTPCache key=http://107.109.155.97/styles/yellow.css fragment=foo.com: remembering not-found status for 299 seconds.
[May  5 15:49:39.443] Server {0x7f62f6bfb700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] HTTPCache key=http://107.109.155.97/styles/blue.css fragment=foo.com: remembering not-found status for 299 seconds.
[May  5 15:49:39.443] Server {0x7f62f6bfb700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] HTTPCache key=http://107.109.155.97/styles/big.css fragment=foo.com: remembering not-found status for 299 seconds.
[May  5 15:49:39.443] Server {0x7f62f6bfb700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] HTTPCache key=http://107.109.155.97/styles/bold.css fragment=foo.com: remembering not-found status for 299 seconds.
[May  5 15:49:39.445] Server {0x7f62f73fc700} DIAG: (ats-speed) HeadersComplete()!
[May  5 15:49:39.445] Server {0x7f62f73fc700} DIAG: (ats-speed) Done()!
[May  5 15:49:39.453] Server {0x7f630d653700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  5 15:49:39.473] Server {0x7f630dc59700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  5 15:49:39.477] Server {0x7f630da57700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  5 15:49:39.478] Server {0x7f630db58700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  5 15:49:39.478] Server {0x7f630da57700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  5 15:49:39.478] Server {0x7f630d653700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/


[May  5 15:50:08.955] Server {0x7f630da57700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  5 15:50:08.955] Server {0x7f630da57700} DIAG: (ats_pagespeed_transform) Will optimize [http://107.109.155.97/combine_css.html]
[May  5 15:50:08.955] Server {0x7f630da57700} DIAG: (ats-speed) transform added
[May  5 15:50:08.956] Server {0x7f630d855700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  5 15:50:08.956] Server {0x7f630d855700} DIAG: (ats-speed-vlog) [1.8.31.4-4009] [0505/155008:VERBOSE1:proxy_fetch.cc(516)] Attaching RewriteDriver 0x7f62ec179250 to HtmlRewriter 0x7f62ec17d4d0
[May  5 15:50:08.956] Server {0x7f630d855700} DIAG: (ats-speed) transform_one()
[May  5 15:50:08.956] Server {0x7f630d855700} DIAG: (ats-speed) transform!
[May  5 15:50:08.956] Server {0x7f630d855700} DIAG: (ats-speed-vlog) [1.8.31.4-4009] [0505/155008:VERBOSE1:proxy_fetch.cc(561)] Parse successfully started.
[May  5 15:50:08.956] Server {0x7f630d855700} DIAG: (ats-speed) proxy fetch finished
[May  5 15:50:08.956] Server {0x7f630d855700} DIAG: (ats-speed-vlog) [1.8.31.4-4009] [0505/155008:VERBOSE1:proxy_fetch.cc(946)] Fetch result:1 http://107.109.155.97/combine_css.html : 200
[May  5 15:50:08.956] Server {0x7f630d754700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  5 15:50:08.958] Server {0x7f62f7bfd700} DIAG: (ats-speed) HeadersComplete()!
[May  5 15:50:08.958] Server {0x7f62f7bfd700} DIAG: (ats-speed) Done()!
[May  5 15:50:08.965] Server {0x7f630d653700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  5 15:50:08.985] Server {0x7f630db58700} DIAG: (ats-speed) ats_pagespeed_transform()
[May  5 15:50:08.989] Server {0x7f630da57700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  5 15:50:08.990] Server {0x7f630d653700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  5 15:50:08.990] Server {0x7f630da57700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/
[May  5 15:50:08.990] Server {0x7f630db58700} DIAG: (ats-speed) static asset prefix: /pagespeed_static/


FYI : I have installed ATS 5.3 in forward proxy now. Its still not working, so now i am suspecting something wrong with the setup maybe. Any comments ?

Otto van der Schaaf

unread,
May 5, 2016, 6:30:22 AM5/5/16
to mod-pagespeed-discuss
So, no debug comments are written after the <link> elements for the css?
Would you be able to share a url so I can have a look? 

Otto

--
You received this message because you are subscribed to the Google Groups "mod-pagespeed-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-di...@googlegroups.com.
 To view this discussion on the web visit https://groups.google.com/d/msgid/mod-pagespeed-discuss/1148703a-8ec5-4f38-bbd1-18f610a846b7%40googlegroups.com.

kapil kumar

unread,
May 5, 2016, 6:37:02 AM5/5/16
to mod-pagespeed-discuss
Hello,
Nothing else has been added :(

For testing, i took the test HTML from "mod_pagespeed\src\install\mod_pagespeed_example/combine_css.html" and copied to my web server.

Is there any open link for testing ? (which show before/after output)

Br,
Kapil Kumar
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-discuss+unsub...@googlegroups.com.

Otto van der Schaaf

unread,
May 5, 2016, 6:46:23 AM5/5/16
to mod-pagespeed-discuss

On Thu, May 5, 2016 at 12:37 PM, kapil kumar <kapil...@gmail.com> wrote:

Is there any open link for testing ? (which show before/after output)

See http://www.modpagespeed.com/

The optimized result for the css combining example should end up like this: http://www.modpagespeed.com/combine_css.html?PageSpeed=on&PageSpeedFilters=combine_css

Otto

kapil kumar

unread,
May 5, 2016, 6:57:03 AM5/5/16
to mod-pagespeed-discuss
Thanks, i checked the same. But for me always result is the same :(
CSS or JS is not combining. Or Images are not getting transformed.

As i informed before, add_head or remove_comments use cases works fine. But all the sub resources transformation are not working.
So i am struck here with no clue at all.

<html>
<head>
<title>combine_css example</title>
<link rel="stylesheet" type="text/css" href="styles/yellow.css">
<link rel="stylesheet" type="text/css" href="styles/blue.css">
<link rel="stylesheet" type="text/css" href="styles/big.css">
<link rel="stylesheet" type="text/css" href="styles/bold.css">
</head>
<body>
<div class="blue yellow big bold">
Hello, PageSpeed!
</div>
</body>
</html>
<!--
#NumFlushes            0
#EndDocument after     820us
#Total Parse duration  597us
#Total Render duration 1146us
#Total Idle duration   223us
-->

Otto van der Schaaf

unread,
May 5, 2016, 7:06:34 AM5/5/16
to mod-pagespeed-discuss
This fragment from the last log you posted earlier might explain it:

[May  5 15:49:39.440] Server {0x7f62f6bfb700} DIAG: (ats-speed) [ats_pagespeed 1.8.31.4-4009] HTTPCache key=http://107.109.155.97/styles/yellow.css fragment=foo.com: remembering not-found status for 299 seconds.

It looks like pagespeed is not able to fetch the css?

Otto 


--
You received this message because you are subscribed to the Google Groups "mod-pagespeed-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-di...@googlegroups.com.
 To view this discussion on the web visit https://groups.google.com/d/msgid/mod-pagespeed-discuss/27adea66-8281-4e2f-a62b-0c7a016ed3bb%40googlegroups.com.

kapil kumar

unread,
May 5, 2016, 7:13:54 AM5/5/16
to mod-pagespeed-discuss
Even i suspected that before. (specially in reveres proxy mode, till i added in remap.conf)
But in forward proxy mode, by default its able to access.

As i could open the direct link : http://107.108.50.106/ps/styles/yellow.css, and webpage also shows yellow background.
But i am not sure about this log exactly.

Could you please share your setup configuration details too ?

Thanks again ,
KK
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-discuss+unsub...@googlegroups.com.

kapil kumar

unread,
May 5, 2016, 11:37:07 AM5/5/16
to mod-pagespeed-discuss
Can you please suggest other debugging point to see why subresources are not getting transformed ?

Thanks a lot.

Otto van der Schaaf

unread,
May 5, 2016, 11:44:28 AM5/5/16
to mod-pagespeed-discuss

On Thu, May 5, 2016 at 5:37 PM, kapil kumar <kapil...@gmail.com> wrote:
Can you please suggest other debugging point to see why subresources are not getting transformed ?

Do you see any requests mentioning "serf" or "pagespeed" in their user-agent strings in the server access logs?

kapil kumar

unread,
May 6, 2016, 1:20:22 AM5/6/16
to mod-pagespeed-discuss
GM,

I checked the original Web server logs and i just see Mozilla UA. 

107.109.153.156 - - [06/May/2016:10:47:06 +0530] "GET /css.html HTTP/1.1" 200 571 "-" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:35.0) Gecko/20100101 Firefox/35.0"
107.109.153.156 - - [06/May/2016:10:47:06 +0530] "GET /yellow.css HTTP/1.1" 200 36 "http://107.108.50.106/css.html" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:35.0) Gecko/20100101 Firefox/35.0"
107.109.153.156 - - [06/May/2016:10:47:06 +0530] "GET /blue.css HTTP/1.1" 200 21 "http://107.108.50.106/css.html" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:35.0) Gecko/20100101 Firefox/35.0"
107.109.153.156 - - [06/May/2016:10:47:06 +0530] "GET /big.css HTTP/1.1" 200 4307 "http://107.108.50.106/css.html" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:35.0) Gecko/20100101 Firefox/35.0"
107.109.153.156 - - [06/May/2016:10:47:06 +0530] "GET /bold.css HTTP/1.1" 200 31 "http://107.108.50.106/css.html" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:35.0) Gecko/20100101 Firefox/35.0"
107.109.153.156 - - [06/May/2016:10:47:06 +0530] "GET /favicon.ico HTTP/1.1" 200 30894 "-" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:35.0) Gecko/20100101 Firefox/35.0"

In deal situation, do ATS/pagespeed request the resources with UA as pagespeed ? (not the original UA?)

Otto van der Schaaf

unread,
May 6, 2016, 4:17:40 AM5/6/16
to mod-pagespeed-discuss
PageSpeed should (attempt to) fetch the css files that the html mentions via http, and I would have expected those attempts to show up in the logs with a user-agent that mentions mod_pagespeed and Serf.

Otto

--
You received this message because you are subscribed to the Google Groups "mod-pagespeed-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-di...@googlegroups.com.
 To view this discussion on the web visit https://groups.google.com/d/msgid/mod-pagespeed-discuss/f55badc0-3e2b-478a-8f20-3fc7d1341c31%40googlegroups.com.

kapil kumar

unread,
May 6, 2016, 5:40:26 AM5/6/16
to mod-pagespeed-discuss
Thanks a lot Otto for giving suggestion to add domainmapping, once i added this it works fine :)
Will test all use cases and other websites now.

Really appreciate your support :)
Cheers
To unsubscribe from this group and stop receiving emails from it, send an email to mod-pagespeed-discuss+unsub...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages