Record page sets for https:// requests fail with CertificateError

[singapati]

Hello,

I am trying to record page sets from Android chromium (ChromePublic APK / Content-shell apk). Chromium version: 50.0.2661.76.

Recording "http://.." urls works but not "https://". https:// requests fail with CertificateError.

For eg., this one:
tools/perf/record_wpr -v --chrome-root=~/path/to/chrome_android/src --browser=android-chromium top10_mobile_page_set

************************** WPR LOG *****************************
(INFO) 2016-05-26 14:33:06,801 platformsettings.get_original_primary_nameserver:288 Saved original primary DNS nameserver: 127.0.1.1
(WARNING) 2016-05-26 14:33:06,802 httpproxy.__init__:350 HTTP server started on 127.0.0.1:45612
(WARNING) 2016-05-26 14:33:06,802 httpproxy.__init__:350 HTTPS server started on 127.0.0.1:34258
(INFO) 2016-05-26 14:33:06,884 httpproxy.handle_one_request:187 httpproxy handle_one_request()
(INFO) 2016-05-26 14:33:06,885 httpproxy.read_request_body:90 read_request_body() : None
(INFO) 2016-05-26 14:33:06,885 httpproxy.do_parse_and_handle_one_request:245 response: (11, 200, 'OK', [('content-type', 'text/plain')], ['200 OK'])
(INFO) 2016-05-26 14:33:12,754 httpproxy.handle_one_request:187 httpproxy handle_one_request()
(INFO) 2016-05-26 14:33:12,785 httpproxy.read_request_body:90 read_request_body() : None
(INFO) 2016-05-26 14:33:12,786 httpproxy.do_parse_and_handle_one_request:245 response: None
(INFO) 2016-05-26 14:33:12,786 httpclient.__call__:310 RealHttpFetch: www.google.com /
(INFO) 2016-05-26 14:33:12,792 httpproxy.handle_one_request:187 httpproxy handle_one_request()
(INFO) 2016-05-26 14:33:14,175 httpclient.__call__:346 Retrying fetch GET https://www.google.com/ [('accept-encoding', 'gzip,deflate'), ('host', 'www.google.com'), ('upgrade-insecure-requests', '1')]: CertificateError("hostname '216.58.201.164' doesn't match 'www.google.com'",)
(INFO) 2016-05-26 14:33:14,308 httpclient.__call__:346 Retrying fetch GET https://www.google.com/ [('accept-encoding', 'gzip,deflate'), ('host', 'www.google.com'), ('upgrade-insecure-requests', '1')]: CertificateError("hostname '216.58.201.164' doesn't match 'www.google.com'",)
(INFO) 2016-05-26 14:33:14,440 httpclient.__call__:346 Retrying fetch GET https://www.google.com/ [('accept-encoding', 'gzip,deflate'), ('host', 'www.google.com'), ('upgrade-insecure-requests', '1')]: CertificateError("hostname '216.58.201.164' doesn't match 'www.google.com'",)
(CRITICAL) 2016-05-26 14:33:14,586 httpclient.__call__:348 Could not fetch GET https://www.google.com/ [('accept-encoding', 'gzip,deflate'), ('host', 'www.google.com'), ('upgrade-insecure-requests', '1')]: CertificateError("hostname '216.58.201.164' doesn't match 'www.google.com'",)
(INFO) 2016-05-26 14:33:14,587 httpproxy.do_parse_and_handle_one_request:251 do_parse_and_handle_one_request() 404
(WARNING) 2016-05-26 14:33:14,587 httpproxy.do_parse_and_handle_one_request:263 Failed to find response for: GET https://www.google.com/ [('accept-encoding', 'gzip,deflate'), ('host', 'www.google.com'), ('upgrade-insecure-requests', '1')] (1801ms)
(INFO) 2016-05-26 14:33:14,587 httpproxy.handle_one_request:187 httpproxy handle_one_request()
(INFO) 2016-05-26 14:33:14,696 httpproxy.read_request_body:90 read_request_body() : None
(INFO) 2016-05-26 14:33:14,696 httpproxy.do_parse_and_handle_one_request:245 response: None
(INFO) 2016-05-26 14:33:14,696 httpclient.__call__:310 RealHttpFetch: www.google.com /favicon.ico
(INFO) 2016-05-26 14:33:14,839 httpclient.__call__:346 Retrying fetch GET https://www.google.com/favicon.ico [('accept-encoding', 'gzip,deflate'), ('host', 'www.google.com')]: CertificateError("hostname '216.58.201.164' doesn't match 'www.google.com'",)
(INFO) 2016-05-26 14:33:14,977 httpclient.__call__:346 Retrying fetch GET https://www.google.com/favicon.ico [('accept-encoding', 'gzip,deflate'), ('host', 'www.google.com')]: CertificateError("hostname '216.58.201.164' doesn't match 'www.google.com'",)
(INFO) 2016-05-26 14:33:15,120 httpclient.__call__:346 Retrying fetch GET https://www.google.com/favicon.ico [('accept-encoding', 'gzip,deflate'), ('host', 'www.google.com')]: CertificateError("hostname '216.58.201.164' doesn't match 'www.google.com'",)
(CRITICAL) 2016-05-26 14:33:15,268 httpclient.__call__:348 Could not fetch GET https://www.google.com/favicon.ico [('accept-encoding', 'gzip,deflate'), ('host', 'www.google.com')]: CertificateError("hostname '216.58.201.164' doesn't match 'www.google.com'",)
(INFO) 2016-05-26 14:33:15,268 httpproxy.do_parse_and_handle_one_request:251 do_parse_and_handle_one_request() 404
(WARNING) 2016-05-26 14:33:15,268 httpproxy.do_parse_and_handle_one_request:263 Failed to find response for: GET https://www.google.com/favicon.ico [('accept-encoding', 'gzip,deflate'), ('host', 'www.google.com')] (573ms)
(INFO) 2016-05-26 14:33:15,268 httpproxy.handle_one_request:187 httpproxy handle_one_request()
(INFO) 2016-05-26 14:33:17,756 httpproxy.handle_one_request:187 httpproxy handle_one_request()
(INFO) 2016-05-26 14:33:17,756 httpproxy.read_request_body:90 read_request_body() : None
(INFO) 2016-05-26 14:33:17,756 httpproxy.do_parse_and_handle_one_request:245 response: (11, 200, 'OK', [('content-type', 'text/plain')], ['200 OK'])
(INFO) 2016-05-26 14:33:17,763 httpproxy.handle_one_request:187 httpproxy handle_one_request()
(INFO) 2016-05-26 14:33:17,764 httpproxy.read_request_body:90 read_request_body() : None
(INFO) 2016-05-26 14:33:17,764 httpproxy.do_parse_and_handle_one_request:245 response: (11, 200, 'OK', [('content-type', 'text/plain')], ['200 OK'])
(INFO) 2016-05-26 14:33:18,298 httpproxy.cleanup:359 Stopped HTTPS server. Total time processing requests: 2375ms
(INFO) 2016-05-26 14:33:18,765 httpproxy.cleanup:359 Stopped HTTP server. Total time processing requests: 2ms
(INFO) 2016-05-26 14:33:18,765 replay.replay:367 Saved 0 responses to /tmp/tmp14UrzQ

************************** END OF WPR LOG **********************

Thanks,
Sarath

[Ned]

I suspect this is because your python version is less than 2.7.9. WPR from TOT won't run against old python. Can you pull the latest & run it again?

--
You received this message because you are subscribed to the Google Groups "telemetry" group.
To unsubscribe from this group and stop receiving emails from it, send an email to telemetry+...@chromium.org.

[Sarath Singapati]

Yes, works with latest telemetry scripts. Thanks.