Regarding Executing Performance Tests Locally

[AJITHKUMAR VELUTHERI]

Hello Telemetry Team,

 

I was trying to measure the performance of my patch https://codereview.chromium.org/2979533002/ (Associated with bug https://bugs.chromium.org/p/chromium/issues/detail?id=737388) using following command locally on a Linux build.

 

./tools/perf/run_benchmark -v --browser=default --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.social.facebook.infinite.scroll system_health.common_desktop

 

I got following error during the execution almost all the times, after test is started and the browser is launched;

 

INFO:root:*********** END OF BROWSER STANDARD OUTPUT ************
INFO:root:********************* BROWSER LOG *********************
INFO:root:No log file
INFO:root:***************** END OF BROWSER LOG ******************
Traceback (most recent call last):
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 107, in _RunStoryAndProcessErrorIfNeeded
    state.RunStory(results)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function
    return func(*args, **kwargs)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 305, in RunStory
    self._current_page.Run(self)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/third_party/catapult/telemetry/telemetry/page/__init__.py", line 112, in Run
    self.RunPageInteractions(action_runner)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/tools/perf/page_sets/system_health/system_health_story.py", line 142, in RunPageInteractions
    self._DidLoadDocument(action_runner)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/tools/perf/page_sets/system_health/browsing_stories.py", line 808, in _DidLoadDocument
    self._Scroll(action_runner, self.SCROLL_DISTANCE, self.SCROLL_STEP)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/tools/perf/page_sets/system_health/browsing_stories.py", line 830, in _Scroll
    'Scrolling stuck at %d' % remaining)
StoryActionError: Scrolling stuck at 13648

INFO:root:Chrome version: 3151
INFO:root:Trace sizes in bytes: {'cpuSnapshots': 2916705, 'traceEvents': 26639832, 'telemetry': 258381, 'tabIds': 40}
[  FAILED  ] browse:social:facebook_infinite_scroll@{'case': 'browse', 'group': 'social'} (62539 ms)
INFO:py_utils.cloud_storage:Uploading /tmp/tmpnCgb5O.html to gs://chrome-telemetry-output/trace-file-id_1-2017-07-11_20-04-22-23428.html
ERROR:root:Cannot upload trace files to cloud storage due to  permission error: Attempted to access a file from Cloud Storage but you don't have permission. To configure your credentials:
  1. Run "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/third_party/catapult/third_party/gsutil/gsutil config" and follow its instructions.
  2. If you have a @google.com account, use that account.
  3. For the project-id, just enter 0.
INFO:py_utils.cloud_storage:Uploading /tmp/tmpHAyGJN.png to gs://chrome-telemetry-output/profiler-file-id_0-2017-07-11_20-04-2330253.png
ERROR:root:Cannot upload profiling files to cloud storage due to  permission error: Attempted to access a file from Cloud Storage but you don't have permission. To configure your credentials:
  1. Run "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/third_party/catapult/third_party/gsutil/gsutil config" and follow its instructions.
  2. If you have a @google.com account, use that account.
  3. For the project-id, just enter 0.
[  PASSED  ] 0 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ]  browse:social:facebook_infinite_scroll@{'case': 'browse', 'group': 'social'}

1 FAILED TEST

View result at file:///home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/tools/perf/results-chart.json

 

I had already configured "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/third_party/catapult/third_party/gsutil/gsutil config" correctly and did multiple times after deleting .boto.bak file.

 

It appears like a permission error from Google Telemetry system. Could you please give necessary permission to aji...@samsung.com and aji...@chromium.org and help me to rectify this problem.

 

If it's possible to run on Android platform, then please share those information as well.

 

 

Thanks & Regards,

Ajith

[AJITHKUMAR VELUTHERI]

Hello Telemetry team,

 

Could you please update me on below request ?

 

Regards,

Ajith

 

--------- Original Message ---------

Sender : AJITH KUMAR V <aji...@samsung.com> Chief Engineer/SRI-Bangalore-Android Web-ContentView/Samsung Electronics

Date : 2017-07-11 20:12 (GMT+5:30)

Title : Regarding Executing Performance Tests Locally

To : null<tele...@chromium.org>, AJITH KUMAR V<aji...@samsung.com>

 

Hello Telemetry Team,

 

I was trying to measure the performance of my patch https://codereview.chromium.org/2979533002/ (Associated with bug https://bugs.chromium.org/p/chromium/issues/detail?id=737388) using following command locally on a Linux build.

 

./tools/perf/run_benchmark -v --browser=default --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.social.facebook.infinite.scroll system_health.common_desktop

 

I got following error during the execution almost all the times, after test is started and the browser is launched;

 

INFO:root:*********** END OF BROWSER STANDARD OUTPUT ************
INFO:root:********************* BROWSER LOG *********************
INFO:root:No log file
INFO:root:***************** END OF BROWSER LOG ******************
Traceback (most recent call last):
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 107, in _RunStoryAndProcessErrorIfNeeded
    state.RunStory(results)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function
    return func(*args, **kwargs)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 305, in RunStory
    self._current_page.Run(self)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/third_party/catapult/telemetry/telemetry/page/__init__.py", line 112, in Run
    self.RunPageInteractions(action_runner)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/tools/perf/page_sets/system_health/system_health_story.py", line 142, in RunPageInteractions
    self._DidLoadDocument(action_runner)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/tools/perf/page_sets/system_health/browsing_stories.py", line 808, in _DidLoadDocument
    self._Scroll(action_runner, self.SCROLL_DISTANCE, self.SCROLL_STEP)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/LINUX-CHROMIUM/src/tools/perf/page_sets/system_health/browsing_stories.py", line 830, in _Scroll
    'Scrolling stuck at %d' % remaining)

StoryActiON-ERROR: Scrolling stuck at 13648

[Ned]

Can you update your copy of Chromium check out? We landed a fix that make infinite scroll stories more stable recently (https://chromium-review.googlesource.com/c/563340/).

--
You received this message because you are subscribed to the Google Groups "telemetry" group.
To unsubscribe from this group and stop receiving emails from it, send an email to telemetry+...@chromium.org.

[AJITHKUMAR VELUTHERI]

My Checkout is based on 61.0.3151.0

 

Regards,

Ajith

--------- Original Message ---------

Sender : Ned <nedn...@google.com>

Date : 2017-07-12 15:56 (GMT+5:30)

Title : Re: Regarding Executing Performance Tests Locally

To : null<tele...@chromium.org>, AJITH KUMAR V<aji...@samsung.com>

CC : null<ko...@chromium.org>, null<chan...@chromium.org>

--

You received this message because you are subscribed to the Google Groups "telemetry" group.
To unsubscribe from this group and stop receiving emails from it, send an email to telemetry+...@chromium.org.

[Ned]

Can you make sure that your checkout is after r484918?

[Takayoshi Kochi]

I think Ned's change went in 61.0.3152 and after.

(You can of course check with git log)

To unsubscribe from this group and stop receiving emails from it, send an email to telemetry+unsubscribe@chromium.org.

--

Takayoshi Kochi

[AJITHKUMAR VELUTHERI]

Thanks Ned and Kochi for your inputs. Tonight I will update my build and continue the test execution tomorrow and check for any improvement in local execution.

 

Best Regards,

Ajith

 

--------- Original Message ---------

Sender : Takayoshi Kochi <ko...@chromium.org>

Date : 2017-07-12 16:03 (GMT+5:30)

Title : Re: Re: Regarding Executing Performance Tests Locally

To : AJITH KUMAR V<aji...@samsung.com>

CC : null<nedn...@google.com>, null<tele...@chromium.org>, null<chan...@chromium.org>

--

Takayoshi Kochi