Regarding Telemetry test running on Android

275 views
Skip to first unread message

AJITH KUMAR V

unread,
Jul 19, 2017, 11:01:53 AM7/19/17
to tele...@chromium.org, ko...@chromium.org, chan...@chromium.org, RAGHAVENDRA GHATAGE

Hello Telemetry team,

 

I am trying to run telemetry performance benchmark for my patch @ https://chromium-review.googlesource.com/c/574514/ locally in an Android device (Samsung Galaxy S7 Edge, it's a rooted device with eng binary). I get following error, and is never succeeded. Could you please check and let me know, whether it's possible to run these tests in Android or not. I was able to run same test successfully on Linux build locally and able to measure the performance.

 

Command: ./tools/perf/run_benchmark -v --browser=android-chromium --output-format=html --pageset-repeat=2 --also-run-disabled-tests --story-filter=browse.social.facebook.infinite.scroll system_health.common_desktop

 

INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 wait-for-device
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 shell '( getprop service.adb.root );echo %$?'
INFO:devil.utils.timeout_retry:condition 'device_online_with_root' not met (29.2s)
CRITICAL:root:Timed out. Dumping threads.
ERROR:root:Failed with CommandTimeoutError while starting the browser backend.
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 shell '( ls /root );echo %$?'
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 shell '( su 0 ls /root && ! ls /root );echo %$?'
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 shell '( cd /sys/devices/system/cpu && for CPU in cpu0 cpu1 cpu2 cpu3 cpu4 cpu5 cpu6 cpu7; do test -e "${CPU}/cpufreq/scaling_available_governors" && grep -q ondemand ${CPU}/cpufreq/scaling_available_governors && test -e "$CPU/cpufreq/scaling_governor" && echo ondemand > "$CPU/cpufreq/scaling_governor"; echo -n "%~%$?%~%"; done );echo %$?'
WARNING:devil.android.perf.perf_control:Failed to set cpufreq/scaling_governor to 'ondemand' on any cpus
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 shell '( cd /sys/devices/system/cpu && for CPU in cpu0 cpu1 cpu2 cpu3 cpu4 cpu5 cpu6 cpu7; do cat "$CPU/online"; echo -n "%~%$?%~%"; done );echo %$?'
WARNING:devil.android.perf.perf_control:Unexpected cpu hot plugging detected.
ERROR:root:Failed with CommandTimeoutError while creating Android browser.
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 shell '( ps | grep -F org.chromium.chrome; echo "PIPESTATUS: ${PIPESTATUS[@]}" );echo %$?'
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 forward --remove tcp:47027
CRITICAL:root:(TimeoutThread-1-for-MainThread) Exception on _RunAdbCmd(<class 'devil.android.sdk.adb_wrapper.AdbWrapper'>, ['forward', '--remove', 'tcp:47027'], check_error=True, retries=2, device_serial=9885754d4343394647, timeout=30), attempt 1 of 3: AdbCommandFailedError('(device: 9885754d4343394647) adb forward --remove tcp:47027: failed with exit status 1 and output:\n- error: listener not found\n- error: listener not found\n',)
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 forward --remove tcp:47027
CRITICAL:root:(TimeoutThread-2-for-MainThread) Exception on _RunAdbCmd(<class 'devil.android.sdk.adb_wrapper.AdbWrapper'>, ['forward', '--remove', 'tcp:47027'], check_error=True, retries=2, device_serial=9885754d4343394647, timeout=30), attempt 2 of 3: AdbCommandFailedError('(device: 9885754d4343394647) adb forward --remove tcp:47027: failed with exit status 1 and output:\n- error: listener not found\n- error: listener not found\n',)
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 forward --remove tcp:47027
CRITICAL:root:Attempted to unforward port tcp:47027 but failed.
WARNING:root:Cannot dump browser state: No browser.
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 shell '( /system/bin/screencap -p /data/local/tmp/temp_file-ee735cddf10a3.png );echo %$?'
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 pull /data/local/tmp/temp_file-ee735cddf10a3.png /tmp/tmpvB6WwA.png
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 shell 'rm -f /data/local/tmp/temp_file-ee735cddf10a3.png'
Traceback (most recent call last):
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 97, in _RunStoryAndProcessErrorIfNeeded
    state.WillRunStory(story)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function
    return func(*args, **kwargs)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 230, in WillRunStory
    self._StartBrowser(page)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function
    return func(*args, **kwargs)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 189, in _StartBrowser
    self._browser = self._possible_browser.Create(self._finder_options)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome/android_browser_finder.py", line 132, in Create
    browser_backend, self._platform_backend, self._credentials_path)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/browser/browser.py", line 42, in __init__
    self._platform_backend.DidCreateBrowser(self, self._browser_backend)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/platform/platform_backend.py", line 99, in DidCreateBrowser
    self.SetFullPerformanceModeEnabled(browser_options.full_performance_mode)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/platform/android_platform_backend.py", line 203, in SetFullPerformanceModeEnabled
    self._perf_tests_setup.SetHighPerfMode()
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/android/perf/perf_control.py", line 42, in SetHighPerfMode
    self._device.EnableRoot()
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/android/decorators.py", line 57, in timeout_retry_wrapper
    retry_if_func=retry_if_func)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/utils/timeout_retry.py", line 159, in Run
    error_log_func=error_log_func)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/utils/reraiser_thread.py", line 186, in JoinAll
    self._JoinAll(watcher, timeout)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/utils/reraiser_thread.py", line 158, in _JoinAll
    thread.ReraiseIfException()
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/utils/reraiser_thread.py", line 81, in run
    self._ret = self._func(*self._args, **self._kwargs)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/utils/timeout_retry.py", line 152, in <lambda>
    child_thread = reraiser_thread.ReraiserThread(lambda: func(*args, **kwargs),
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/android/decorators.py", line 47, in impl
    return f(*args, **kwargs)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/android/device_utils.py", line 481, in EnableRoot
    timeout_retry.WaitFor(device_online_with_root, wait_period=1)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/utils/timeout_retry.py", line 113, in WaitFor
    msg='Timed out waiting for %r' % condition_name)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/utils/timeout_retry.py", line 56, in GetRemainingTime
    raise reraiser_thread.TimeoutError(msg)
CommandTimeoutError: Timed out waiting for 'device_online_with_root', wait of 1.0 secs required but only 0.8 secs left

INFO:root:Try printing formatted exception: None None None

Exception raised when cleaning story run:

Traceback (most recent call last):
  _RunStoryAndProcessErrorIfNeeded at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/story_runner.py:129
    test.DidRunStory(state.platform, results)
  DidRunStory at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/web_perf/timeline_based_measurement.py:310
    trace_result = platform.tracing_controller.StopTracing()
  StopTracing at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/core/tracing_controller.py:47
    return self._tracing_controller_backend.StopTracing()
  StopTracing at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py:109
    self._IssueClockSyncMarker()
  _IssueClockSyncMarker at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/platform/tracing_controller_backend.py:213
    self._RecordIssuerClockSyncMarker)
  RecordClockSyncMarker at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/platform/tracing_agent/chrome_tracing_agent.py:177
    raise ChromeClockSyncError('Cannot issue clock sync. No devtools clients')
ChromeClockSyncError: Cannot issue clock sync. No devtools clients

Locals:
  devtools_clients                             : []
  record_controller_clock_sync_marker_callback : <bound method TracingControllerBackend._RecordIssuerClockSyncMarker of <telemetry.internal.platform.tracing_controller_backend.TracingControllerBackend object at 0x7f3e36d0e850>>
  sync_id                                      : '18661d6f-15a6-4785-a46f-af425ca94f34'

[  FAILED  ] browse:social:facebook_infinite_scroll@{'case': 'browse', 'group': 'social'} (121573 ms)
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/forwarder_host --adb=/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb --serial-id=9885754d4343394647 --unmap 34722
INFO:root:rmtree is invoked with arguments: ('/tmp/tmpMLFZeI',) {}
INFO:root:Call site info:   File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/results/page_test_results.py", line 194, in PopulateHistogramSet
    vinn_result = convert_chart_json.ConvertChartJson(chart_json_path)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/tracing/tracing/value/convert_chart_json.py", line 24, in ConvertChartJson
    js_args=[os.path.abspath(chart_json)])
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/third_party/vinn/vinn/_vinn.py", line 188, in RunFile
    shutil.rmtree(temp_dir)

INFO:root:Try printing formatted exception: None None None

Traceback (most recent call last):
  RunBenchmark at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/story_runner.py:399
    expectations=expectations, metadata=benchmark.GetMetadata())
  Run at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/story_runner.py:262
    _RunStoryAndProcessErrorIfNeeded(story, results, state, test)
  _RunStoryAndProcessErrorIfNeeded at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/story_runner.py:97
    state.WillRunStory(story)
  traced_function at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py:75
    return func(*args, **kwargs)
  WillRunStory at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/page/shared_page_state.py:230
    self._StartBrowser(page)
  traced_function at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py:75
    return func(*args, **kwargs)
  _StartBrowser at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/page/shared_page_state.py:189
    self._browser = self._possible_browser.Create(self._finder_options)
  Create at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome/android_browser_finder.py:132
    browser_backend, self._platform_backend, self._credentials_path)
  __init__ at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/browser/browser.py:42
    self._platform_backend.DidCreateBrowser(self, self._browser_backend)
  DidCreateBrowser at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/platform/platform_backend.py:99
    self.SetFullPerformanceModeEnabled(browser_options.full_performance_mode)
  SetFullPerformanceModeEnabled at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/platform/android_platform_backend.py:203
    self._perf_tests_setup.SetHighPerfMode()
  SetHighPerfMode at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/android/perf/perf_control.py:42
    self._device.EnableRoot()
  timeout_retry_wrapper at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/android/decorators.py:57
    retry_if_func=retry_if_func)
  Run at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/utils/timeout_retry.py:159
    error_log_func=error_log_func)
  JoinAll at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/utils/reraiser_thread.py:186
    self._JoinAll(watcher, timeout)
  _JoinAll at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/utils/reraiser_thread.py:158
    thread.ReraiseIfException()
  run at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/utils/reraiser_thread.py:81
    self._ret = self._func(*self._args, **self._kwargs)
  <lambda> at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/utils/timeout_retry.py:152
    child_thread = reraiser_thread.ReraiserThread(lambda: func(*args, **kwargs),
  impl at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/android/decorators.py:47
    return f(*args, **kwargs)
  EnableRoot at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/android/device_utils.py:481
    timeout_retry.WaitFor(device_online_with_root, wait_period=1)
  WaitFor at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/utils/timeout_retry.py:113
    msg='Timed out waiting for %r' % condition_name)
  GetRemainingTime at /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/devil/utils/timeout_retry.py:56
    raise reraiser_thread.TimeoutError(msg)
CommandTimeoutError: Timed out waiting for 'device_online_with_root', wait of 1.0 secs required but only 0.8 secs left

Locals:
  msg       : "Timed out waiting for 'device_online_with_root', wait of 1.0 secs required but only 0.8 secs left"
  remaining : 0.808215856552124
  required  : 1

[  PASSED  ] 0 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ]  browse:social:facebook_infinite_scroll@{'case': 'browse', 'group': 'social'}

1 FAILED TEST

INFO:root:rmtree is invoked with arguments: ('/tmp/tmpDquyHj',) {}
INFO:root:Call site info:   File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/telemetry/telemetry/internal/results/html_output_formatter.py", line 41, in _ConvertChartJson
    vinn_result = convert_chart_json.ConvertChartJson(chart_json_path)
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/tracing/tracing/value/convert_chart_json.py", line 24, in ConvertChartJson
    js_args=[os.path.abspath(chart_json)])
  File "/home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/third_party/vinn/vinn/_vinn.py", line 188, in RunFile
    shutil.rmtree(temp_dir)

View result at file:///home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/tools/perf/results.html
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 shell '( rm -f /data/local/chrome-trace-config.json );echo %$?'
INFO:devil.utils.cmd_helper:[host]> /home/ajithk/EXTRA_HDD/ANDROID_BROWSER/OPEN_SOURCE_CHROME_PATCHES/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 9885754d4343394647 shell '( dumpsys battery );echo %$?'
WARNING:devil.android.battery_utils:Unknown line found in dumpsys battery: "BatteryInfoBackUp"
INFO:root:Charging status checked at exit.

 

Thanks & Regards,

Ajith

201602111742151_N3WZA6X7.png

Ned

unread,
Jul 19, 2017, 11:07:43 AM7/19/17
to aji...@samsung.com, tele...@chromium.org, rne...@google.com, ko...@chromium.org, chan...@chromium.org, RAGHAVENDRA GHATAGE
We currently don't support "Samsung Galaxy S7 Edge" device. Our currently supported devices are: Android One, Nexus 5, Nexus 5X.

+Randy Nephew we probably should also bail out early if the Android device type is not in our support.

--
You received this message because you are subscribed to the Google Groups "telemetry" group.
To unsubscribe from this group and stop receiving emails from it, send an email to telemetry+...@chromium.org.

Timothy Dresser

unread,
Jul 19, 2017, 11:12:14 AM7/19/17
to Ned, aji...@samsung.com, tele...@chromium.org, rne...@google.com, ko...@chromium.org, chan...@chromium.org, RAGHAVENDRA GHATAGE
I'm confused by the list of devices there. Don't we also have Nexus 6, 7 and 9 on the waterfall?

We used to support arbitrary devices, correct? I've also run into issues being unable to run telemetry tests on non-Nexus devices.

How much additional effort was it to keep telemetry working on a broader set of devices?

Tim

AJITH KUMAR V

unread,
Jul 19, 2017, 11:13:52 AM7/19/17
to Ned, AJITH KUMAR V, tele...@chromium.org, rne...@google.com, ko...@chromium.org, chan...@chromium.org, RAGHAVENDRA GHATAGE

Hello Ned,

 

Thank you for the initial information.

 

For running the tests on any of (Android One, Nexus 5, Nexus 5X) devices, do we need to root the device ?

or

on a commercial device (user binary device, say Google Pixel), will it work by doing some additional changes ?

 

Can you brief out other criteria required from an Android device for running the tests ?

 

Thanks & Regards,

Ajith

 

--------- Original Message ---------

Sender : Ned <nedn...@google.com>

Date : 2017-07-19 20:37 (GMT+5:30)

Title : Re: Regarding Telemetry test running on Android

To : AJITH KUMAR V<aji...@samsung.com>, null<tele...@chromium.org>, null<rne...@google.com>

CC : null<ko...@chromium.org>, null<chan...@chromium.org>, RAGHAVENDRA GHATAGE<r.gh...@samsung.com>

--
You received this message because you are subscribed to the Google Groups "telemetry" group.
To unsubscribe from this group and stop receiving emails from it, send an email to telemetry+...@chromium.org.

201602111742151_N3WZA6X7.png

Ned

unread,
Jul 19, 2017, 11:18:32 AM7/19/17
to Timothy Dresser, aji...@samsung.com, tele...@chromium.org, rne...@google.com, ko...@chromium.org, chan...@chromium.org, RAGHAVENDRA GHATAGE
On Wed, Jul 19, 2017 at 8:12 AM Timothy Dresser <tdre...@chromium.org> wrote:
I'm confused by the list of devices there. Don't we also have Nexus 6, 7 and 9 on the waterfall?

Yes, my list there is not comprehensive. But any device on the perf waterfall is supported.  

We used to support arbitrary devices, correct? I've also run into issues being unable to run telemetry tests on non-Nexus devices.

How much additional effort was it to keep telemetry working on a broader set of devices?

If a particular device is not tested in integration testing, I have zero confident that Telemetry will work there. 

Adding automated test coverage for broader set of devices is lots of work, and we already struggle keeping the waterfall green with our current portfolio of devices crosses different version of Android OSes.

Ned

unread,
Jul 19, 2017, 11:22:50 AM7/19/17
to aji...@samsung.com, tele...@chromium.org, rne...@google.com, ko...@chromium.org, chan...@chromium.org, RAGHAVENDRA GHATAGE
On Wed, Jul 19, 2017 at 8:13 AM AJITH KUMAR V <aji...@samsung.com> wrote:

Hello Ned,

 

Thank you for the initial information.

 

For running the tests on any of (Android One, Nexus 5, Nexus 5X) devices, do we need to root the device ?


or

on a commercial device (user binary device, say Google Pixel), will it work by doing some additional changes ?


Possibly. But without continuous testing, there is no guarantee that those additional changes won't be rotted.  My impression is any thing that is not continuously tested in Telemetry rot very rapidly given the complexity of the project. 

 

Can you brief out other criteria required from an Android device for running the tests ?


Device is rooted & is listed in https://build.chromium.org/p/chromium.perf/waterfall   

201602111742151_N3WZA6X7.png

--
You received this message because you are subscribed to the Google Groups "telemetry" group.
To unsubscribe from this group and stop receiving emails from it, send an email to telemetry+...@chromium.org.

201602111742151_N3WZA6X7.png

Randy Nephew

unread,
Jul 19, 2017, 1:14:12 PM7/19/17
to Ned, aji...@samsung.com, tele...@chromium.org, ko...@chromium.org, chan...@chromium.org, RAGHAVENDRA GHATAGE
I can certainly add a check that checks if the device is one of the types on the waterfall, but I dont know if we want to strictly stop the user from using rooted devices not on the waterfall. I know flags are considered dangerous, but it might be useful to add one that can override the device type requirement for local testing for when new device types come out. We could also send them a sternly written warning that requires user input to continue if it is not an officially supported device type? I'm also not against just not letting it run on unsupported devices to avoid adding a new flag or bothering the user with requiring their input to continue, I just want to make sure we think it through and make the correct decision.

--
To unsubscribe from this group and stop receiving emails from it, send an email to telemetry+unsubscribe@chromium.org.

201602111742151_N3WZA6X7.png


ying chen

unread,
Jan 21, 2020, 4:56:16 AM1/21/20
to telemetry, nedn...@google.com, aji...@samsung.com, ko...@chromium.org, chan...@chromium.org, r.gh...@samsung.com, rne...@google.com
I wonder if there is any update on this thread. I want to run testing locally, however, my rooted deivce is not on the list.

Or if you can give some indication on howto work around. Thanks.

/chromium_b79/src$ tools/perf/run_benchmark list 
(INFO) 2020-01-22 17:43:25,055 timeout_retry.WaitFor:105  condition '<lambda>' met
(INFO) 2020-01-22 17:43:26,391 timeout_retry.WaitFor:105  condition 'device_online_with_root' not met (0.2s)


在 2017年7月20日星期四 UTC+8上午1:14:12,Randy Nephew写道:
--
To unsubscribe from this group and stop receiving emails from it, send an email to tele...@chromium.org.

201602111742151_N3WZA6X7.png


Reply all
Reply to author
Forward
0 new messages