Problem running Telemetry

[Menglin Liu]

Hello,

I'm a noogler. This is my first time to run telemetry.

I get the following error if I run 

run_benchmark --browser=android-jb-system-chrome octane

If I run it with --use-live-sites, the test passes.

Did I miss any basic setups? Thank you in advance!

Menglin

run_benchmark --browser=android-jb-system-chrome octane

[ RUN      ] http://octane-benchmark.googlecode.com/svn/latest/index.html?auto=1

78 KB/s (3383 bytes in 0.041s)

Traceback (most recent call last):

  File "./../telemetry/telemetry/user_story/user_story_runner.py", line 82, in _RunUserStoryAndProcessErrorIfNeeded

    state.WillRunUserStory(user_story)

  File "./../telemetry/telemetry/page/shared_page_state.py", line 148, in WillRunUserStory

    self.browser = self._possible_browser.Create(self._finder_options)

  File "./../telemetry/telemetry/core/backends/chrome/android_browser_finder.py", line 117, in Create

    browser_backend, self._platform_backend, self._credentials_path)

  File "./../telemetry/telemetry/core/browser.py", line 40, in __init__

    self._platform_backend.DidCreateBrowser(self, self._browser_backend)

  File "./../telemetry/telemetry/core/platform/platform_backend.py", line 127, in DidCreateBrowser

    self._network_controller_backend.UpdateReplay(browser_backend)

  File "./../telemetry/telemetry/core/platform/network_controller_backend.py", line 138, in UpdateReplay

    _ForwarderPortPairs(started_ports, wpr_port_pairs))

  File "./../telemetry/telemetry/core/forwarders/android_forwarder.py", line 40, in Create

    return AndroidForwarder(self._adb, port_pairs)

  File "./../telemetry/telemetry/core/forwarders/android_forwarder.py", line 59, in __init__

    for p in port_pairs if p], self._device)

  File "/usr/local/google/code/clankium2/src/build/android/pylib/forwarder.py", line 83, in Map

    instance._InitDeviceLocked(device, tool)

  File "/usr/local/google/code/clankium2/src/build/android/pylib/forwarder.py", line 289, in _InitDeviceLocked

    Forwarder._DEVICE_FORWARDER_FOLDER)])

  File "/usr/local/google/code/clankium2/src/build/android/pylib/device/decorators.py", line 57, in TimeoutRetryWrapper

    return timeout_retry.Run(impl, timeout, retries)

  File "/usr/local/google/code/clankium2/src/build/android/pylib/utils/timeout_retry.py", line 161, in Run

    thread_group.JoinAll(child_thread.GetWatcher())

  File "/usr/local/google/code/clankium2/src/build/android/pylib/utils/reraiser_thread.py", line 143, in JoinAll

    self._JoinAll(watcher)

  File "/usr/local/google/code/clankium2/src/build/android/pylib/utils/reraiser_thread.py", line 130, in _JoinAll

    thread.ReraiseIfException()

  File "/usr/local/google/code/clankium2/src/build/android/pylib/utils/reraiser_thread.py", line 76, in run

    self._ret = self._func(*self._args, **self._kwargs)

  File "/usr/local/google/code/clankium2/src/build/android/pylib/utils/timeout_retry.py", line 150, in RunOnTimeoutThread

    ret[0] = func(*args, **kwargs)

  File "/usr/local/google/code/clankium2/src/build/android/pylib/device/decorators.py", line 51, in impl

    return f(*args, **kwargs)

  File "/usr/local/google/code/clankium2/src/build/android/pylib/device/device_utils.py", line 776, in PushChangedFiles

    files += self._GetChangedFilesImpl(h, d)

  File "/usr/local/google/code/clankium2/src/build/android/pylib/device/device_utils.py", line 821, in _GetChangedFilesImpl

    host_hash_tuples = md5sum.CalculateHostMd5Sums([real_host_path])

  File "/usr/local/google/code/clankium2/src/build/android/pylib/utils/md5sum.py", line 38, in CalculateHostMd5Sums

    [p for p in paths])

  File "/usr/local/google/code/clankium2/src/build/android/pylib/cmd_helper.py", line 114, in GetCmdOutput

    (_, output) = GetCmdStatusAndOutput(args, cwd, shell)

  File "/usr/local/google/code/clankium2/src/build/android/pylib/cmd_helper.py", line 150, in GetCmdStatusAndOutput

    shell=shell, cwd=cwd)

  File "/usr/local/google/code/clankium2/src/build/android/pylib/cmd_helper.py", line 74, in Popen

    preexec_fn=lambda: signal.signal(signal.SIGPIPE, signal.SIG_DFL))

  File "/usr/lib/python2.7/subprocess.py", line 710, in __init__

    errread, errwrite)

  File "/usr/lib/python2.7/subprocess.py", line 1327, in _execute_child

    raise child_exception

OSError: [Errno 2] No such file or directory

[  FAILED  ] http://octane-benchmark.googlecode.com/svn/latest/index.html?auto=1 (3561 ms)

Traceback (most recent call last):

  Run at tools/telemetry/telemetry/benchmark.py:202

    max_failures=self._max_failures)

  Run at tools/telemetry/telemetry/user_story/user_story_runner.py:221

    expectations, user_story, results, state)

  _RunUserStoryAndProcessErrorIfNeeded at tools/telemetry/telemetry/user_story/user_story_runner.py:82

    state.WillRunUserStory(user_story)

  WillRunUserStory at tools/telemetry/telemetry/page/shared_page_state.py:148

    self.browser = self._possible_browser.Create(self._finder_options)

  Create at tools/telemetry/telemetry/core/backends/chrome/android_browser_finder.py:117

    browser_backend, self._platform_backend, self._credentials_path)

  __init__ at tools/telemetry/telemetry/core/browser.py:40

    self._platform_backend.DidCreateBrowser(self, self._browser_backend)

  DidCreateBrowser at tools/telemetry/telemetry/core/platform/platform_backend.py:127

    self._network_controller_backend.UpdateReplay(browser_backend)

  UpdateReplay at tools/telemetry/telemetry/core/platform/network_controller_backend.py:138

    _ForwarderPortPairs(started_ports, wpr_port_pairs))

  Create at tools/telemetry/telemetry/core/forwarders/android_forwarder.py:40

    return AndroidForwarder(self._adb, port_pairs)

  __init__ at tools/telemetry/telemetry/core/forwarders/android_forwarder.py:59

    for p in port_pairs if p], self._device)

  Map at build/android/pylib/forwarder.py:83

    instance._InitDeviceLocked(device, tool)

  _InitDeviceLocked at build/android/pylib/forwarder.py:289

    Forwarder._DEVICE_FORWARDER_FOLDER)])

  TimeoutRetryWrapper at build/android/pylib/device/decorators.py:57

    return timeout_retry.Run(impl, timeout, retries)

  Run at build/android/pylib/utils/timeout_retry.py:161

    thread_group.JoinAll(child_thread.GetWatcher())

  JoinAll at build/android/pylib/utils/reraiser_thread.py:143

    self._JoinAll(watcher)

  _JoinAll at build/android/pylib/utils/reraiser_thread.py:130

    thread.ReraiseIfException()

  run at build/android/pylib/utils/reraiser_thread.py:76

    self._ret = self._func(*self._args, **self._kwargs)

  RunOnTimeoutThread at build/android/pylib/utils/timeout_retry.py:150

    ret[0] = func(*args, **kwargs)

  impl at build/android/pylib/device/decorators.py:51

    return f(*args, **kwargs)

  PushChangedFiles at build/android/pylib/device/device_utils.py:776

    files += self._GetChangedFilesImpl(h, d)

  _GetChangedFilesImpl at build/android/pylib/device/device_utils.py:821

    host_hash_tuples = md5sum.CalculateHostMd5Sums([real_host_path])

  CalculateHostMd5Sums at build/android/pylib/utils/md5sum.py:38

    [p for p in paths])

  GetCmdOutput at build/android/pylib/cmd_helper.py:114

    (_, output) = GetCmdStatusAndOutput(args, cwd, shell)

  GetCmdStatusAndOutput at build/android/pylib/cmd_helper.py:150

    shell=shell, cwd=cwd)

  Popen at build/android/pylib/cmd_helper.py:74

    preexec_fn=lambda: signal.signal(signal.SIGPIPE, signal.SIG_DFL))

  __init__ at /usr/lib/python2.7/subprocess.py:710

    errread, errwrite)

  _execute_child at /usr/lib/python2.7/subprocess.py:1327

    raise child_exception

OSError: [Errno 2] No such file or directory

Locals:

  _close_in_parent   : <function _close_in_parent at 0x7f6701ed9320>

  args               : ['/usr/local/google/code/clankium2/src/out/Release/md5sum_bin_host', '/usr/local/google/code/clankium2/src/out/Release/forwarder_dist']

  c2pread            : 5

  c2pwrite           : 6

  child_exception    : OSError(2, 'No such file or directory')

  close_fds          : True

  creationflags      : 0

  cwd                : None

  data               : 'cexceptions\nOSError\np0\n(I2\nS\'No such file or directory\'\np1\ntp2\nRp3\n(dp4\nS\'child_traceback\'\np5\nS\'Traceback (most recent call last):\\n  File "/usr/lib/python2.7/subprocess.py", line 1282, in _execute_child\\n    os.execvp(executable, args)\\n  File "/usr/lib/python2.7/os.py", line 344, in execvp\\n    _execvpe(file, args)\\n  File "/usr/lib/python2.7/os.py", line 368, in _execvpe\\n    func(file, *argrest)\\nOSError: [Errno 2] No such file or directory\\n\'\np6\nsb.'

  env                : None

  errpipe_read       : 9

  errpipe_write      : 10

  errread            : 7

  errwrite           : 8

  executable         : '/usr/local/google/code/clankium2/src/out/Release/md5sum_bin_host'

  gc_was_enabled     : True

  p2cread            : None

  p2cwrite           : None

  preexec_fn         : <function <lambda> at 0x7f6701ed92a8>

  shell              : False

  startupinfo        : None

  to_close           : set([5, 7])

  universal_newlines : False

[  PASSED  ] 0 tests.

[  FAILED  ] 1 test, listed below:

[  FAILED  ]  http://octane-benchmark.googlecode.com/svn/latest/index.html?auto=1

1 FAILED TEST

Pages: []

RESULT telemetry_page_measurement_results: num_failed= 1 count

RESULT telemetry_page_measurement_results: num_errored= 0 count

Pages: []

View result at file:///usr/local/google/code/clankium2/src/tools/perf/results.html

[Ethan Kuefner]

Hi Menglin,

Try following the directions here: http://www.chromium.org/developers/telemetry#TOC-I-get-an-error-when-I-try-to-use-recorded-page-sets. and see if that fixes the problem. If gsutil asks for a project id you can enter 0.

[Ethan Kuefner]

Try just clearing your boto files by using rm -f ~/.boto ~/.boto.bak and giving gsutil config another go. Also, make sure you're logged in as your @google.com user when you try getting the confirmation code.

On Tue, Apr 14, 2015 at 10:49 AM, Menglin Liu <ml...@google.com> wrote:

Hi Ethan,

Thanks for your reply!

I've ran gsutil config to authenticate and copy the generated code from the page. It didn't ask me the project-id though. The test still failed. 

I just tried to do gsutil config again after receiving your email. It says "CommandException: Cannot back up existing config file "/usr/local/google/home/mlliu/.boto": backup file exists ("/usr/local/google/home/mlliu/.boto.bak")."

Thanks

Menglin

[Menglin Liu]

I tried again but the same error, now both with and without --use-live-sites. This time it asked for the project-id though. I wonder if it's because the code that I checkout. I followed the steps from checking out clank code. I've done all the steps (sync, post-sync) till Building Clank. 

Then I ran src/tools/perf/run_benchmark --browser=android-jb-system-chrome octane

Thank you

Menglin

[Ethan Kuefner]

So, looking through the stack trace you posted, I see now that it's looking for /usr/local/google/code/clankium2/src/out/Release/md5sum_bin_host, which is a binary that I assume needs to be built.

Try building first, and then running Telemetry again.

[Dave Tu]

Hi Menglin,

Telemetry should download md5sum_bin_host automatically from Cloud Storage - you don't need to build it. We can debug why it isn't being downloaded to out/Release. For starters, what Android device are you trying to run on? Is there a message in the output similar to, "Unknown architecture type: foo"?

Dave 2

[Menglin Liu]

Hi Dave,

I tried building first. Now the test passes with "run_benchmark --browser=android-jb-system-chrome octane"

I'm using a nexus5. I don't see a "Unknown architecture type:foo" kind of message in the output.

Thanks

Menglin