stephendonner

stephendonner-7hlvdq:mozilla-unified sdonner$ ./mach browsertime --setup --clobber
 0:00.66 Using artifact from local cache: /Users/sdonner/.mozbuild/cache/browsertime/6d3750376ed79919-ImageMagick-x86_64-apple-darwin17.7.0.tar.gz
 0:00.66 Unpacking temporary location /Users/sdonner/.mozbuild/cache/browsertime/6d3750376ed79919-ImageMagick-x86_64-apple-darwin17.7.0.tar.gz
 0:01.46 Using artifact from local cache: /Users/sdonner/.mozbuild/cache/browsertime/ac79da076f1ab59d-ffmpeg-4.1.1-macos64-static.zip
 0:01.46 Unpacking temporary location /Users/sdonner/.mozbuild/cache/browsertime/ac79da076f1ab59d-ffmpeg-4.1.1-macos64-static.zip
 0:02.84 Installing browsertime node module from /Users/sdonner/mozilla-source/mozilla-unified/tools/browsertime/package.json
Clobbering /Users/sdonner/mozilla-source/mozilla-unified/tools/browsertime/node_modules...
Installing browsertime for mach using "/Users/sdonner/.mozbuild/node/bin/node /Users/sdonner/.mozbuild/node/bin/npm install --loglevel=error"...
info sharp Using cached /

stephendonner

diff --git a/testing/raptor/raptor/raptor.py b/testing/raptor/raptor/raptor.py
--- a/testing/raptor/raptor/raptor.py
+++ b/testing/raptor/raptor/raptor.py
@@ -190,7 +190,7 @@ either Raptor or browsertime."""
         LOG.info("Making temp_download_dir from inside get_conditioned_profile {}"
                  .format(temp_download_dir))
         platform = get_current_platform()
-        cond_prof_target_dir = get_profile(temp_download_dir, platform, "cold")
+        cond_prof_target_dir = get_profile(temp_download_dir, platform, "settled")
         LOG.info("temp_download_dir is: {}".format(temp_download_dir))

stephendonner

stephendonner-7hlvdq:mozilla-unified sdonner$ moz-phab patch D55786
Patching revision: D55786
Checked out 3dc70a33491f
Bookmark set to D55786
D55786 applied
stephendonner-7hlvdq:mozilla-unified sdonner$ ./mach raptor -t raptor-tp6-1-cold --with-conditioned-profile --post-startup-delay 2 --browser-cycles 2
Updating external benchmarks from https://github.com/mozilla/perf-automation
Cloning the benchmarks to /Users/sdonner/.mozbuild/performance-tests
Switched to branch 'master'
Your branch is up to date with 'origin/master'.

stephendonner

stephendonner-7hlvdq:mozilla-unified sdonner$ hg diff
diff --git a/testing/raptor/raptor/raptor.py b/testing/raptor/raptor/raptor.py
--- a/testing/raptor/raptor/raptor.py
+++ b/testing/raptor/raptor/raptor.py
@@ -190,7 +190,7 @@ either Raptor or browsertime."""
         LOG.info("Making temp_download_dir from inside get_conditioned_profile {}"
                  .format(temp_download_dir))
         platform = get_current_platform()

stephendonner

00:06:18     INFO -  [2019-12-04 16:06:18] INFO: [browsertime.command.measure] Testing url https://www.facebook.com iteration 2
00:06:18     INFO -  console.timeStamp: "t_start"
00:06:19     INFO -  console.timeStamp: "t_domcontent"
00:06:19     INFO -  console.timeStamp: "t_tti"
00:06:19     INFO -  console.error: "ErrorUtils caught an error: \"Tried to listen to element of type click from Error: Cannot listen to an unde...\". Subsequent errors won't be logged; see https://fburl.com/debugjs."
00:06:19     INFO -  console.timeStamp: "t_prehooks"
00:06:19     INFO -  console.timeStamp: "t_hooks"
00:06:19     INFO -  console.log: "\n\n\n                                            \n .d8888b.  888                       888    \nd88P  Y88b 888                       888    \nY88b.      888                       888    This is a browser feature intended for \n \"Y888b.   888888  .d88b.  88888b.   888    developers. If someone told you to copy-paste \n    \"Y88b. 888    d88\"\"88b 888 \"88b  888    something here to

stephendonner

stephendonner-7hlvdq:mozilla-unified sdonner$ ./mach python-test -v --python 2 --subsuite raptor
Processing ./third_party/python/certifi
  Requirement already satisfied (use --upgrade to upgrade): certifi==2018.4.16 from file:///Users/sdonner/mozilla-source/mozilla-unified/third_party/python/certifi in ./testing/web-platform/tests/tools/third_party/certifi
Processing ./third_party/python/pipenv
Installing collected packages: pipenv
  Running setup.py install for pipenv ... done
Successfully installed pipenv-2018.5.18
Processing ./third_party/python/six
Installing collected packages: six
  Running setup.py install for six ... done

stephendonner

stephendonner-7hlvdq:raptor-studio sdonner$ pipenv run python studio.py --app Firefox --proxy mitm4 --record --sites desktop-sites.json
Starting record mode!!!
Parsing sites json
Starting MitmProxy
/Users/sdonner/raptor-studio/proxy/utils/mitm4.0.4/mitmdump-osx --save-stream-file Recordings/mitm4-darwin-firefox-google-search/mitm4-darwin-firefox-google-search.mp --set websocket=false --scripts /Users/sdonner/raptor-studio/proxy/scripts/inject_deterministic.py --scripts /Users/sdonner/raptor-studio/proxy/scripts/http_protocol_extractor.py
Recording https://www.google.com/search?hl=en&q=barack+obama&cad=h...
Do user input and press <Return>

stephendonner

17:31:50     INFO -  raptor-mitmproxy Info: mozproxy_dir used for mitmproxy downloads and exe files: /Users/sdonner/mozilla-source/mozilla-unified/obj-x86_64-apple-darwin19.2.0/testing/mozproxy
17:31:50     INFO -  raptor-mitmproxy Info: mitmproxy binary already exists. Skipping download
17:31:50     INFO -  raptor-mitmproxy Info: downloading mitmproxy pageset
17:31:50     INFO -  raptor-mitmproxy Info: INFO - unzipping "mitm4-pixel2-fennec-amazon.zip"
17:31:50     INFO -  raptor-mitmproxy Info: mitmdump path: /Users/sdonner/mozilla-source/mozilla-unified/obj-x86_64-apple-darwin19.2.0/testing/mozproxy/mitmdump-4.0.4/mitmdump
17:31:50     INFO -  raptor-mitmproxy Info: browser path: org.mozilla.geckoview_example
17:31:50     INFO -  raptor-mitmproxy Info: Starting mitmproxy playback using env path: :/Users/sdonner/mozilla-source/mozilla-unified/obj-x86_64-apple-darwin19.2.0/testing/raptor-venv/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Applications/VMware Fusion.app/Contents/Public:/Applications/Wiresha

stephendonner

[task 2019-11-26T23:21:01.413Z] 23:21:01     INFO -  Getting https://index.taskcluster.net/v1/task/gecko.v2.try.latest.firefox.condprof-win32/artifacts/public/condprof/profile-win32-cold-default.tgz
[task 2019-11-26T23:21:01.472Z] 23:21:01    ERROR -  Traceback (most recent call last):
[task 2019-11-26T23:21:01.472Z] 23:21:01     INFO -    File "C:\tasks\task_1574807689\build\tests\raptor\raptor\raptor.py", line 1811, in <module>
[task 2019-11-26T23:21:01.472Z] 23:21:01     INFO -      main()
[task 2019-11-26T23:21:01.472Z] 23:21:01     INFO -    File "C:\tasks\task_1574807689\build\tests\raptor\raptor\raptor.py", line 1776, in main
[task 2019-11-26T23:21:01.473Z] 23:21:01     INFO -      with_conditioned_profile=args.with_conditioned_profile,
[task 2019-11-26T23:21:01.473Z] 23:21:01     INFO -    File "C:\tasks\task_1574807689\build\tests\raptor\raptor\raptor.py", line 1753, in raptor_class
[task 2019-11-26T23:21:01.473Z] 23:21:01     INFO -      return klass(*inner_args, **inner_kwargs)
[task 2019-11-26T23:

stephendonner

From reading code, I see:

• platform is set like so: https://searchfox.org/mozilla-central/rev/652014ca1183c56bc5f04daf01af180d4e50a91c/testing/condprofile/condprof/runner.py#121

Android profile paths: https://searchfox.org/mozilla-central/rev/0678172d5b5c681061b904c776b668489e3355b0/testing/raptor/raptor/raptor.py#1302-1303 self.remote_test_root self.remote_profile

we push the latter in copy_profile_to_device, here: https://searchfox.org/mozilla-central/rev/0678172d5b5c681061b904c776b668489e3355b0/testing/raptor/raptor/raptor.py#1368