Wed Jul 17 2024 21:56:33 PDT
  • Keywords: pi-marionette-runner

138 bugs found.
ID Type Summary Product Comp Assignee Status Resolution Updated
960436 add a register_exception_handler function to base.py Testing Marionette Client an nobody NEW --- 2023-02-10
993100 Harness should output *something* if a manifest file isn't going to be run Testing Marionette Client an nobody NEW --- 2023-02-10
1142064 BaseMarionetteArguments.verify_usage() should call all registered verify_usage_handlers first Testing Marionette Client an nobody NEW --- 2023-02-10
1135267 No option to use --symbols-path with ./mach marionette-test Testing Marionette Client an nobody REOP --- 2023-02-10
1050511 marionette-test mach target is broken Remote Protocol Marionette chmanchester RESO FIXE 2023-02-09
994176 Create branched versions of marionette-client and consumer packages Remote Protocol Marionette dave.hunt RESO FIXE 2023-02-09
967318 ScriptTimeoutExceptions should be reported with the failure on the same line as the test name Remote Protocol Marionette dburns RESO FIXE 2023-02-09
1222388 ./mach marionette-test fails due to "ImportError: cannot import name startTestRunner" Remote Protocol Marionette dburns RESO FIXE 2023-02-09
1030442 Need way to set prefs that get read at browser startup Remote Protocol Marionette malini RESO FIXE 2023-02-09
1210874 [meta] [15Q4] Refactor the Marionette Test Runner to make it easier to use for future end-to-end test suites Remote Protocol Marionette mjzffr RESO FIXE 2023-02-09
1223429 Return exit code 10 when Marionette harness has failing tests Remote Protocol Marionette mjzffr RESO FIXE 2023-02-09
1121139 Allow data transfer between runner and MarionetteTestCase Remote Protocol Marionette nobody RESO WONT 2023-02-09
1127399 Crashes in the Windows Marionette harness don't generate stacks Remote Protocol Marionette nobody RESO FIXE 2023-02-09
1280048 Firefox 47 crash with new marionette driver Remote Protocol Marionette nobody RESO WONT 2023-02-09
970886 MarionetteTestRunner runs tests twice if the filename is the same Remote Protocol Marionette j.parkouss RESO FIXE 2023-02-09
1025125 If enabled, enter pdb session when test fails Remote Protocol Marionette j.parkouss RESO FIXE 2023-02-09
940911 [MTBF][Marionette] Marionette getcrashreport() Remote Protocol Marionette nobody RESO WONT 2023-02-09
965256 Make desktopb2g socket.timeout error messages more useful Remote Protocol Marionette nobody RESO DUPL 2023-02-09
1099127 Marionette needs support for inside application triggered restarts and shutdowns Remote Protocol Marionette nobody RESO WORK 2023-02-09
960438 BaseMarionetteTestRunner should be able to have some customizable setup code Remote Protocol Marionette malini RESO WONT 2023-02-09
873583 [meta] [Tracking bug] Improve error messages in the marionette test runner Remote Protocol Marionette nobody RESO FIXE 2023-02-09
901832 Provide a command line option to output a manifest of test failures Remote Protocol Marionette nobody RESO WONT 2023-02-09
938982 Stop function in marionette test runner Remote Protocol Marionette nobody RESO WONT 2023-02-09
943868 Allow test metadata to be included in the manifest and available in the test result objects Remote Protocol Marionette nobody RESO INAC 2023-02-09
945798 Log emulator's output to terminal when running Marionette test Remote Protocol Marionette nobody RESO INVA 2023-02-09
967566 Refactor CommonTestCase.run Remote Protocol Marionette nobody RESO WONT 2023-02-09
968055 run_tests in BaseMarionetteTestRunner should expand test suite/manifest Remote Protocol Marionette nobody RESO WONT 2023-02-09
974156 Abort Marionette testrun if we get more than 4 connection timeouts (in a row?) Remote Protocol Marionette nobody RESO WONT 2023-02-09
974471 Expected failures in setUp/tearDown are counted as errors Remote Protocol Marionette nobody RESO WONT 2023-02-09
1082686 Refactor marionette runner's option handling Remote Protocol Marionette nobody RESO WONT 2023-02-09
1083237 Wrong test suite duration when using mozlog as test reporter Remote Protocol Marionette nobody RESO WONT 2023-02-09
1107983 Update MarionetteTestRunner to locate mozinfo.json and import into runner framework Remote Protocol Marionette nobody RESO DUPL 2023-02-09
1129493 Add file path to Marionette's test_start and test_end structured logs Remote Protocol Marionette nobody RESO DUPL 2023-02-09
1166431 Create distinct log files for each call to BaseMarionetteTestRunner.run_tests Remote Protocol Marionette nobody RESO WONT 2023-02-09
1275013 Improve failure message in case of early start-up crashes of the application Remote Protocol Marionette nobody RESO DUPL 2023-02-09
1294447 Android emulator doesn't launch with ./mach marionette-test Remote Protocol Marionette nobody RESO WONT 2023-02-09
1297364 A socket error in tearDown should also cause a test failure Remote Protocol Marionette nobody RESO DUPL 2023-02-09
956297 runtests.py does not expand paths given from command line Remote Protocol Marionette nobody RESO INVA 2023-02-09
1005004 Make default address localhost:2828 Remote Protocol Marionette nobody RESO INCO 2023-02-09
980932 Add option to stop the test run after N number of failures Remote Protocol Marionette nobody RESO INAC 2023-02-09
1039752 Marionette should support bisection ability Remote Protocol Marionette nobody RESO INAC 2023-02-09
1213013 Add ability to produce memory reports Remote Protocol Marionette nobody RESO WONT 2023-02-09
1377529 Move e10s checks and logging to proper places to avoid an extra restart of Firefox Testing Marionette Client an nobody RESO INVA 2023-02-10
1104742 Stopping Marionette with Ctrl-C does not quit the application Remote Protocol Marionette ahal RESO FIXE 2023-02-09
1258505 BaseMarionetteArguments does not cooperate with mach Remote Protocol Marionette anjanavakil RESO FIXE 2023-02-09
1275269 [refactor] Test BaseMarionetteTestRunner.run_tests Remote Protocol Marionette anjanavakil RESO FIXE 2023-02-09
1284238 Test that manifest.active_tests is called with appropriate arguments Remote Protocol Marionette anjanavakil RESO FIXE 2023-02-09
1284847 Test that driver_class is called with appropriate arguments Remote Protocol Marionette anjanavakil RESO FIXE 2023-02-09
1155260 Unable to specify base URL for HTTP content since bug 941085 Remote Protocol Marionette ato RESO FIXE 2023-02-09
1205687 Add support for Marionette tests to `mach test` target Testing General ato RESO FIXE 2016-01-23
1221187 Support changing logging level for Marionette Remote Protocol Marionette ato RESO FIXE 2023-02-09
1239987 Merge marionette-transport back into marionette-driver Testing Marionette Client an ato RESO FIXE 2023-02-10
1240576 Use Preferences.jsm module over Services.pref Testing Marionette Client an ato RESO FIXE 2023-02-10
1246407 Rename driver and client directories Testing Marionette Client an ato RESO FIXE 2023-02-10
1025838 Add "version" prefix to version number in HTML report Remote Protocol Marionette botalov.andrey RESO FIXE 2023-02-09
1028407 Try to make marionette connect to browser sessions quicker Remote Protocol Marionette chmanchester RESO FIXE 2023-02-09
1083131 Marionette does not always remove temporary profiles Remote Protocol Marionette chmanchester RESO FIXE 2023-02-09
1100124 Add --jsdebugger flag to mach marionette-test Remote Protocol Marionette chmanchester RESO FIXE 2023-02-09
1108714 skip_if_b2g skips desktop tests Remote Protocol Marionette chmanchester RESO FIXE 2023-02-09
1120630 Turn on Mn-e10s Remote Protocol Marionette chmanchester RESO FIXE 2023-02-09
1121666 ./mach marionette-test --jsdebugger doesn't work with e10s Remote Protocol Marionette chmanchester RESO FIXE 2023-02-09
1007592 When running against a running desktopb2g instance, the test runner tries to connect to device in tearDown Remote Protocol Marionette dave.hunt RESO FIXE 2023-02-09
1049717 Expose suite start and end times in the BaseMarionetteTestRunner Remote Protocol Marionette dave.hunt RESO FIXE 2023-02-09
1118697 Allow server root to be a base URL to an existing webserver Remote Protocol Marionette dave.hunt RESO FIXE 2023-02-09
1006511 Marionette timeouts shouldn't print the ScriptTimeoutException traceback to the log Remote Protocol Marionette dburns RESO FIXE 2023-02-09
1141519 Marionette hangs if exceptions are happening in content scope Remote Protocol Marionette dburns RESO FIXE 2023-02-09
1195440 Disable sending data to Mozilla to improve experience Remote Protocol Marionette dburns RESO FIXE 2023-02-09
902125 Add a version config/flag for Python Marionette (and JavaScript version too if we don't have one) Remote Protocol Marionette j.parkouss RESO FIXE 2023-02-09
940924 Marionette should list the number of unexpected/expected fails at the end of the test run Remote Protocol Marionette j.parkouss RESO FIXE 2023-02-09
983821 'marionette' cli entrypoint doesn't have access to proper packages Remote Protocol Marionette j.parkouss RESO FIXE 2023-02-09
996236 screenshot() should allow decoding from base64 automatically Remote Protocol Marionette j.parkouss RESO FIXE 2023-02-09
1081970 Gracefully handle interrupts when running test suite Remote Protocol Marionette j.parkouss RESO FIXE 2023-02-09
1129122 Marionette should show an error if a test file doesn't start with the test_ prefix Remote Protocol Marionette j.parkouss RESO FIXE 2023-02-09
1141129 BaseMarionetteTestRunner.__init__ should initialize self.prefs as dictionary Remote Protocol Marionette j.parkouss RESO FIXE 2023-02-09
1168803 Add --addon option to specify add-ons to be installed Remote Protocol Marionette j.parkouss RESO FIXE 2023-02-09
1183157 make marionette --version flag also show the transport and driver package versions Remote Protocol Marionette j.parkouss RESO FIXE 2023-02-09
1213026 Skip a test based on the value of a browser pref Remote Protocol Marionette j.parkouss RESO FIXE 2023-02-09
1033824 Bump and release marionette-client 0.7.11 Remote Protocol Marionette jgriffin RESO FIXE 2023-02-09
984208 [Marionette Client] Modifying shuffle to put its seed outside Remote Protocol Marionette luvagarwal1995su RESO FIXE 2023-02-09
997770 Allow users to declare how long to wait before connection timeout Remote Protocol Marionette malini RESO FIXE 2023-02-09
1105748 Fix Mn failure on emulator/device (wrappedJSObject.System is undefined) Remote Protocol Marionette malini RESO FIXE 2023-02-09
1040742 MarionetteTestCase should not try to delete_session/call the server if a crash has occurred Testing Marionette Client an mjzffr RESO FIXE 2023-02-10
1150512 Move Marionette test runner to wptserve Remote Protocol Marionette mjzffr RESO FIXE 2023-02-09
1199588 Profile location is ignored by BaseMarionetteTestRunner (always created under TEMP) Remote Protocol Marionette mjzffr RESO FIXE 2023-02-09
1227367 Add harness unit tests to marionette-client Remote Protocol Marionette mjzffr RESO FIXE 2023-02-09
1229765 Monitor Marionette browser process for start-up crashes Remote Protocol Marionette mjzffr RESO FIXE 2023-02-09
1238156 [tracking] Split out specialized features in Marionette harness and add harness unit tests Remote Protocol Marionette mjzffr RESO FIXE 2023-02-09
1238996 Release marionette-driver 1.2, marionette-transport 1.1, and marionette-client 2.1 Testing Marionette Client an mjzffr RESO FIXE 2023-02-10
1294879 avd parameter not passed on to Marionette class Remote Protocol Marionette mjzffr RESO FIXE 2023-02-09
1328411 BaseMarionetteTestRunner should log e10s status based on appinfo not incoming args Remote Protocol Marionette mjzffr RESO FIXE 2023-02-09
1328654 Clean up left-over processes in MarionetteHarness Remote Protocol Marionette mjzffr RESO FIXE 2023-02-09
1002039 Cannot find virtualenv.py to setup marionette environment Testing Marionette Client an mvines RESO FIXE 2023-02-10
1256973 [refactor] Simplify assignment to result_callbacks Remote Protocol Marionette nathalier RESO FIXE 2023-02-09
1256978 [refactor] Use self.capabilities instead of self._capabilities where ever possible in BaseMarionetteTestRunner Remote Protocol Marionette nathalier RESO FIXE 2023-02-09
807095 JS assertion failures in a Python test case do not cause the test to be marked as failed Remote Protocol Marionette nobody RESO WONT 2023-02-09
808631 Marionette needs unique error messages Remote Protocol Marionette nobody RESO INCO 2023-02-09
813292 Marionette should abort test run when an emulator crash has been detected Remote Protocol Marionette nobody RESO WONT 2023-02-09
818146 Don't proceed to "Running run-marionette step" if "Running install step" failed Remote Protocol Marionette nobody RESO INCO 2023-02-09
830888 Provide a common name for targets to map to manifest attributes for running tests Remote Protocol Marionette nobody RESO WONT 2023-02-09
840182 Need to detect when app crashes/freezes when running marionette tests Remote Protocol Marionette nobody RESO FIXE 2023-02-09
853264 Add an argument to Marionette to attach a debugger Remote Protocol Marionette nobody RESO DUPL 2023-02-09
873644 Fix our test manifests Remote Protocol Marionette nobody RESO DUPL 2023-02-09
916015 add a setup/cleanup method to marionette webapi tests Remote Protocol Marionette nobody RESO WONT 2023-02-09
973675 Need tests for the test runner Remote Protocol Marionette nobody RESO DUPL 2023-02-09
973792 connection timed out when trying to take a screenshot of virgin-atlantic.com Remote Protocol Marionette nobody RESO INCO 2023-02-09
984951 Disable the warning when running the tests against a desktop b2g build Remote Protocol Marionette nobody RESO WONT 2023-02-09
1002458 Make host/port available in MarionetteTestRunner Remote Protocol Marionette nobody RESO WONT 2023-02-09
1024416 Make Marionette handle the hangs/crashes in bug 1023151 so as to not hit the buildbot timeout Remote Protocol Marionette nobody RESO WORK 2023-02-09
1028947 marionette.py python exception regex matches against XUL!AsmJSMachExceptionHandlerThread(...) in crash stacks Remote Protocol Marionette nobody RESO INVA 2023-02-09
1031390 Marionette busted on v2.0 Remote Protocol Marionette nobody RESO FIXE 2023-02-09
1038870 Use B2GDesktopRunner in the Marionette client Remote Protocol Marionette nobody RESO WONT 2023-02-09
1045226 Client needs better cli verification Remote Protocol Marionette nobody RESO WONT 2023-02-09
1048554 remove non-functional browser autolaunch to make functional tests faster Remote Protocol Marionette nobody RESO WORK 2023-02-09
1050178 Marionette "TEST-UNEXPECTED-FAIL" now displays as "TEST-UNEXPECTED-ERROR" Remote Protocol Marionette nobody RESO WONT 2023-02-09
1050293 Start multiple browser instances on different ports Remote Protocol Marionette nobody RESO FIXE 2023-02-09
1062671 Marionette failed to detect the crash on b2g emulator Remote Protocol Marionette nobody RESO WONT 2023-02-09
1064798 logcat from Jenkins is being chopped up before it arrives on Treeherder Remote Protocol Marionette nobody RESO INCO 2023-02-09
1079277 Marionette should use unique temp dir for each session Remote Protocol Marionette nobody RESO WONT 2023-02-09
1083685 ./mach --log-file file.log marionette-webapi fails with unrecognized --log-file option Remote Protocol Marionette nobody RESO WONT 2023-02-09
1087687 --gecko-log doesn't work when running Marionette on remote device Remote Protocol Marionette nobody RESO WONT 2023-02-09
1097586 Minor refactor of run_tests in BaseMarionetteTestRunner Remote Protocol Marionette nobody RESO INCO 2023-02-09
1097809 Our ability to catch Marionette crashes on OSX appears to be broken Remote Protocol Marionette nobody RESO INCO 2023-02-09
1111644 unable to connect to started firefox instance when using --binary Remote Protocol Marionette nobody RESO WORK 2023-02-09
1114808 Create profile in a given directory Remote Protocol Marionette nobody RESO DUPL 2023-02-09
1118302 Test runner never cleans up temporary directory of Firefox profiles Remote Protocol Marionette nobody RESO DUPL 2023-02-09
1130220 Marionette automation doesn't clean up its socket after getting killed with SIGINT Remote Protocol Marionette nobody RESO DUPL 2023-02-09
1202531 Potential leaking in marionette: cyclic reference between runner and the marionette instance Remote Protocol Marionette nobody RESO INVA 2023-02-09
1223334 [B2G] Marionette: cannot import name startTestRunner Remote Protocol Marionette nobody RESO DUPL 2023-02-09
1238746 Separate application-specific setup code in Marionette runner Remote Protocol Marionette nobody RESO WONT 2023-02-09
1298407 [marionette harness tests] failures in test_add_test_manifest when MOZCONFIG env variable is set Remote Protocol Marionette nobody RESO WORK 2023-02-09
1255064 MarionetteHarness should internally use dicts for arguments and not Namespaces Remote Protocol Marionette rachel.b.king RESO FIXE 2023-02-09
1165231 Possible leaking in marionette runner Remote Protocol Marionette shing.lyu RESO FIXE 2023-02-09
1166239 possible memory leak in report modifier mixin Remote Protocol Marionette shing.lyu RESO FIXE 2023-02-09
1125098 Remove XML report functionality from Marionette test runner Remote Protocol Marionette shrutijasoria1996 RESO FIXE 2023-02-09
859952 Profile can only be used once when launching B2G desktop client with mozrunner Remote Protocol Marionette ted RESO FIXE 2023-02-09
1114695 Factor most of MarionetteJSTestCase.runTest out into a base class method Remote Protocol Marionette ted RESO FIXE 2023-02-09
1115118 [marionette-js-runner] Enable desired capabilities support in mariontte-js-runner Testing Graveyard JSMarionette yura.zenevich RESO FIXE 2018-01-27
1132055 [marionette-js-runner] Parametrize marionette desired capabilities for marionette-mocha. Testing Graveyard JSMarionette yura.zenevich RESO FIXE 2018-01-27
138 bugs found.