Qemu Twister Failed Unknown

[carriegong]

Describe the bug
Qemu twister build / execution fails with unknown.
FAILED Unknown (qemu)
This is running on CI
Unsure what is happening here

2023-11-14 18:02:36,311 - twister - DEBUG - Spawning QEMUHandler Thread for qemu_cortex_m3/unit.test
2023-11-14 18:02:36,321 - twister - DEBUG - Running qemu_cortex_m3/unit.test (qemu)
2023-11-14 18:02:36,325 - twister - DEBUG - Spawning QEMUHandler Thread for qemu_cortex_m3/unit.test
2023-11-14 18:02:36,357 - twister - DEBUG - No timeout, return code from QEMU (None): 1
2023-11-14 18:02:36,357 - twister - DEBUG - Timed out while monitoring QEMU output
2023-11-14 18:02:36,357 - twister - DEBUG - return code from QEMU (None): 1
2023-11-14 18:02:36,357 - twister - DEBUG - Expected suite names:['integration_button', 'settings_test', 'devices', 'framework_tests']
2023-11-14 18:02:36,357 - twister - DEBUG - Detected suite names:[]

Expected behavior
twister test pass

Logs and console output

2023-11-14 18:02:27,825 - twister - DEBUG - Launch process 35
2023-11-14 18:02:32,428 - twister - DEBUG - Finished building /root/project/west-repos/tests for qemu_cortex_m3
2023-11-14 18:02:32,431 - twister - DEBUG - build test: qemu_cortex_m3/unit.test
2023-11-14 18:02:32,431 - twister - DEBUG - Building /root/project/west-repos/tests for qemu_cortex_m3
2023-11-14 18:02:36,218 - twister - DEBUG - Determine test cases for test instance: qemu_cortex_m3/unit.test
2023-11-14 18:02:36,218 - twister - DEBUG - Determine test cases for test suite: unit.test
2023-11-14 18:02:36,221 - twister - DEBUG - Test instance qemu_cortex_m3/unit.test already has 7 cases.
2023-11-14 18:02:36,306 - twister - DEBUG - unit.test.not_equal_settings, unit.test.settings, unit.test.xxx, unit.test.xxx, unit.test.message, unit.test.error_stored in /root/project/west-repos/zephyr/twister-out/qemu_cortex_m3/unit.test/zephyr/zephyr.elf
2023-11-14 18:02:36,311 - twister - DEBUG - run test: qemu_cortex_m3/unit.test
2023-11-14 18:02:36,311 - twister - DEBUG - Spawning QEMUHandler Thread for qemu_cortex_m3/unit.test
2023-11-14 18:02:36,321 - twister - DEBUG - Running qemu_cortex_m3/unit.test (qemu)
2023-11-14 18:02:36,325 - twister - DEBUG - Spawning QEMUHandler Thread for qemu_cortex_m3/unit.test
2023-11-14 18:02:36,357 - twister - DEBUG - No timeout, return code from QEMU (None): 1
2023-11-14 18:02:36,357 - twister - DEBUG - Timed out while monitoring QEMU output
2023-11-14 18:02:36,357 - twister - DEBUG - return code from QEMU (None): 1
2023-11-14 18:02:36,357 - twister - DEBUG - Expected suite names:['integration_button', 'settings_test', 'devices', 'framework_tests']
2023-11-14 18:02:36,357 - twister - DEBUG - Detected suite names:[]
2023-11-14 18:02:36,358 - twister - DEBUG - run status: qemu_cortex_m3/unit.test failed
2023-11-14 18:02:36,361 - twister - INFO - 1/1 qemu_cortex_m3            unit.test                                          �[31m FAILED �[39mUnknown (qemu)
2023-11-14 18:02:36,361 - twister - ERROR - see: �[33m/root/project/west-repos/zephyr/twister-out/qemu_cortex_m3/unit.test/build.log�[39m
2023-11-14 18:02:36,368 - twister - INFO - 1 test scenarios (1 test instances) selected, 0 configurations skipped (0 by static filter, 0 at runtime).
2023-11-14 18:02:36,369 - twister - INFO - �[31m0 of 1�[39m test configurations passed (0.00%), �[31m1�[39m failed, �[39m0�[39m errored, 0 skipped with �[39m0�[39m warnings in 10.86 seconds
2023-11-14 18:02:36,369 - twister - INFO - In total 6 test cases were executed, 0 skipped on 1 out of total 622 platforms (0.16%)
2023-11-14 18:02:36,369 - twister - INFO - �[32m0�[39m test configurations executed on platforms, �[31m1�[39m test configurations were only built.
2023-11-14 18:02:36,369 - twister - INFO - Saving reports...
2023-11-14 18:02:36,369 - twister - INFO - Writing JSON report /root/project/west-repos/zephyr/twister-out/twister.json
2023-11-14 18:02:36,374 - twister - INFO - Writing xunit report /root/project/west-repos/zephyr/twister-out/twister.xml...
2023-11-14 18:02:36,375 - twister - INFO - Writing xunit report /root/project/west-repos/zephyr/twister-out/twister_report.xml...
2023-11-14 18:02:36,377 - twister - INFO - -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
2023-11-14 18:02:36,377 - twister - INFO - The following issues were found (showing the top 10 items):
2023-11-14 18:02:36,377 - twister - INFO - 1) unit.test on qemu_cortex_m3 failed (Unknown)
2023-11-14 18:02:36,377 - twister - INFO - 
2023-11-14 18:02:36,377 - twister - INFO - To rerun the tests, call twister using the following commandline:
2023-11-14 18:02:36,377 - twister - INFO - west twister -p <PLATFORM> -s <TEST ID>, for example:
2023-11-14 18:02:36,377 - twister - INFO - 
2023-11-14 18:02:36,377 - twister - INFO - west twister -p qemu_cortex_m3 -s unit.test
2023-11-14 18:02:36,377 - twister - INFO - or with west:
2023-11-14 18:02:36,377 - twister - INFO - west build -p -b qemu_cortex_m3 -T unit.test
2023-11-14 18:02:36,377 - twister - INFO - -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
2023-11-14 18:02:36,377 - twister - INFO - Run completed

Environment (please complete the following information):

• OS: CI (circle ci) linux
• Toolchain zephyr sdk 0.16.3
• Commit SHA or Version used

[henrikbrixandersen]

Is this from a job running in the mainline Zephyr CI or in your local CI?

[carriegong]

Is this from a job running in the mainline Zephyr CI or in your local CI?

what do you mean mainline? it is running on the cloud. using circle ci

[henrikbrixandersen]

what do you mean mainline? it is running on the cloud. using circle ci

Mainline as in this repository, e.g. running as part of https://github.com/zephyrproject-rtos/zephyr/actions

We are unable to debug something that is running in your CI unless you provide instructions on how to reproduce this issue outside of your CI, sorry.

[carriegong]

what do these logs mean

2023-11-14 18:02:36,311 - twister - DEBUG - Spawning QEMUHandler Thread for qemu_cortex_m3/unit.test
2023-11-14 18:02:36,321 - twister - DEBUG - Running qemu_cortex_m3/unit.test (qemu)
2023-11-14 18:02:36,325 - twister - DEBUG - Spawning QEMUHandler Thread for qemu_cortex_m3/unit.test
2023-11-14 18:02:36,357 - twister - DEBUG - No timeout, return code from QEMU (None): 1
2023-11-14 18:02:36,357 - twister - DEBUG - Timed out while monitoring QEMU output
2023-11-14 18:02:36,357 - twister - DEBUG - return code from QEMU (None): 1
2023-11-14 18:02:36,357 - twister - DEBUG - Expected suite names:['integration_button', 'settings_test', 'devices', 'framework_tests']
2023-11-14 18:02:36,357 - twister - DEBUG - Detected suite names:[]

[JobSintecs]

We're having the exact same problem. The test will build but simply won't run.
On my own machine, it works fine. On a working machine the above logs would change into:

2023-11-14 18:02:36,325 - twister - DEBUG - Spawning QEMUHandler Thread for qemu_cortex_m3/unit.test
... lots of tests being executed ...
2023-11-14 18:02:36,357 - twister - DEBUG - No timeout, return code from QEMU (None): 0

For me this is with Zephyr 3.6. with SDK 0.16.4
The same CI setup works fine for Zephyr 2.7.5 with SDK 0.13.1