tests: Require `run-fail` ui tests to have an exit code (`SIGABRT` not ok) #143002

Enselic · 2025-06-25T06:10:21Z

And introduce two new directives for ui tests:

run-crash
run-fail-or-crash

Normally a run-fail ui test like tests that panic shall not be terminated by a signal like SIGABRT. So begin having that as a hard requirement.

Some of our current tests do terminate by a signal/crash however. Introduce and use run-crash for those tests. Note that Windows crashes are not handled by signals but by certain high bits set on the process exit code. Example exit code for crash on Windows: 0xc000001d (STATUS_ILLEGAL_INSTRUCTION). Because of this, we define "crash" on all platforms as "not exit with success and not exit with a regular failure code in the range 1..=127".

Some tests behave differently on different targets:

Targets without unwind support will abort (crash) instead of exit with failure code 101 after panicking. As a special case, allow crashes for run-fail tests for such targets.
Different sanitizer implementations handle detected memory problems differently. Some abort (crash) the process while others exit with failure code 1. Introduce and use run-fail-or-crash for such tests.

This adds further (cc #142304, #142886) protection against the regression in #123733 since that bug also manifested as SIGABRT in tests/ui/panics/panic-main.rs (shown as Aborted (core dumped) in the logs attached to that issue, and I have also been able to reproduce this locally).

TODO

Q: what about on Windows?
A: we'll treat any exit code outside of 1 - 127 as "crashed", and we'll do the same on unix.
test all permutations of actual vs expected
Done: See tests: Require run-fail ui tests to have an exit code (SIGABRT not ok) #143002 (comment).
Handle targets without unwind support
Add run-fail-or-crash for some sanitizer tests

Zulip discussion

See https://rust-lang.zulipchat.com/#narrow/channel/122651-general/topic/compiletest.3A.20terminate.20by.20signal.20vs.20exit.20with.20error/with/525611235

try-job: aarch64-apple
try-job: x86_64-msvc-1
try-job: x86_64-gnu
try-job: dist-i586-gnu-i586-i686-musl
try-job: test-various

rustbot · 2025-06-25T06:10:25Z

r? @petrochenkov

rustbot has assigned @petrochenkov.
They will have a look at your PR within the next two weeks and either review your PR or reassign to another reviewer.

Use r? to explicitly pick a reviewer

rustbot · 2025-06-25T06:10:29Z

Some changes occurred in src/tools/compiletest

cc @jieyouxu

workingjubilee · 2025-06-25T08:18:58Z

why not simply run-abort

also would accept run-crash

jieyouxu · 2025-06-25T10:10:37Z

@bors2 delegate=try

rust-bors · 2025-06-25T10:10:40Z

@Enselic can now perform try builds on this pull request

Enselic · 2025-06-25T11:37:25Z

@bors2 try jobs=x86_64-msvc-1,x86_64-msvc-2

rust-bors · 2025-06-25T11:37:29Z

⌛ Trying commit 17be091 with merge 873ecba…

To cancel the try build, run the command @bors2 try cancel.

…try> tests: Require `run-fail` ui tests to have an exit code (`SIGABRT` not ok) Normally a `run-fail` ui test shall not be terminated by a signal like `SIGABRT`. So begin having that as a hard requirement. Some of our current tests do terminate by a signal however. Introduce and use `run-fail-without-exit-code` for those tests. This adds further (cc #142304, #142886) protection against the regression in #123733 since that bug also manifested as `SIGABRT` in `tests/ui/panics/panic-main.rs` (shown as `Aborted (core dumped)` in the logs attached to that issue, and I have also been able to reproduce this locally). ### TODO - [ ] what about on Windows? - [ ] also update docs at https://rustc-dev-guide.rust-lang.org/tests/directives.html#controlling-outcome-expectations - [ ] clean up the code ### Zulip discussion See https://rust-lang.zulipchat.com/#narrow/channel/122651-general/topic/compiletest.3A.20terminate.20by.20signal.20vs.20exit.20with.20error/with/525611235 try-job: x86_64-msvc-1 try-job: x86_64-msvc-2

Enselic · 2025-06-25T13:34:03Z

An only-windows test that was run-fail now must be run-crash. Fixed now. Trying again:

@bors2 try jobs=x86_64-msvc-1,x86_64-msvc-2

rust-bors · 2025-06-25T13:34:07Z

⌛ Trying commit ad4e082 with merge e685982…

To cancel the try build, run the command @bors2 try cancel.

…try> tests: Require `run-fail` ui tests to have an exit code (`SIGABRT` not ok) Normally a `run-fail` ui test shall not be terminated by a signal like `SIGABRT`. So begin having that as a hard requirement. Some of our current tests do terminate by a signal however. Introduce and use `run-fail-without-exit-code` for those tests. This adds further (cc #142304, #142886) protection against the regression in #123733 since that bug also manifested as `SIGABRT` in `tests/ui/panics/panic-main.rs` (shown as `Aborted (core dumped)` in the logs attached to that issue, and I have also been able to reproduce this locally). ### TODO - [ ] **Q:** what about on Windows? **A:** we'll treat any exit code outside of 1 - 127 as "crashed", and we'll do the same on unix. - [ ] also update docs at https://rustc-dev-guide.rust-lang.org/tests/directives.html#controlling-outcome-expectations - [ ] clean up the code - [ ] test all permutations of actual vs expected ### Zulip discussion See https://rust-lang.zulipchat.com/#narrow/channel/122651-general/topic/compiletest.3A.20terminate.20by.20signal.20vs.20exit.20with.20error/with/525611235 try-job: x86_64-msvc-1 try-job: x86_64-msvc-2

rustbot · 2025-07-01T22:33:05Z

Some changes occurred in tests/ui/sanitizer

cc @rcvalle

Enselic · 2025-07-02T04:25:17Z

@bors2 try jobs=aarch64-apple

rust-bors · 2025-07-02T04:25:21Z

⌛ Trying commit b210f9a with merge 6b2b0d7…

To cancel the try build, run the command @bors2 try cancel.

…try> tests: Require `run-fail` ui tests to have an exit code (`SIGABRT` not ok) Normally a `run-fail` ui test shall not be terminated by a signal like `SIGABRT`. So begin having that as a hard requirement. Some of our current tests do terminate by a signal however. Introduce and use ~`run-fail-without-exit-code`~ `run-crash` for those tests. This adds further (cc #142304, #142886) protection against the regression in #123733 since that bug also manifested as `SIGABRT` in `tests/ui/panics/panic-main.rs` (shown as `Aborted (core dumped)` in the logs attached to that issue, and I have also been able to reproduce this locally). ### TODO - [x] **Q:** what about on Windows? **A:** we'll treat any exit code outside of 1 - 127 as "crashed", and we'll do the same on unix. - [x] test all permutations of actual vs expected **Done:** See #143002 (comment). - [x] Handle targets without unwind support - [ ] Add `run-fail-or-crash` for some sanitizer tests ### Zulip discussion See https://rust-lang.zulipchat.com/#narrow/channel/122651-general/topic/compiletest.3A.20terminate.20by.20signal.20vs.20exit.20with.20error/with/525611235 try-job: aarch64-apple // try-job: x86_64-msvc-1 // try-job: x86_64-gnu // try-job: dist-i586-gnu-i586-i686-musl // try-job: test-various try-job: aarch64-apple

rust-bors · 2025-07-02T05:50:10Z

☀️ Try build successful (CI)
Build commit: 6b2b0d7 (6b2b0d7553948641a6fbcc84346962a4bae641e5, parent: 085c24790e591948f788fd294ca3f9858313741c)

Enselic · 2025-07-02T07:44:24Z

Now running all try-jobs added to PR description by matthiaskrgr:

@bors2 try

rust-bors · 2025-07-02T07:44:29Z

⌛ Trying commit d0fc6d2 with merge 6778a43…

To cancel the try build, run the command @bors2 try cancel.

…try> tests: Require `run-fail` ui tests to have an exit code (`SIGABRT` not ok) Normally a `run-fail` ui test shall not be terminated by a signal like `SIGABRT`. So begin having that as a hard requirement. Some of our current tests do terminate by a signal however. Introduce and use ~`run-fail-without-exit-code`~ `run-crash` for those tests. This adds further (cc #142304, #142886) protection against the regression in #123733 since that bug also manifested as `SIGABRT` in `tests/ui/panics/panic-main.rs` (shown as `Aborted (core dumped)` in the logs attached to that issue, and I have also been able to reproduce this locally). ### TODO - [x] **Q:** what about on Windows? **A:** we'll treat any exit code outside of 1 - 127 as "crashed", and we'll do the same on unix. - [x] test all permutations of actual vs expected **Done:** See #143002 (comment). - [x] Handle targets without unwind support - [ ] Add `run-fail-or-crash` for some sanitizer tests ### Zulip discussion See https://rust-lang.zulipchat.com/#narrow/channel/122651-general/topic/compiletest.3A.20terminate.20by.20signal.20vs.20exit.20with.20error/with/525611235 try-job: aarch64-apple try-job: x86_64-msvc-1 try-job: x86_64-gnu try-job: dist-i586-gnu-i586-i686-musl try-job: test-various

rust-bors · 2025-07-02T10:12:36Z

☀️ Try build successful (CI)
Build commit: 6778a43 (6778a43f0f7b98963a9a3cd127bdf034a66e9cbc, parent: f51c9870bab634afb9e7a262b6ca7816bb9e940d)

Enselic · 2025-07-02T13:55:37Z

The problems found by bors in the approved commit 4573c84 should be fixed now. Changes in the current commit compared to that commit:

Allow run-fail tests to crash on targets without unwind support such as wasm32-wasip1 (see updated docs for more info).
Add and use run-fail-or-crash for sanitizer tests since some sanitizers abort while others exit with code 1. I'm also sure we'll find more uses for that relaxed version in the future.
Update rustc-dev-guide with the above.
Include more details in the test fail messages (see exhaustive examples below).

Since the try-jobs succeeded (I only did minor change since then) this is ready for review again:

@rustbot ready

Updated examples of failure messages:

error: test did not exit with success! code=Some(101) so test would pass with `run-fail`
status: exit status: 101

error: test did not exit with success! code=None so test would pass with `run-crash`
status: signal: 4 (SIGILL) (core dumped)

error: test did not crash! code=Some(101) so test would pass with `run-fail`
status: exit status: 101

error: test did not crash! code=Some(0) so test would pass with `run-pass`
status: exit status: 0

error: test did not exit with failure! code=None so test would pass with `run-crash`
status: signal: 6 (SIGABRT) (core dumped)

error: test did not exit with failure! code=Some(0) so test would pass with `run-pass`
status: exit status: 0

How exit code 0 looks like for a `run-fail` test on platforms without unwind support:

error: test did not exit with failure or crash (`wasm32-wasip1` can't unwind)! code=Some(0) so test would pass with `run-pass`
status: exit status: 0

More details

Click to expand full test output of test failures

$ ./x test --stage 1 tests/ui

failures:

---- [ui] tests/ui/async-await/issues/issue-65419/issue-65419-coroutine-resume-after-completion.rs stdout ----

error: test did not exit with failure! code=Some(0) so test would pass with `run-pass`
status: exit status: 0
command: cd "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/async-await/issues/issue-65419/issue-65419-coroutine-resume-after-completion" && RUSTC="/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/stage1/bin/rustc" RUST_TEST_THREADS="32" "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/async-await/issues/issue-65419/issue-65419-coroutine-resume-after-completion/a"
stdout: none
stderr: none


---- [ui] tests/ui/deref.rs stdout ----

error: test did not exit with success! code=Some(101) so test would pass with `run-fail`
status: exit status: 101
command: cd "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/deref" && RUSTC="/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/stage1/bin/rustc" RUST_TEST_THREADS="32" "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/deref/a"
stdout: none
--- stderr -------------------------------

thread 'main' panicked at /home/martin/src/rust-2/tests/ui/deref.rs:4:5:
moop
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
------------------------------------------


---- [ui] tests/ui/inlined-main.rs stdout ----

error: test did not exit with success! code=None so test would pass with `run-crash`
status: signal: 4 (SIGILL) (core dumped)
command: cd "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/inlined-main" && RUSTC="/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/stage1/bin/rustc" RUST_TEST_THREADS="32" "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/inlined-main/a"
stdout: none
stderr: none


---- [ui] tests/ui/mir/alignment/misaligned_borrow.rs stdout ----

error: test did not crash! code=Some(101) so test would pass with `run-fail`
status: exit status: 101
command: cd "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/mir/alignment/misaligned_borrow" && RUSTC="/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/stage1/bin/rustc" RUST_TEST_THREADS="32" "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/mir/alignment/misaligned_borrow/a"
stdout: none
--- stderr -------------------------------

thread 'main' panicked at /home/martin/src/rust-2/tests/ui/mir/alignment/misaligned_borrow.rs:7:5:
moop
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
------------------------------------------


---- [ui] tests/ui/mir/alignment/borrow_misaligned_field_projection.rs stdout ----

error: test did not crash! code=Some(0) so test would pass with `run-pass`
status: exit status: 0
command: cd "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/mir/alignment/borrow_misaligned_field_projection" && RUSTC="/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/stage1/bin/rustc" RUST_TEST_THREADS="32" "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/mir/alignment/borrow_misaligned_field_projection/a"
stdout: none
stderr: none


---- [ui] tests/ui/panics/main-panic.rs stdout ----

error: test did not exit with failure! code=None so test would pass with `run-crash`
status: signal: 6 (SIGABRT) (core dumped)
command: cd "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/panics/main-panic" && RUSTC="/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/stage1/bin/rustc" RUST_TEST_THREADS="32" "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/panics/main-panic/a"
stdout: none
--- stderr -------------------------------

thread 'main' panicked at /home/martin/src/rust-2/tests/ui/panics/main-panic.rs:8:9:
null pointer dereference occurred
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
thread caused non-unwinding panic. aborting.
------------------------------------------


---- [ui] tests/ui/panics/panic-main.rs stdout ----

error: test did not exit with failure! code=Some(0) so test would pass with `run-pass`
status: exit status: 0
command: cd "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/panics/panic-main" && RUSTC="/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/stage1/bin/rustc" RUST_TEST_THREADS="32" "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/panics/panic-main/a"
stdout: none
stderr: none



failures:
    [ui] tests/ui/async-await/issues/issue-65419/issue-65419-coroutine-resume-after-completion.rs
    [ui] tests/ui/deref.rs
    [ui] tests/ui/inlined-main.rs
    [ui] tests/ui/mir/alignment/misaligned_borrow.rs
    [ui] tests/ui/mir/alignment/borrow_misaligned_field_projection.rs
    [ui] tests/ui/panics/main-panic.rs
    [ui] tests/ui/panics/panic-main.rs

test result: FAILED. 19165 passed; 7 failed; 164 ignored; 0 measured; 0 filtered out; finished in 100.41s

Some tests failed in compiletest suite=ui mode=ui host=x86_64-unknown-linux-gnu target=x86_64-unknown-linux-gnu
Build completed unsuccessfully in 0:03:42






$ PATH="/home/martin/opt/wasmtime-v19/wasmtime-v19.0.0-x86_64-linux:$PATH" WASI_SDK_PATH=/home/martin/opt/wasi-sdk-25/wasi-sdk-25.0-x86_64-linux ./x test --stage 1 --set rust.lld=true --target wasm32-wasip1 tests/ui/async-await/issues/issue-65419/issue-65419-coroutine-resume-after-completion.rs --force-rerun

Testing stage1 compiletest suite=ui mode=ui (x86_64-unknown-linux-gnu -> wasm32-wasip1)

running 1 tests

[ui] tests/ui/async-await/issues/issue-65419/issue-65419-coroutine-resume-after-completion.rs ... F


failures:

---- [ui] tests/ui/async-await/issues/issue-65419/issue-65419-coroutine-resume-after-completion.rs stdout ----

error: test did not exit with failure or crash (`wasm32-wasip1` can't unwind)! code=Some(0) so test would pass with `run-pass`
status: exit status: 0
command: cd "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/async-await/issues/issue-65419/issue-65419-coroutine-resume-after-completion" && RUSTC="/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/stage1/bin/rustc" RUST_TEST_THREADS="32" "/home/martin/opt/wasmtime-v19/wasmtime-v19.0.0-x86_64-linux/wasmtime" "run" "-C" "cache=n" "--dir" "." "--env" "RUSTC_BOOTSTRAP" "/home/martin/src/rust-2/build/x86_64-unknown-linux-gnu/test/ui/async-await/issues/issue-65419/issue-65419-coroutine-resume-after-completion/a.wasm"
stdout: none
stderr: none



failures:
    [ui] tests/ui/async-await/issues/issue-65419/issue-65419-coroutine-resume-after-completion.rs

test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 19335 filtered out; finished in 133.06ms

Some tests failed in compiletest suite=ui mode=ui host=x86_64-unknown-linux-gnu target=wasm32-wasip1
Build completed unsuccessfully in 0:01:15

src/tools/compiletest/src/runtest.rs

petrochenkov · 2025-07-03T13:13:55Z

r=me with #143002 (comment) addressed.
@rustbot author
@bors delegate+

bors · 2025-07-03T13:13:58Z

✌️ @Enselic, you can now approve this pull request!

If @petrochenkov told you to "r=me" after making some further change, please make that change, then do @bors r=@petrochenkov

…t ok) And introduce two new directives for ui tests: * `run-crash` * `run-fail-or-crash` Normally a `run-fail` ui test like tests that panic shall not be terminated by a signal like `SIGABRT`. So begin having that as a hard requirement. Some of our current tests do terminate by a signal/crash however. Introduce and use `run-crash` for those tests. Note that Windows crashes are not handled by signals but by certain high bits set on the process exit code. Example exit code for crash on Windows: `0xc000001d`. Because of this, we define "crash" on all platforms as "not exit with success and not exit with a regular failure code in the range 1..=127". Some tests behave differently on different targets: * Targets without unwind support will abort (crash) instead of exit with failure code 101 after panicking. As a special case, allow crashes for `run-fail` tests for such targets. * Different sanitizer implementations handle detected memory problems differently. Some abort (crash) the process while others exit with failure code 1. Introduce and use `run-fail-or-crash` for such tests.

Enselic · 2025-07-03T16:49:57Z

@bors r=@petrochenkov

bors · 2025-07-03T16:49:59Z

📌 Commit 6950daf has been approved by petrochenkov

It is now in the queue for this repository.

rustbot assigned petrochenkov Jun 25, 2025

Enselic added S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Jun 25, 2025

Enselic mentioned this pull request Jun 25, 2025

RUST_BACKTRACE=full loop with -Cpanic=abort on aarch64-unknown-linux-gnu #123733

Open

rustbot added the T-infra Relevant to the infrastructure team, which will review and decide on the PR/issue. label Jun 25, 2025

This comment has been minimized.

Sign in to view

Enselic force-pushed the tests-ui-run-fail-exit-vs-signal branch from 6ad1973 to 17be091 Compare June 25, 2025 10:12

This comment was marked as outdated.

Sign in to view

This comment was marked as resolved.

Sign in to view

Enselic force-pushed the tests-ui-run-fail-exit-vs-signal branch from 17be091 to ad4e082 Compare June 25, 2025 13:30

This comment was marked as resolved.

Sign in to view

Enselic force-pushed the tests-ui-run-fail-exit-vs-signal branch from ad4e082 to 2499dac Compare June 25, 2025 16:29

rustbot added the A-rustc-dev-guide Area: rustc-dev-guide label Jun 25, 2025

Enselic force-pushed the tests-ui-run-fail-exit-vs-signal branch from b210f9a to d0fc6d2 Compare July 2, 2025 06:26

Enselic force-pushed the tests-ui-run-fail-exit-vs-signal branch 2 times, most recently from c19e167 to 7914e18 Compare July 2, 2025 12:14

rustbot added S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. and removed S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. labels Jul 2, 2025

This comment was marked as resolved.

Sign in to view

Enselic force-pushed the tests-ui-run-fail-exit-vs-signal branch from 7914e18 to 5334e8a Compare July 3, 2025 08:04

This comment has been minimized.

Sign in to view

Enselic force-pushed the tests-ui-run-fail-exit-vs-signal branch from 5334e8a to 7f2f79f Compare July 3, 2025 09:21

petrochenkov reviewed Jul 3, 2025

View reviewed changes

src/tools/compiletest/src/runtest.rs Outdated Show resolved Hide resolved

rustbot removed the S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. label Jul 3, 2025

rustbot added the S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. label Jul 3, 2025

Enselic force-pushed the tests-ui-run-fail-exit-vs-signal branch from 7f2f79f to 6950daf Compare July 3, 2025 13:35

bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. labels Jul 3, 2025

tests: Require run-fail ui tests to have an exit code (SIGABRT not ok) #143002

Are you sure you want to change the base?

tests: Require run-fail ui tests to have an exit code (SIGABRT not ok) #143002

Conversation

Enselic commented Jun 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

TODO

Zulip discussion

Uh oh!

rustbot commented Jun 25, 2025

Uh oh!

rustbot commented Jun 25, 2025

Uh oh!

This comment has been minimized.

workingjubilee commented Jun 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jieyouxu commented Jun 25, 2025

Uh oh!

rust-bors bot commented Jun 25, 2025

Uh oh!

This comment was marked as outdated.

This comment was marked as outdated.

Enselic commented Jun 25, 2025

Uh oh!

rust-bors bot commented Jun 25, 2025

Uh oh!

This comment was marked as resolved.

Enselic commented Jun 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

rust-bors bot commented Jun 25, 2025

Uh oh!

This comment was marked as resolved.

rustbot commented Jul 1, 2025

Uh oh!

Enselic commented Jul 2, 2025

Uh oh!

rust-bors bot commented Jul 2, 2025

Uh oh!

rust-bors bot commented Jul 2, 2025

Uh oh!

Enselic commented Jul 2, 2025

Uh oh!

rust-bors bot commented Jul 2, 2025

Uh oh!

rust-bors bot commented Jul 2, 2025

Uh oh!

Enselic commented Jul 2, 2025

Updated examples of failure messages:

How exit code 0 looks like for a run-fail test on platforms without unwind support:

More details

Uh oh!

This comment was marked as resolved.

This comment has been minimized.

Uh oh!

petrochenkov commented Jul 3, 2025

Uh oh!

bors commented Jul 3, 2025

Uh oh!

Enselic commented Jul 3, 2025

Uh oh!

bors commented Jul 3, 2025

Uh oh!

Uh oh!

tests: Require `run-fail` ui tests to have an exit code (`SIGABRT` not ok) #143002

tests: Require `run-fail` ui tests to have an exit code (`SIGABRT` not ok) #143002

Enselic commented Jun 25, 2025 •

edited

Loading

workingjubilee commented Jun 25, 2025 •

edited

Loading

Enselic commented Jun 25, 2025 •

edited

Loading

How exit code 0 looks like for a `run-fail` test on platforms without unwind support: