]> git.feebdaed.xyz Git - 0xmirror/curl.git/commit
runtests: add options to set minimum number of tests, use them
authorViktor Szakats <commit@vsz.me>
Fri, 12 Dec 2025 00:55:30 +0000 (01:55 +0100)
committerViktor Szakats <commit@vsz.me>
Fri, 12 Dec 2025 11:20:22 +0000 (12:20 +0100)
commit3f1cd809eeae05f39fec72fe780f3a69d21972fb
treef85c280232010936c9ad004818b16c570fbb2c41
parenteb39fee40be6a8e68be2551e36b6fcb94170aaed
runtests: add options to set minimum number of tests, use them

To detect mistakes made in the runtests framework that reduce
the number of test runs. Before this patch it could go undetected with
a green CI.

The minimum thresholds will need light maintenance going forward (either
bumping them periodically, or adjust if some may fell below minimums for
justified reasons). We may also make minimums tighter or looser, or more
job-specific.

Latest number of test runs for each job can be seen at Test Clutch:
https://testclutch.curl.se/static/reports/feature-matrix.html

Also:
- GHA: set minimums.

Assisted-by: Dan Fandrich
Follow-up to f2a75a14dd95e06cf9121c7d3bd5dc559748f350
Follow-up to bb1391f94394e635c1a5c58253e7a3d3b36bde57 #19510

Closes #19942
.github/workflows/distcheck.yml
.github/workflows/linux-old.yml
.github/workflows/linux.yml
.github/workflows/macos.yml
.github/workflows/non-native.yml
.github/workflows/windows.yml
docs/runtests.md
tests/globalconfig.pm
tests/runtests.pl