On 7/31/24 9:57 PM, Shuah Khan wrote:
On 7/31/24 07:39, Muhammad Usama Anjum wrote:Yes from https://testanything.org/tap-version-13-specification.html
Don't print that 88 sub-tests are going to be executed, but then skip.
This is against TAP compliance. Instead check pre-requisites first
before printing total number of tests.
Does TAP clearly mention this?
Skipping everything
This listing shows that the entire listing is a skip. No tests were run.
TAP version 13
1..0 # skip because English-to-French translator isn't installed
We can see above that we need to print 1..0 and skip without printing the
total number of tests to be executed as they are going to be skipped.
I think the number of tests represents the number of planned tests. If we
Old non-tap compliant output:
TAP version 13
1..88
ok 2 # SKIP all tests require euid == 0
# Planned tests != run tests (88 != 1)>>> # Totals: pass:0 fail:0 xfail:0 xpass:0 skip:1 error:0
New and correct output:
TAP version 13
1..0 # SKIP all tests require euid == 0
The problem is that this new output doesn't show how many tests
are in this test suite that could be run.
I am not use if this is better for communicating coverage information
even if meets the TAP compliance.
don't plan to run X number of tests, we shouldn't print it.