qt6-bb10/tests/auto/testlib/selftests
Jason McDonald 016cd01846 Remove QTest::SkipMode from qtestlib API.
When the SkipAll mode is used, tests only report a SKIP for the first
line of test data and subsequent lines are not reported at all.  This
behaviour makes it impossible for anything post-processing test results
to accurately report test pass- and run- rates because they cannot see
how many lines of test data were skipped.

This commit removes SkipMode.  QSKIPs in regular test functions and data
functions are treated the same as SkipSingle, so that every skipped line
of local or global test data is reported in the test log.  QSKIPs
elsewhere are treated the same as SkipAll -- skipping in init() causes
the next test function to be skipped entirely, and skipping in
initTestCase() or initTestCase_data() causes all test functions to be
skipped.

This commit only changes qtestlib and the selftests. A further commit
will change the autotests to remove the SkipMode parameter from QSKIP
calls.

Note that the change in expected output for the globaldata selftest is
deliberate, as the QSKIP in the skipLocal test function has effectively
changed from SkipAll to SkipSingle.

Task-number: QTBUG-21851, QTBUG-21652
Change-Id: I7b1c53fe7ca9dde032810b789d967e2a402bbe5d
Reviewed-by: Rohan McGovern <rohan.mcgovern@nokia.com>
Reviewed-by: Alex <alex.blasche@nokia.com>
2011-10-21 01:20:29 +02:00
..
alive Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
assert Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
badxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
benchlibcallgrind Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
benchlibeventcounter Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
benchliboptions Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
benchlibtickcounter Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
benchlibwalltime Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
cmptest Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
commandlinedata Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
crashes Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
datatable Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
datetime Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
differentexec Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
exceptionthrow Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expectfail Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
failinit Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
failinitdata Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
fetchbogus Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
float Split subtest selftest 2011-09-20 08:46:18 +02:00
globaldata Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
longstring Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
maxwarnings Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
multiexec Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
qexecstringlist Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
singleskip Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
skip Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
skipinit Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
skipinitdata Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
sleep Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
strcmp Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
subtest Split subtest selftest 2011-09-20 08:46:18 +02:00
test Re-enabled tests that are now passing on Linux 2011-09-26 18:47:24 +02:00
warnings Remove printf calls from warnings selftest 2011-09-21 03:59:09 +02:00
xunit Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
.gitignore Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_alive.txt Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_assert.lightxml Fix XFAIL in testlib selftest 2011-09-17 03:21:44 +02:00
expected_assert.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_assert.xml Fix XFAIL in testlib selftest 2011-09-17 03:21:44 +02:00
expected_assert.xunitxml Fix XFAIL in testlib selftest 2011-09-17 03:21:44 +02:00
expected_badxml.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_badxml.txt Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_badxml.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_badxml.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchlibcallgrind.lightxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchlibcallgrind.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_benchlibcallgrind.xml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchlibcallgrind.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchlibeventcounter.lightxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchlibeventcounter.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_benchlibeventcounter.xml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchlibeventcounter.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchliboptions.lightxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchliboptions.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_benchliboptions.xml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchliboptions.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchlibtickcounter.lightxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchlibtickcounter.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_benchlibtickcounter.xml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchlibtickcounter.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchlibwalltime.lightxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchlibwalltime.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_benchlibwalltime.xml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_benchlibwalltime.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_cmptest.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_cmptest.txt Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_cmptest.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_cmptest.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_commandlinedata.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_commandlinedata.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_commandlinedata.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_commandlinedata.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_crashes.lightxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_crashes.xml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_crashes.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_crashes_1.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_crashes_2.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_crashes_3.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_datatable.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_datatable.txt Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_datatable.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_datatable.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_datetime.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_datetime.txt Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_datetime.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_datetime.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_differentexec.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_exceptionthrow.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_exceptionthrow.txt Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_exceptionthrow.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_exceptionthrow.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_expectfail.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_expectfail.txt Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_expectfail.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_expectfail.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_failinit.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_failinit.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_failinit.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_failinit.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_failinitdata.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_failinitdata.txt Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_failinitdata.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_failinitdata.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_fatal.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_fetchbogus.lightxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_fetchbogus.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_fetchbogus.xml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_fetchbogus.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_float.lightxml Split subtest selftest 2011-09-20 08:46:18 +02:00
expected_float.txt Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_float.xml Split subtest selftest 2011-09-20 08:46:18 +02:00
expected_float.xunitxml Split subtest selftest 2011-09-20 08:46:18 +02:00
expected_globaldata.lightxml Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
expected_globaldata.txt Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
expected_globaldata.xml Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
expected_globaldata.xunitxml Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
expected_longstring.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_longstring.txt Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_longstring.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_longstring.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_maxwarnings.lightxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_maxwarnings.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_maxwarnings.xml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_maxwarnings.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_multiexec.lightxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_multiexec.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_multiexec.xml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_multiexec.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_qexecstringlist.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_singleskip.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_singleskip.txt Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
expected_singleskip.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_singleskip.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_skip.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_skip.txt Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_skip.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_skip.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_skipinit.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_skipinit.txt Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
expected_skipinit.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_skipinit.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_skipinitdata.lightxml Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
expected_skipinitdata.txt Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
expected_skipinitdata.xml Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
expected_skipinitdata.xunitxml Remove QTest::SkipMode from qtestlib API. 2011-10-21 01:20:29 +02:00
expected_sleep.lightxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_sleep.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_sleep.xml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_sleep.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_strcmp.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_strcmp.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_strcmp.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_strcmp.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_subtest.lightxml Split subtest selftest 2011-09-20 08:46:18 +02:00
expected_subtest.txt Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_subtest.xml Split subtest selftest 2011-09-20 08:46:18 +02:00
expected_subtest.xunitxml Split subtest selftest 2011-09-20 08:46:18 +02:00
expected_warnings.lightxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_warnings.txt Use placeholder for Qt version in expected output 2011-09-26 07:50:20 +02:00
expected_warnings.xml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_warnings.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
expected_xunit.lightxml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_xunit.txt Make QTest::qWarn() use __FILE__ and __LINE__. 2011-09-28 12:17:45 +02:00
expected_xunit.xml Sanitize paths in selftest data. 2011-10-19 07:24:40 +02:00
expected_xunit.xunitxml Moved autotests in category 'testlib' into new directory structure 2011-09-12 08:36:15 +02:00
selftests.pro Remove skipglobal testlib selftest. 2011-10-19 07:24:26 +02:00
selftests.qrc Remove skipglobal testlib selftest. 2011-10-19 07:24:26 +02:00
tst_selftests.cpp Remove skipglobal testlib selftest. 2011-10-19 07:24:26 +02:00