glibc/stdlib
Joseph Myers f214606a0e Enumerate tests with special rules in tests-special variable.
This patch is a revised and updated version of
<https://sourceware.org/ml/libc-alpha/2014-01/msg00196.html>.

In order to generate overall summaries of the results of all tests in
the glibc testsuite, we need to identify and concatenate the files
with the results of individual tests.

Tomas Dohnalek's patch used $(common-objpfx)*/*.test-result for this.
However, the normal glibc approach is explicit enumeration of the
expected set of files with a given property, rather than all files
matching some pattern like that.  Furthermore, we would like to be
able to mark tests as UNRESOLVED if the file with their results is for
some reason missing, and in future we would like to be able to mark
tests as UNSUPPORTED if they are disabled for a particular
configuration (rather than simply having them missing from the list of
tests as at present).  Such handling of tests that were not run or did
not record results requires an explicit enumeration of tests.

For the tests following the default makefile rules, $(tests) (and
$(xtests)) provides such an enumeration.  Others, however, are added
directly as dependencies of the "tests" and "xtests" makefile
targets.  This patch changes the makefiles to put them in variables
tests-special and xtests-special, with appropriate dependencies on the
tests listed there then being added centrally.

Those variables are used in Rules and so need to be set before Rules
is included in a subdirectory makefile, which is often earlier in the
makefile than the dependencies were present before.  We previously
discussed the question of where to include Rules; see the question at
<https://sourceware.org/ml/libc-alpha/2012-11/msg00798.html>, and a
discussion in
<https://sourceware.org/ml/libc-alpha/2013-01/msg00337.html> of why
Rules is included early rather than late in subdirectory makefiles.

It was necessary to avoid an indirection through the check-abi target
and get the check-abi-* targets for individual libraries into the
tests-special variable.  The intl/ test $(objpfx)tst-gettext.out,
previously built only because of dependencies from other tests, was
also added to tests-special for the same reason.

The entries in tests-special are the full makefile targets, complete
with $(objpfx) and .out.  If a future change causes tests to be named
consistently with a .out suffix, this can be changed to include just
the path relative to $(objpfx), without .out.

Tested x86_64, including that the same set of files is generated in
the build directory by a build and testsuite run both before and after
the patch (except for changes to the
elf/tst-null-argv.debug.out.<number> file name), and a build with
run-built-tests=no to verify there aren't any more obvious instances
of the issue Marcus Shawcroft reported with a previous version in
<https://sourceware.org/ml/libc-alpha/2014-01/msg00462.html>.

	* Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	(tests): Depend on $(tests-special).
	* Makerules (check-abi-list): New variable.
	(check-abi): Depend on $(check-abi-list).
	[$(subdir) = elf] (tests-special): Add
	$(objpfx)check-abi-libc.out.
	[$(build-shared) = yes && subdir] (tests-special): Add
	$(check-abi-list).
	[$(build-shared) = yes && subdir] (tests): Do not depend on
	check-abi.
	* Rules (tests): Depend on $(tests-special).
	(xtests): Depend on $(xtests-special).
	* catgets/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	* conform/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	* elf/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	* grp/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	* iconv/Makefile (xtests): Change dependencies to ....
	(xtests-special): ... additions to this variable.
	* iconvdata/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	* intl/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.  Also add
	$(objpfx)tst-gettext.out.
	* io/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	* libio/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	* malloc/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	* misc/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	* nptl/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	* nptl_db/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	* posix/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	(xtests): Change dependencies to ....
	(xtests-special): ... additions to this variable.
	* resolv/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	(xtests): Change dependencies to ....
	(xtests-special): ... additions to this variable.
	* stdio-common/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	(do-tst-unbputc): Remove target.
	(do-tst-printf): Likewise.
	* stdlib/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	* string/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
	* sysdeps/x86/Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.

localedata:
	* Makefile (tests): Change dependencies to ....
	(tests-special): ... additions to this variable.
2014-03-06 22:35:33 +00:00
..
bits Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
sys
a64l.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
abort.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
abs.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
add_n.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
addmul_1.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
alloca.h Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
at_quick_exit.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
atexit.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
atof.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
atoi.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
atol.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
atoll.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
bsearch.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
bug-fmtmsg1.c
bug-getcontext.c
bug-strtod2.c
bug-strtod.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
canonicalize.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
cmp.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
cxa_at_quick_exit.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
cxa_atexit.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
cxa_finalize.c Use glibc_likely instead __builtin_expect. 2014-02-10 15:07:12 +01:00
cxa_thread_atexit_impl.c Use glibc_likely instead __builtin_expect. 2014-02-10 15:07:12 +01:00
dbl2mpn.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
Depend
div.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
divmod_1.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
divrem.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
drand48_r.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
drand48-iter.c Use glibc_likely instead __builtin_expect. 2014-02-10 15:07:12 +01:00
drand48.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
erand48_r.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
erand48.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
errno.h Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
exit.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
exit.h Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
fmtmsg.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
fmtmsg.h Combine __USE_BSD and __USE_SVID into __USE_MISC. 2014-02-12 23:41:01 +00:00
fpioconst.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
fpioconst.h Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
gen-fpioconst.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
gen-tst-strtod-round.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
getcontext.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
getenv.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
getsubopt.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
gmp-impl.h Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
gmp.h Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
grouping.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
grouping.h Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
groupingwc.c
inlines.c
isomac.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
jrand48_r.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
jrand48.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
l64a.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
labs.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
lcong48_r.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
lcong48.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
ldbl2mpn.c
ldiv.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
llabs.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
lldiv.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
longlong.h Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
lrand48_r.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
lrand48.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
lshift.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
makecontext.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
Makefile Enumerate tests with special rules in tests-special variable. 2014-03-06 22:35:33 +00:00
mblen.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
mbstowcs.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
mbtowc.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
mod_1.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
monetary.h Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
mp_clz_tab.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
mpn2dbl.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
mpn2flt.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
mpn2ldbl.c
mrand48_r.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
mrand48.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
msort.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
mul_1.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
mul_n.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
mul.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
nrand48_r.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
nrand48.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
old_atexit.c
on_exit.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
putenv.c Use glibc_likely instead __builtin_expect. 2014-02-10 15:07:12 +01:00
qsort.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
quick_exit.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
rand_r.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
rand.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
random_r.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
random.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
rpmatch.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
rshift.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
secure-getenv.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
seed48_r.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
seed48.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
setcontext.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
setenv.c Remove unused variable from stdlib/setenv.c 2014-02-11 12:43:49 +01:00
srand48_r.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
srand48.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
stdlib.h Complete _BSD_SOURCE / _SVID_source followup cleanup. 2014-02-21 21:45:26 +00:00
strfmon_l.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
strfmon.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
strtod_l.c Use glibc_likely instead __builtin_expect. 2014-02-10 15:07:12 +01:00
strtod.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
strtof_l.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
strtof.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
strtoimax.c
strtol_l.c Use glibc_likely instead __builtin_expect. 2014-02-10 15:07:12 +01:00
strtol.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
strtold_l.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
strtold.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
strtoll_l.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
strtoll.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
strtoul_l.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
strtoul.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
strtoull_l.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
strtoull.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
strtoumax.c
sub_n.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
submul_1.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
swapcontext.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
system.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tens_in_limb.c
test-a64l.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
test-canon2.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
test-canon.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
testdiv.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
testdiv.input
testmb2.c
testmb.c
testrand.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
testsort.c
tst-atof1.c
tst-atof2.c
tst-bsearch.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-environ.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-fmtmsg.c
tst-fmtmsg.sh Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-limits.c
tst-makecontext2.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-makecontext3.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-makecontext.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-putenv.c
tst-putenvmod.c
tst-qsort2.c
tst-qsort.c
tst-rand48-2.c
tst-rand48.c
tst-random2.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-random.c
tst-secure-getenv.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-setcontext.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-strtod2.c
tst-strtod3.c
tst-strtod4.c
tst-strtod5.c
tst-strtod6.c
tst-strtod-overflow.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-strtod-round-data Fix strtod rounding of half the least subnormal (bug 16151). 2013-11-13 12:59:54 +00:00
tst-strtod-round.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-strtod-underflow.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-strtod.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-strtol.c
tst-strtoll.c
tst-system.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-tininess.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-tls-atexit-lib.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-tls-atexit.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
tst-unsetenv1.c
tst-xpg-basename.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
ucontext.h Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
udiv_qrnnd.c
Versions
wcstoimax.c
wcstombs.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
wcstoumax.c
wctomb.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00
xpg_basename.c Update copyright notices with scripts/update-copyrights 2014-01-01 22:00:23 +10:00