Adhemerval Zanella 461cab1de7 linux: Add support for getrandom vDSO ... Linux 6.11 has getrandom() in vDSO. It operates on a thread-local opaque state allocated with mmap using flags specified by the vDSO. Multiple states are allocated at once, as many as fit into a page, and these are held in an array of available states to be doled out to each thread upon first use, and recycled when a thread terminates. As these states run low, more are allocated. To make this procedure async-signal-safe, a simple guard is used in the LSB of the opaque state address, falling back to the syscall if there's reentrancy contention. Also, _Fork() is handled by blocking signals on opaque state allocation (so _Fork() always sees a consistent state even if it interrupts a getrandom() call) and by iterating over the thread stack cache on reclaim_stack. Each opaque state will be in the free states list (grnd_alloc.states) or allocated to a running thread. The cancellation is handled by always using GRND_NONBLOCK flags while calling the vDSO, and falling back to the cancellable syscall if the kernel returns EAGAIN (would block). Since getrandom is not defined by POSIX and cancellation is supported as an extension, the cancellation is handled as 'may occur' instead of 'shall occur' [1], meaning that if vDSO does not block (the expected behavior) getrandom will not act as a cancellation entrypoint. It avoids a pthread_testcancel call on the fast path (different than 'shall occur' functions, like sem_wait()). It is currently enabled for x86_64, which is available in Linux 6.11, and aarch64, powerpc32, powerpc64, loongarch64, and s390x, which are available in Linux 6.12. Link: https://pubs.opengroup.org/onlinepubs/9799919799/nframe.html [1] Co-developed-by: Jason A. Donenfeld <Jason@zx2c4.com> Tested-by: Jason A. Donenfeld <Jason@zx2c4.com> # x86_64 Tested-by: Adhemerval Zanella <adhemerval.zanella@linaro.org> # x86_64, aarch64 Tested-by: Xi Ruoyao <xry111@xry111.site> # x86_64, aarch64, loongarch64 Tested-by: Stefan Liebler <stli@linux.ibm.com> # s390x		2024-11-12 14:42:12 -03:00
..
alloc_buffer_alloc_array.c
alloc_buffer_allocate.c
alloc_buffer_copy_bytes.c
alloc_buffer_copy_string.c
alloc_buffer_create_failure.c
arena.c
Depend
dynarray_at_failure.c
dynarray_emplace_enlarge.c
dynarray_finalize.c
dynarray_resize_clear.c
dynarray_resize.c
dynarray-skeleton.c
dynarray.h
hooks.c
Makefile	malloc: Link threading tests with $(shared-thread-library)	2024-08-20 16:16:25 +02:00
malloc-check.c
malloc-debug.c
malloc-internal.h
malloc.c	linux: Add support for getrandom vDSO	2024-11-12 14:42:12 -03:00
malloc.h
mallocbug.c
mcheck-impl.c
mcheck-init.c
mcheck.c
mcheck.h
memusage.c	Fix usage of _STACK_GROWS_DOWN and _STACK_GROWS_UP defines [BZ 31989]	2024-07-19 10:10:17 -04:00
memusage.sh
memusagestat.c
morecore.c
mtrace-impl.c
mtrace.c
mtrace.pl	mtrace: make shell commands robust against meta characters	2024-06-24 09:33:49 +02:00
obstack.c
obstack.h
reallocarray.c
scratch_buffer_grow_preserve.c
scratch_buffer_grow.c
scratch_buffer_set_array_size.c
set-freeres.c
thread-freeres.c
tst-aligned_alloc-lib.c	malloc: avoid global locks in tst-aligned_alloc-lib.c	2024-07-22 11:54:46 +02:00
tst-aligned-alloc-random-thread-cross.c	malloc: add multi-threaded tests for aligned_alloc/calloc/malloc	2024-07-22 11:54:46 +02:00
tst-aligned-alloc-random-thread.c	malloc: add multi-threaded tests for aligned_alloc/calloc/malloc	2024-07-22 11:54:46 +02:00
tst-aligned-alloc-random.c
tst-aligned-alloc-static.c
tst-aligned-alloc.c
tst-alloc_buffer.c
tst-calloc.c
tst-compathooks-off.c
tst-compathooks-on.c
tst-dynarray-at-fail.c
tst-dynarray-fail.c
tst-dynarray-shared.h
tst-dynarray.c
tst-free-errno.c
tst-interpose-aux-nothread.c
tst-interpose-aux-thread.c
tst-interpose-aux.c
tst-interpose-aux.h
tst-interpose-nothread.c
tst-interpose-skeleton.c
tst-interpose-static-nothread.c
tst-interpose-static-thread.c
tst-interpose-thread.c
tst-mallinfo2.c
tst-malloc_info.c
tst-malloc-alternate-path.c	malloc: New test to check malloc alternate path using memory obstruction	2024-06-04 18:00:29 +02:00
tst-malloc-backtrace.c
tst-malloc-check.c
tst-malloc-fork-deadlock.c
tst-malloc-random.c
tst-malloc-stats-cancellation.c
tst-malloc-tcache-leak.c
tst-malloc-thread-exit.c
tst-malloc-thread-fail.c
tst-malloc-too-large.c
tst-malloc-usable-tunables.c
tst-malloc-usable.c
tst-malloc.c
tst-mallocalign1.c
tst-mallocfork2.c
tst-mallocfork3.c
tst-mallocfork.c
tst-mallocstate.c
tst-mallopt.c
tst-memalign-2.c
tst-memalign-3.c
tst-memalign.c
tst-mtrace.c
tst-mtrace.sh
tst-mxfast.c
tst-obstack.c
tst-posix_memalign.c
tst-pvalloc-fortify.c
tst-pvalloc.c
tst-realloc.c
tst-reallocarray.c
tst-safe-linking.c
tst-scratch_buffer.c
tst-tcfree1.c
tst-tcfree2.c
tst-tcfree3.c
tst-trim1.c
tst-valloc.c
Versions