curl/.github/workflows/torture.yml

# Copyright (C) Daniel Stenberg, <daniel@haxx.se>, et al.
#
# SPDX-License-Identifier: curl

name: Linux torture

on:
  push:
    branches:
      - master
      - '*/ci'
    paths-ignore:
      - '**/*.md'
      - '**/CMakeLists.txt'
      - '.azure-pipelines.yml'
      - '.circleci/**'
      - '.cirrus.yml'
      - 'appveyor.*'
      - 'CMake/**'
      - 'packages/**'
      - 'plan9/**'
      - 'projects/**'
      - 'winbuild/**'
  pull_request:
    branches:
      - master
    paths-ignore:
      - '**/*.md'
      - '**/CMakeLists.txt'
      - '.azure-pipelines.yml'
      - '.circleci/**'
      - '.cirrus.yml'
      - 'appveyor.*'
      - 'CMake/**'
      - 'packages/**'
      - 'plan9/**'
      - 'projects/**'
      - 'winbuild/**'

concurrency:
  # Hardcoded workflow filename as workflow name above is just Linux again
  group: torture-${{ github.event.pull_request.number || github.sha }}
  cancel-in-progress: true

permissions: {}

env:
  MAKEFLAGS: -j 3

jobs:
  autotools:
    name: ${{ matrix.build.name }}
    runs-on: 'ubuntu-latest'
    timeout-minutes: 90
    strategy:
      fail-fast: false
      matrix:
        build:
          - name: torture
            install: libpsl-dev libbrotli-dev libzstd-dev zlib1g-dev libnghttp2-dev libssh2-1-dev libc-ares-dev
            configure: --with-openssl --enable-debug --enable-ares --enable-websockets
            tflags: -n -t --shallow=25 !FTP
          - name: torture-ftp
            install: libpsl-dev libbrotli-dev libzstd-dev zlib1g-dev libnghttp2-dev libssh2-1-dev libc-ares-dev
            configure: --with-openssl --enable-debug --enable-ares
            tflags: -n -t --shallow=20 FTP

    steps:
      - run: |
          sudo apt-get update
          sudo apt-get install libtool autoconf automake pkg-config stunnel4 ${{ matrix.build.install }}
          sudo python3 -m pip install impacket
        name: 'install prereqs and impacket'

      - uses: actions/checkout@v4

      - run: autoreconf -fi
        name: 'autoreconf'

      - run: ./configure --enable-warnings --enable-werror ${{ matrix.build.configure }}
        name: 'configure'

      - run: make V=1
        name: 'make'

      - run: make V=1 -C tests
        name: 'make tests'

      - run: make V=1 test-torture
        name: 'run tests'
        env:
          TFLAGS: "${{ matrix.build.tflags }}"
copyright: update all copyright lines and remove year ranges - they are mostly pointless in all major jurisdictions - many big corporations and projects already don't use them - saves us from pointless churn - git keeps history for us - the year range is kept in COPYING checksrc is updated to allow non-year using copyright statements Closes #10205 2023-01-02 20:51:48 +08:00			`# Copyright (C) Daniel Stenberg, <daniel@haxx.se>, et al.`
GHA: mv CI torture test from Zuul Closes #9310 2022-08-14 05:59:51 +08:00			`#`
			`# SPDX-License-Identifier: curl`

CI: enable parallel make in more builds Most CI services provide at least two cores, so enable parallel make jobs to take advantage of that for builds. Some dependencies aren't safe to build in parallel so leave those as-is. Also, rename a few workflows to eliminate duplicate names and provide a better idea what they're about. 2023-06-24 03:51:41 +08:00			`name: Linux torture`
GHA: mv CI torture test from Zuul Closes #9310 2022-08-14 05:59:51 +08:00
			`on:`
			`push:`
			`branches:`
tidy-up: fix yamllint whitespace issues Closes #12466 2023-12-06 18:05:20 +08:00			`- master`
			`- '*/ci'`
GHA: ignore changes to md files for most workflows Closes #10176 2022-12-28 22:57:36 +08:00			`paths-ignore:`
tidy-up: fix yamllint whitespace issues Closes #12466 2023-12-06 18:05:20 +08:00			`- '*/.md'`
			`- '**/CMakeLists.txt'`
			`- '.azure-pipelines.yml'`
			`- '.circleci/**'`
			`- '.cirrus.yml'`
appveyor: replace PowerShell with bash + parallel autotools PowerShell works (after a steep development curve), but one property of it stuck and kept causing unresolvable usability issues: With `$ErrorActionPreference=Stop`, it does abort on failures, but shows only the first line of the error message. In `Continue` mode, it shows the full error message, but doesn't stop on all errors. Another issue is PowerShell considering any stderr output as if the command failed (this has been improved in 7.2 (2021-Nov), but fixed versions aren't running in CI and will not be for a long time in all test images.) Thus, we're going with bash. Also: - use `-j2` with autotools tests, making them finish 5-15 minutes per job faster. - omit `POSIX_PATH_PREFIX`. - use `WINDIR`. - prefer forward slashes. Follow-up to: 75078a415d9c769419aed4153d3d525a8eba95af #11999 Ref: #12444 Fixes #12560 Closes #12572 2023-12-21 11:59:20 +08:00			`- 'appveyor.*'`
tidy-up: fix yamllint whitespace issues Closes #12466 2023-12-06 18:05:20 +08:00			`- 'CMake/**'`
			`- 'packages/**'`
			`- 'plan9/**'`
			`- 'projects/**'`
			`- 'winbuild/**'`
GHA: mv CI torture test from Zuul Closes #9310 2022-08-14 05:59:51 +08:00			`pull_request:`
			`branches:`
tidy-up: fix yamllint whitespace issues Closes #12466 2023-12-06 18:05:20 +08:00			`- master`
GHA: ignore changes to md files for most workflows Closes #10176 2022-12-28 22:57:36 +08:00			`paths-ignore:`
tidy-up: fix yamllint whitespace issues Closes #12466 2023-12-06 18:05:20 +08:00			`- '*/.md'`
			`- '**/CMakeLists.txt'`
			`- '.azure-pipelines.yml'`
			`- '.circleci/**'`
			`- '.cirrus.yml'`
appveyor: replace PowerShell with bash + parallel autotools PowerShell works (after a steep development curve), but one property of it stuck and kept causing unresolvable usability issues: With `$ErrorActionPreference=Stop`, it does abort on failures, but shows only the first line of the error message. In `Continue` mode, it shows the full error message, but doesn't stop on all errors. Another issue is PowerShell considering any stderr output as if the command failed (this has been improved in 7.2 (2021-Nov), but fixed versions aren't running in CI and will not be for a long time in all test images.) Thus, we're going with bash. Also: - use `-j2` with autotools tests, making them finish 5-15 minutes per job faster. - omit `POSIX_PATH_PREFIX`. - use `WINDIR`. - prefer forward slashes. Follow-up to: 75078a415d9c769419aed4153d3d525a8eba95af #11999 Ref: #12444 Fixes #12560 Closes #12572 2023-12-21 11:59:20 +08:00			`- 'appveyor.*'`
tidy-up: fix yamllint whitespace issues Closes #12466 2023-12-06 18:05:20 +08:00			`- 'CMake/**'`
			`- 'packages/**'`
			`- 'plan9/**'`
			`- 'projects/**'`
			`- 'winbuild/**'`
GHA: mv CI torture test from Zuul Closes #9310 2022-08-14 05:59:51 +08:00
CI/GHA: cancel outdated CI runs on new PR changes Avoid letting outdated CI runs continue if a PR receives new changes. Outside a PR we let them continue running by tying the concurrency to the commit hash instead. Also only let one CodeQL or Hacktoberfest job run at a time. Other CI platforms we use have this build in, but GitHub unfortunately neither by default nor with a simple option. This saves CI resources and therefore a little energy. Approved-by: Daniel Stenberg Approved-by: Max Dymond Closes #9533 2022-09-18 05:45:32 +08:00			`concurrency:`
			`# Hardcoded workflow filename as workflow name above is just Linux again`
			`group: torture-${{ github.event.pull_request.number \|\| github.sha }}`
			`cancel-in-progress: true`

GHA: clarify workflows permissions, set least possible privilege Set top-level permissions to None on all workflows, setting per-job permissions. This avoids that new jobs inherit unwanted permissions. Discussion: https://curl.se/mail/lib-2022-11/0028.html Signed-off-by: Diogo Teles Sant'Anna <diogoteles@google.com> Closes #9928 2022-11-16 22:55:33 +08:00			`permissions: {}`

CI: enable parallel make in more builds Most CI services provide at least two cores, so enable parallel make jobs to take advantage of that for builds. Some dependencies aren't safe to build in parallel so leave those as-is. Also, rename a few workflows to eliminate duplicate names and provide a better idea what they're about. 2023-06-24 03:51:41 +08:00			`env:`
			`MAKEFLAGS: -j 3`

GHA: mv CI torture test from Zuul Closes #9310 2022-08-14 05:59:51 +08:00			`jobs:`
			`autotools:`
			`name: ${{ matrix.build.name }}`
			`runs-on: 'ubuntu-latest'`
			`timeout-minutes: 90`
			`strategy:`
			`fail-fast: false`
			`matrix:`
			`build:`
tidy-up: fix yamllint whitespace issues Closes #12466 2023-12-06 18:05:20 +08:00			`- name: torture`
			`install: libpsl-dev libbrotli-dev libzstd-dev zlib1g-dev libnghttp2-dev libssh2-1-dev libc-ares-dev`
			`configure: --with-openssl --enable-debug --enable-ares --enable-websockets`
			`tflags: -n -t --shallow=25 !FTP`
			`- name: torture-ftp`
			`install: libpsl-dev libbrotli-dev libzstd-dev zlib1g-dev libnghttp2-dev libssh2-1-dev libc-ares-dev`
			`configure: --with-openssl --enable-debug --enable-ares`
			`tflags: -n -t --shallow=20 FTP`
GHA: mv CI torture test from Zuul Closes #9310 2022-08-14 05:59:51 +08:00
			`steps:`
tidy-up: fix yamllint whitespace issues Closes #12466 2023-12-06 18:05:20 +08:00			`- run: \|`
			`sudo apt-get update`
			`sudo apt-get install libtool autoconf automake pkg-config stunnel4 ${{ matrix.build.install }}`
			`sudo python3 -m pip install impacket`
			`name: 'install prereqs and impacket'`
GHA: mv CI torture test from Zuul Closes #9310 2022-08-14 05:59:51 +08:00
tidy-up: fix yamllint whitespace issues Closes #12466 2023-12-06 18:05:20 +08:00			`- uses: actions/checkout@v4`
GHA: mv CI torture test from Zuul Closes #9310 2022-08-14 05:59:51 +08:00
tidy-up: fix yamllint whitespace issues Closes #12466 2023-12-06 18:05:20 +08:00			`- run: autoreconf -fi`
			`name: 'autoreconf'`
GHA: mv CI torture test from Zuul Closes #9310 2022-08-14 05:59:51 +08:00
tidy-up: fix yamllint whitespace issues Closes #12466 2023-12-06 18:05:20 +08:00			`- run: ./configure --enable-warnings --enable-werror ${{ matrix.build.configure }}`
			`name: 'configure'`
GHA: mv CI torture test from Zuul Closes #9310 2022-08-14 05:59:51 +08:00
tidy-up: fix yamllint whitespace issues Closes #12466 2023-12-06 18:05:20 +08:00			`- run: make V=1`
			`name: 'make'`
GHA: mv CI torture test from Zuul Closes #9310 2022-08-14 05:59:51 +08:00
tidy-up: fix yamllint whitespace issues Closes #12466 2023-12-06 18:05:20 +08:00			`- run: make V=1 -C tests`
			`name: 'make tests'`
GHA: build tests in a separate step from the running of them ... to make the output smaller for when you want to look at test failures. Removed the examples build from msh3 Closes #9619 2022-09-29 18:26:04 +08:00
tidy-up: fix yamllint whitespace issues Closes #12466 2023-12-06 18:05:20 +08:00			`- run: make V=1 test-torture`
			`name: 'run tests'`
			`env:`
			`TFLAGS: "${{ matrix.build.tflags }}"`