Go to file
Daniel Stenberg 838d894504
tool_operate: prevent over-queuing in parallel mode
When doing a huge amount of parallel transfers, we must not add them to
the per_transfer list frivolously since they all use memory after all.
This was previous done without really considering millions or billions
of transfers. Massive parallelism would use a lot of memory for no good
purpose.

The queue is now limited to twice the paralleism number.

This makes the 'Qd' value in the parallel progress meter mostly useless
for users, but works for now for us as a debug display.

Reported-by: justchen1369 on github
Fixes #8933
Closes #9389
2022-08-31 15:58:03 +02:00
.circleci copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
.github gha: move over ngtcp2-gnutls CI job from zuul 2022-08-27 14:43:26 +02:00
.lift copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
.reuse reuse/dep5: adjusted to parse better 2022-06-14 14:07:02 +02:00
CMake cmake: fix original MinGW builds 2022-08-31 11:57:24 +00:00
docs THANKS: add contributors from the 7.85.0 release 2022-08-31 08:09:21 +02:00
include curl.h: include <sys/select.h> on SunOS 2022-08-17 13:25:02 +02:00
lib url: really use the user provided in the url when netrc entry exists 2022-08-29 17:25:29 +02:00
LICENSES examples/curlx.c: remove 2022-08-18 00:00:12 +02:00
m4 configure: introduce CURL_SIZEOF 2022-08-11 09:07:02 +02:00
packages tidy-up: delete unused build configuration macros 2022-07-19 15:12:19 +00:00
plan9 copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
projects projects: fix third-party SSL library build paths for Visual Studio 2022-06-20 08:22:24 +02:00
scripts zuul: remove the clang-tidy job 2022-08-30 15:40:03 +02:00
src tool_operate: prevent over-queuing in parallel mode 2022-08-31 15:58:03 +02:00
tests lib530: simplify realloc failure exit path 2022-08-30 15:38:20 +02:00
winbuild copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
zuul.d zuul: remove the clang-tidy job 2022-08-30 15:40:03 +02:00
.azure-pipelines.yml CI/runtests.pl: add param for dedicated curl to talk to APIs 2022-08-28 19:18:22 +02:00
.cirrus.yml cirrus/freebsd-ci: bootstrap the pip installer 2022-08-08 23:25:56 +02:00
.dcignore copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
.dir-locals.el copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
.git-blame-ignore-revs git: ignore large commit making the curl REUSE compliant 2022-06-13 09:14:07 +02:00
.gitattributes copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
.gitignore copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
.lgtm.yml copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
.mailmap connect: add quic connection information 2022-08-10 08:41:50 +02:00
acinclude.m4 configure: fixup bsdsocket detection code for AmigaOS 4.x 2022-08-08 15:49:28 +02:00
appveyor.yml CI/runtests.pl: add param for dedicated curl to talk to APIs 2022-08-28 19:18:22 +02:00
buildconf copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
buildconf.bat buildconf.bat: update copyright year range 2022-06-14 14:06:55 +02:00
CHANGES
CMakeLists.txt cmake: fix original MinGW builds 2022-08-31 11:57:24 +00:00
configure.ac configure: if asked to use TLS, fail if no TLS lib was detected 2022-08-25 17:29:50 +02:00
COPYING COPYING: bump copyright year range 2022-01-05 23:14:15 +01:00
curl-config.in curl-config: quote directories with potential space 2022-08-10 14:35:40 +02:00
GIT-INFO
libcurl.pc.in copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
MacOSX-Framework copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
Makefile.am copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
Makefile.dist copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
maketgz copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00
mlc_config.json mlc: curl.zuul.vexxhost.dev is reachable again 2022-04-24 23:29:38 +02:00
README docs: reduce/avoid English contractions 2021-11-07 23:16:27 +01:00
README.md README.md: use the common "Copyright" style formatting 2022-06-14 14:06:43 +02:00
RELEASE-NOTES RELEASE-NOTES: synced 2022-08-31 08:09:21 +02:00
SECURITY.md copyright: make repository REUSE compliant 2022-06-13 09:13:00 +02:00

curl logo

CII Best Practices Coverity passed AppVeyor Build Status Azure DevOps Build Status Cirrus Build Status Backers on Open Collective Sponsors on Open Collective Language Grade: C/C++ Fuzzing Status REUSE status

Curl is a command-line tool for transferring data specified with URL syntax. Find out how to use curl by reading the curl.1 man page or the MANUAL document. Find out how to install Curl by reading the INSTALL document.

libcurl is the library curl is using to do its job. It is readily available to be used by your software. Read the libcurl.3 man page to learn how.

You can find answers to the most frequent questions we get in the FAQ document.

Study the COPYING file for distribution terms.

Contact

If you have problems, questions, ideas or suggestions, please contact us by posting to a suitable mailing list.

All contributors to the project are listed in the THANKS document.

Commercial support

For commercial support, maybe private and dedicated help with your problems or applications using (lib)curl visit the support page.

Website

Visit the curl website for the latest news and downloads.

Git

To download the latest source from the Git server do this:

git clone https://github.com/curl/curl.git

(you will get a directory named curl created, filled with the source code)

Security problems

Report suspected security problems via our HackerOne page and not in public!

Notice

Curl contains pieces of source code that is Copyright (c) 1998, 1999 Kungliga Tekniska Högskolan. This notice is included here to comply with the distribution terms.

Backers

Thank you to all our backers! 🙏 [Become a backer]

Open Collective Backers

Sponsors

Support this project by becoming a sponsor. Your logo will show up here with a link to your website. [Become a sponsor]

Open Collective Sponsor 0 Open Collective Sponsor 1 Open Collective Sponsor 2 Open Collective Sponsor 3 Open Collective Sponsor 4 Open Collective Sponsor 5 Open Collective Sponsor 6 Open Collective Sponsor 7 Open Collective Sponsor 8 Open Collective Sponsor 9