curl/lib
Daniel Stenberg f19d333ef6 - Ravi Pratap provided work on libcurl making pipelining more robust and
fixing some bugs:
  o Don't mix GET and POST requests in a pipeline
  o Fix the order in which requests are dispatched from the pipeline
  o Fixed several curl bugs with pipelining when the server is returning
    chunked encoding:
    * Added states to chunked parsing for final CRLF
    * Rewind buffer after parsing chunk with data remaining
    * Moved chunked header initializing to a spot just before receiving
      headers
2007-02-21 21:59:40 +00:00
..
.cvsignore
amigaos.c
amigaos.h
arpa_telnet.h
base64.c Suppress the "'convbuf' might be used uninitialized in this function" warning. 2007-02-01 12:23:00 +00:00
base64.h - David McCreedy made changes to allow base64 encoding/decoding to work on 2007-01-03 23:04:38 +00:00
ca-bundle.crt
config-amigaos.h Define HAVE_SIGNAL_H, HAVE_SIG_ATOMIC_T and HAVE_SIG_ATOMIC_T_VOLATILE 2006-11-24 16:38:58 +00:00
config-mac.h Make sure RETSIGTYPE is properly defined 2006-11-25 01:02:52 +00:00
config-riscos.h Define HAVE_SIGNAL_H, HAVE_SIG_ATOMIC_T and HAVE_SIG_ATOMIC_T_VOLATILE 2006-11-24 16:38:58 +00:00
config-tpf.h Define HAVE_SIGNAL_H, HAVE_SIG_ATOMIC_T and HAVE_SIG_ATOMIC_T_VOLATILE 2006-11-24 16:38:58 +00:00
config-win32.h Do not define HAVE_GMTIME_R for native Windows builds 2007-02-15 01:58:37 +00:00
config-win32ce.h Make sure RETSIGTYPE is properly defined 2006-11-25 01:02:52 +00:00
config.dos Define HAVE_SIGNAL_H, HAVE_SIG_ATOMIC_T and HAVE_SIG_ATOMIC_T_VOLATILE 2006-11-24 16:38:58 +00:00
connect.c curlassert macro replaced with DEBUGASSERT macro defined in setup_once.h 2007-02-21 19:03:20 +00:00
connect.h use macros ERRNO, SET_ERRNO(), SOCKERRNO and SET_SOCKERRNO() for errno handling 2007-02-16 18:19:35 +00:00
content_encoding.c Based on a patch by Armel Asselin, the FTP code no longer re-issues the TYPE 2006-08-19 21:18:36 +00:00
content_encoding.h Based on a patch by Armel Asselin, the FTP code no longer re-issues the TYPE 2006-08-19 21:18:36 +00:00
cookie.c avoid using funtion isblank() and just use our ISBLANK 2007-02-14 13:31:37 +00:00
cookie.h Removed "#ifndef__WATCOMC__". Use "#ifdef HAVE_SYS_TIME_H" instead. 2006-08-30 16:17:06 +00:00
curllib.dsw
curlx.h Update copyright year, since the file has been modified 2006-10-27 03:47:57 +00:00
dict.c Remove redundant __CYGWIN__ symbol check 2006-10-11 16:01:16 +00:00
dict.h
easy.c use macros ERRNO, SET_ERRNO(), SOCKERRNO and SET_SOCKERRNO() for errno handling 2007-02-16 18:19:35 +00:00
easyif.h Update copyright year, since the file has been modified 2006-10-27 03:47:57 +00:00
escape.c Avoid typecasting a signed char to an int when using is*() functions, as that 2006-10-17 21:32:56 +00:00
escape.h
file.c - Armel Asselin improved libcurl to behave a lot better when an easy handle 2007-01-16 22:22:10 +00:00
file.h - Armel Asselin improved libcurl to behave a lot better when an easy handle 2007-01-16 22:22:10 +00:00
formdata.c update copyright year notice 2007-01-27 03:43:05 +00:00
formdata.h update copyright year notice 2007-01-27 03:43:05 +00:00
ftp.c New FTP CCC functionality - adds passive and active mode to accomodate for different server behaviour 2007-02-20 22:02:11 +00:00
ftp.h update copyright year notice 2007-01-27 03:43:05 +00:00
getenv.c
getinfo.c compiler warning fix 2007-02-20 14:26:15 +00:00
getinfo.h
gtls.c New FTP CCC functionality - adds passive and active mode to accomodate for different server behaviour 2007-02-20 22:02:11 +00:00
gtls.h - Linus Nielsen Feltzing introduced the --ftp-ssl-ccc command line option to 2007-01-05 23:11:14 +00:00
hash.c Added a useful debug function within #if 0. The function makes it easy to 2006-09-10 22:12:24 +00:00
hash.h
hostares.c use macros ERRNO, SET_ERRNO(), SOCKERRNO and SET_SOCKERRNO() for errno handling 2007-02-16 18:19:35 +00:00
hostasyn.c
hostip4.c use macros ERRNO, SET_ERRNO(), SOCKERRNO and SET_SOCKERRNO() for errno handling 2007-02-16 18:19:35 +00:00
hostip6.c use macros ERRNO, SET_ERRNO(), SOCKERRNO and SET_SOCKERRNO() for errno handling 2007-02-16 18:19:35 +00:00
hostip.c curlassert macro replaced with DEBUGASSERT macro defined in setup_once.h 2007-02-21 19:03:20 +00:00
hostip.h Compilation fix 2006-09-08 05:18:07 +00:00
hostsyn.c
hostthre.c curlassert macro replaced with DEBUGASSERT macro defined in setup_once.h 2007-02-21 19:03:20 +00:00
http_chunks.c - Ravi Pratap provided work on libcurl making pipelining more robust and 2007-02-21 21:59:40 +00:00
http_chunks.h - Ravi Pratap provided work on libcurl making pipelining more robust and 2007-02-21 21:59:40 +00:00
http_digest.c - David McCreedy provided libcurl changes for doing HTTP communication on 2007-01-14 14:57:51 +00:00
http_digest.h Major overhaul introducing http pipelining support and shared connection 2006-09-07 21:49:20 +00:00
http_negotiate.c - David McCreedy made changes to allow base64 encoding/decoding to work on 2007-01-03 23:04:38 +00:00
http_negotiate.h
http_ntlm.c curlassert macro replaced with DEBUGASSERT macro defined in setup_once.h 2007-02-21 19:03:20 +00:00
http_ntlm.h
http.c curlassert macro replaced with DEBUGASSERT macro defined in setup_once.h 2007-02-21 19:03:20 +00:00
http.h update copyright year notice 2007-01-27 03:43:05 +00:00
if2ip.c updated copyright year 2006-10-25 07:19:45 +00:00
if2ip.h
inet_ntoa_r.h
inet_ntop.c curlassert macro replaced with DEBUGASSERT macro defined in setup_once.h 2007-02-21 19:03:20 +00:00
inet_ntop.h
inet_pton.c use macros ERRNO, SET_ERRNO(), SOCKERRNO and SET_SOCKERRNO() for errno handling 2007-02-16 18:19:35 +00:00
inet_pton.h
krb4.c - David McCreedy made changes to allow base64 encoding/decoding to work on 2007-01-03 23:04:38 +00:00
krb4.h cleaned up Curl_write() and the sub functions it uses for various protocols. 2006-11-11 21:34:43 +00:00
ldap.c - David McCreedy made changes to allow base64 encoding/decoding to work on 2007-01-03 23:04:38 +00:00
ldap.h
libcurl.def
libcurl.framework.make Nir Soffer updated libcurl.framework.make: fix symlinks, should link to 2006-11-09 21:58:28 +00:00
libcurl.imp
libcurl.plist
libcurl.rc added project header to lib resource file; fixed header copyright. 2007-01-26 08:53:03 +00:00
llist.c updated copyright year 2006-10-25 07:19:45 +00:00
llist.h
Makefile.am Better separate the library dependencies into those required by libcurl 2007-02-17 01:29:01 +00:00
makefile.amiga
Makefile.b32
makefile.dj Don't include zlib headers in dependency output. 2006-08-29 18:13:54 +00:00
Makefile.inc Rob Crittenden added support for NSS (Network Security Service) for the 2007-02-12 22:32:37 +00:00
Makefile.m32 enabled IPV6 builds. 2007-02-15 01:36:35 +00:00
Makefile.netware enabled build with hardcoded ca-bundle path; 2007-01-28 15:31:06 +00:00
Makefile.riscos
Makefile.vc6 Fix misplaced runtime library specification for 'release-dll' target 2006-10-21 16:25:31 +00:00
Makefile.Watcom Dmitriy Sergeyev provided a patch that made the SOCKS[45] code work better as 2006-09-23 19:07:20 +00:00
md5.c
md5.h
memdebug.c curlassert macro replaced with DEBUGASSERT macro defined in setup_once.h 2007-02-21 19:03:20 +00:00
memdebug.h Update copyright year, since the file has been modified 2006-10-27 03:47:57 +00:00
memory.h
mprintf.c compiler warning fix 2007-02-01 01:42:13 +00:00
msvcproj.foot
msvcproj.head
multi.c - Ravi Pratap provided work on libcurl making pipelining more robust and 2007-02-21 21:59:40 +00:00
multiif.h Reported in #1561470 (http://curl.haxx.se/bug/view.cgi?id=1561470), libcurl 2006-09-28 21:26:06 +00:00
netrc.c
netrc.h
nss.c use macros ERRNO, SET_ERRNO(), SOCKERRNO and SET_SOCKERRNO() for errno handling 2007-02-16 18:19:35 +00:00
nssg.h Rob Crittenden added support for NSS (Network Security Service) for the 2007-02-12 22:32:37 +00:00
nwlib.c
parsedate.c Martin Skinner brought back bug report #1230118 to haunt us once again. 2006-12-05 14:57:43 +00:00
parsedate.h
progress.c Update copyright year, since the file has been modified 2006-10-27 03:47:57 +00:00
progress.h
README.ares Update the information about what c-ares version that's required. 1.3.1 had 2006-11-03 10:56:37 +00:00
README.curlx
README.encoding
README.hostip
README.httpauth
README.memoryleak corrected how tests/memanalyze.pl is used 2006-10-29 23:00:52 +00:00
README.multi_socket updated to current status 2006-10-29 09:18:32 +00:00
README.pipelining updated to reflect reality 2006-10-29 09:11:44 +00:00
security.c cleaned up Curl_write() and the sub functions it uses for various protocols. 2006-11-11 21:34:43 +00:00
select.c use macros ERRNO, SET_ERRNO(), SOCKERRNO and SET_SOCKERRNO() for errno handling 2007-02-16 18:19:35 +00:00
select.h Cory Nelson made libcurl use the WSAPoll() function if built for Windows 2006-09-24 10:41:00 +00:00
sendf.c use macros ERRNO, SET_ERRNO(), SOCKERRNO and SET_SOCKERRNO() for errno handling 2007-02-16 18:19:35 +00:00
sendf.h Update copyright year, since the file has been modified 2006-10-27 03:47:57 +00:00
setup_once.h curlassert macro replaced with DEBUGASSERT macro defined in setup_once.h 2007-02-21 19:03:20 +00:00
setup.h curlassert macro replaced with DEBUGASSERT macro defined in setup_once.h 2007-02-21 19:03:20 +00:00
share.c
share.h
sockaddr.h
socks.c Include some possible dependencies of arpa/inet.h 2007-02-21 18:05:38 +00:00
socks.h - Robson Braga Araujo made passive FTP transfers work with SOCKS (both 4 and 2007-02-19 11:53:54 +00:00
speedcheck.c make the low_speed check set the expire timer so that it has a chance to work 2006-10-17 09:05:44 +00:00
speedcheck.h
splay.c Jari Sundell's minor cleanup, added comments and some extra error-checkings 2006-09-04 22:19:13 +00:00
splay.h
ssh.c SCP upload done non-blocking 2007-02-07 22:00:33 +00:00
ssh.h - Armel Asselin improved libcurl to behave a lot better when an easy handle 2007-01-16 22:22:10 +00:00
sslgen.c compiler warning fix 2007-02-13 02:30:31 +00:00
sslgen.h fix compiler warnings for SSL-disabled builds 2007-01-25 21:00:03 +00:00
ssluse.c curlassert macro replaced with DEBUGASSERT macro defined in setup_once.h 2007-02-21 19:03:20 +00:00
ssluse.h - Linus Nielsen Feltzing introduced the --ftp-ssl-ccc command line option to 2007-01-05 23:11:14 +00:00
strdup.c
strdup.h
strequal.c Update copyright year, since the file has been modified 2006-10-27 03:47:57 +00:00
strequal.h
strerror.c curlassert macro replaced with DEBUGASSERT macro defined in setup_once.h 2007-02-21 19:03:20 +00:00
strerror.h
strtok.c
strtok.h
strtoofft.c use macros ERRNO, SET_ERRNO(), SOCKERRNO and SET_SOCKERRNO() for errno handling 2007-02-16 18:19:35 +00:00
strtoofft.h
telnet.c curlassert macro replaced with DEBUGASSERT macro defined in setup_once.h 2007-02-21 19:03:20 +00:00
telnet.h - Armel Asselin improved libcurl to behave a lot better when an easy handle 2007-01-16 22:22:10 +00:00
tftp.c use macros ERRNO, SET_ERRNO(), SOCKERRNO and SET_SOCKERRNO() for errno handling 2007-02-16 18:19:35 +00:00
tftp.h - Armel Asselin improved libcurl to behave a lot better when an easy handle 2007-01-16 22:22:10 +00:00
timeval.c
timeval.h Move header file inclusion logic and definition of timeval 2007-02-20 12:12:27 +00:00
transfer.c - Ravi Pratap provided work on libcurl making pipelining more robust and 2007-02-21 21:59:40 +00:00
transfer.h - Ravi Pratap provided work on libcurl making pipelining more robust and 2007-02-21 21:59:40 +00:00
url.c - Ravi Pratap provided work on libcurl making pipelining more robust and 2007-02-21 21:59:40 +00:00
url.h fogot to change Curl_mk_connc in header file 2007-02-01 11:27:42 +00:00
urldata.h New FTP CCC functionality - adds passive and active mode to accomodate for different server behaviour 2007-02-20 22:02:11 +00:00
vc8proj.foot Use DOS line-endings. 2007-01-29 19:08:04 +00:00
vc8proj.head Use DOS line-endings. 2007-01-29 19:08:04 +00:00
version.c James Housley did lots of work and introduced SFTP downloads. 2006-11-24 22:14:39 +00:00

HTTP Pipelining with libcurl
============================

Background

Since pipelining implies that one or more requests are sent to a server before
the previous response(s) have been received, we only support it for multi
interface use.

Considerations

When using the multi interface, you create one easy handle for each transfer.
Bascially any number of handles can be created, added and used with the multi
interface - simultaneously. It is an interface designed to allow many
simultaneous transfers while still using a single thread. Pipelining does not
change any of these details.

API

We've added a new option to curl_multi_setopt() called CURLMOPT_PIPELINING
that enables "attempted pipelining" and then all easy handles used on that
handle will attempt to use an existing pipeline.

Details

- A pipeline is only created if a previous connection exists to the same IP
  address that the new request is being made to use.

- Pipelines are only supported for HTTP(S) as no other currently supported
  protocol has features resemembling this, but we still name this feature
  plain 'pipelining' to possibly one day support it for other protocols as
  well.

- HTTP Pipelining is for GET and HEAD requests only.

- When a pipeline is in use, we must take precautions so that when used easy
  handles (i.e those who still wait for a response) are removed from the multi
  handle, we must deal with the outstanding response nicely.

- Explicitly asking for pipelining handle X and handle Y won't be supported.
  It isn't easy for an app to do this association. The lib should probably
  still resolve the second one properly to make sure that they actually _can_
  be considered for pipelining. Also, asking for explicit pipelining on handle
  X may be tricky when handle X get a closed connection.

- We need options to control max pipeline length, and probably how to behave
  if we reach that limit. As was discussed on the list, it can probably be
  made very complicated, so perhaps we can think of a way to pass all
  variables involved to a callback and let the application decide how to act
  in specific situations. Either way, these fancy options are only interesting
  to work on when everything is working and we have working apps to test with.