netcdf-c/libnczarr
Dennis Heimbigner 5fa2defc7e Improve fetch performance of DAP4
Prior to this PR, DAP4 always fetched the whole (constrained) dataset
This PR changes the query processing so
1. It reads data on a per-variable request (equivalent to calling nc_get_var()).
2. It tracks a response for every query.

Most of the changes reflect having to do per-variable requests.
In any case, doing all this significantly reduces the amount of data transmitted and hence speeds up DAP4 requests.
2023-10-08 19:59:28 -06:00
..
obsolete Add filter support to NCZarr 2021-09-02 17:04:26 -06:00
CMakeLists.txt CMake: Ensure all libraries link against MPI if needed 2023-10-02 10:31:24 +01:00
Makefile.am Improve S3 Documentation and Support 2023-04-25 17:15:06 -06:00
SimpleBinStream.h This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
zarr.c Improve fetch performance of DAP4 2023-10-08 19:59:28 -06:00
zarr.h Improve fetch performance of DAP4 2023-10-08 19:59:28 -06:00
zattr.c Improve performance of the nc_reclaim_data and nc_copy_data functions. 2023-05-20 17:11:25 -06:00
zcache.h Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zchunking.c Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zchunking.h Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zclose.c Improve fetch performance of DAP4 2023-10-08 19:59:28 -06:00
zcreate.c Improve fetch performance of DAP4 2023-10-08 19:59:28 -06:00
zcvt.c Fix some problems with PR https://github.com/Unidata/netcdf-c/pull/2492 2022-09-03 14:21:48 -06:00
zdebug.c Fix byterange handling of some URLS 2023-03-02 19:51:02 -07:00
zdebug.h Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zdim.c Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zdispatch.c Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zdispatch.h Enhance/Fix filter support 2022-03-14 12:39:37 -06:00
zfile.c Merge branch 'main' into bloscfix.dmh 2022-09-06 13:49:18 -06:00
zfilter.c Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zfilter.h I made a major update to this PR with the following changes: 2022-05-19 22:00:40 -06:00
zgrp.c Provide a Number of fixes/improvements to NCZarr 2020-11-19 17:01:04 -07:00
zincludes.h Improve S3 Documentation and Support 2023-04-25 17:15:06 -06:00
zinternal.c Improve performance of the nc_reclaim_data and nc_copy_data functions. 2023-05-20 17:11:25 -06:00
zinternal.h Improve fetch performance of DAP4 2023-10-08 19:59:28 -06:00
zmap_file.c Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zmap_s3sdk.c Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zmap_zip.c Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zmap.c Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zmap.h Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zodom.c Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zodom.h Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zopen.c Improve fetch performance of DAP4 2023-10-08 19:59:28 -06:00
zprov.c Additional Fixes to NCZarr 2020-12-16 20:48:02 -07:00
zprovenance.h This PR adds EXPERIMENTAL support for accessing data in the 2020-06-28 18:02:47 -06:00
zs3sdk.cpp Significantly Improve Amazon S3 Cloud Storage Support 2021-09-27 18:36:33 -06:00
zsync.c Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
ztype.c Improve performance of the nc_reclaim_data and nc_copy_data functions. 2023-05-20 17:11:25 -06:00
zutil.c Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zvar.c Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zwalk.c Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00
zxcache.c Mitigate S3 test interference + Unlimited Dimensions in NCZarr 2023-09-26 16:56:48 -06:00