netcdf-c/nc_perf
Dennis Heimbigner 36102e3c32 Improve UTF8 Support On Windows
re: Issue https://github.com/Unidata/netcdf-c/issues/2190

The primary purpose of this PR is to improve the utf8 support
for windows. This is persuant to a change in Windows that
supports utf8 natively (almost). The almost means that it is
still utf16 internally and the set of characters representable
by utf8 is larger than those representable by utf16.

This leaves open the question in the Issue about handling
the Windows 1252 character set.

This required the following changes:

1. Test the Windows build and major version in order to see if
   native utf8 is supported.
2. If native utf8 is supported, Modify dpathmgr.c to call the 8-bit
   version of the windows fopen() and open() functions.
3. In support of this, programs that use XGetOpt (Windows versions)
   need to get the command line as utf8 and then parse to
   arc+argv as utf8. This requires using a homegrown command line parser
   named XCommandLineToArgvA.
4. Add a utility program called "acpget" that prints out the
   current Windows code page and locale.

Additionally, some technical debt was cleaned up as follows:

1. Unify all the places which attempt to read all or a part
   of a file into the dutil.c#NC_readfile code.
2. Similary unify all the code that creates temp files into
   dutil.c#NC_mktmp code.
3. Convert almost all remaining calls to fopen() and open()
   to NCfopen() and NCopen3(). This is to ensure that path management
   is used consistently. This touches a number of files.
4. extern->EXTERNL as needed to get it to work under Windows.
2022-02-08 20:53:30 -07:00
..
bigmeta.c moving metadata performance tests to nc_perf 2019-03-18 08:30:14 -06:00
bm_file.c cleanup of 2d decomposition 2020-07-04 10:31:12 -06:00
bm_many_atts.c
bm_many_objs.c
bm_netcdf4_recs.c
CMakeLists.txt Additional Fixes to NCZarr 2020-12-16 20:48:02 -07:00
gfs_sample.cdl further development 2020-07-01 12:26:12 -06:00
Makefile.am now setting deflate_level to zero does not turn on deflate 2021-11-27 07:40:02 -07:00
openbigmeta.c moving metadata performance tests to nc_perf 2019-03-18 08:30:14 -06:00
perftest.sh Updated call to NC4_read_provenance. 2019-04-18 10:53:16 -06:00
run_bm_elena.sh Spelling fixes 2019-09-18 08:03:01 -06:00
run_bm_test1.sh got distcheck target working 2019-03-18 10:15:18 -06:00
run_bm_test2.sh got distcheck target working 2019-03-18 10:15:18 -06:00
run_gfs_test.sh.in now setting deflate_level to zero does not turn on deflate 2021-11-27 07:40:02 -07:00
run_knmi_bm.sh moved many other benchmark tests to nc_perf 2019-03-17 10:57:00 -06:00
run_par_bm_test.sh.in fixed warnings in tst_create_files.c 2020-06-30 10:40:05 -06:00
run_tst_chunks.sh moved many other benchmark tests to nc_perf 2019-03-17 10:57:00 -06:00
tst_ar4_3d.c
tst_ar4_4d.c
tst_ar4.c
tst_attsperf.c ange H5F_CLOSE_SEMI -> H5F_CLOSE_WEAK for netcdf related tests 2020-09-02 21:29:26 +02:00
tst_bm_rando.c improved docs for cache functions, added libhdf5/hdf5cache.c to Doxyfile.in, added benchmark program for cache settings 2019-11-25 16:33:04 -07:00
tst_chunks3.c 1. Fix an additional flaw in fill_value handling where non-atomic default values were not properly being handled. 2022-01-10 22:26:19 -07:00
tst_compress_par.c Improve UTF8 Support On Windows 2022-02-08 20:53:30 -07:00
tst_compress.c Improve UTF8 Support On Windows 2022-02-08 20:53:30 -07:00
tst_create_files.c Additional Fixes to NCZarr 2020-12-16 20:48:02 -07:00
tst_files2.c Improve UTF8 Support On Windows 2022-02-08 20:53:30 -07:00
tst_files3.c Improve UTF8 Support On Windows 2022-02-08 20:53:30 -07:00
tst_h_many_atts.c
tst_knmi.c
tst_mem1.c remove nc_perf/tst_mem1 from tests run 2021-08-09 13:43:17 -06:00
tst_mem.c Improve UTF8 Support On Windows 2022-02-08 20:53:30 -07:00
tst_utils.c
tst_wrf_reads.c change to trigger CI 2019-03-21 13:35:49 -06:00