glibc/localedata
Mike FABIAN a7b5eb821d Update to Unicode 16.0.0 [BZ #32168]
Unicode 16.0.0 Support: Character encoding, character type info, and
transliteration tables are all updated to Unicode 16.0.0, using
the generator scripts contributed by Mike FABIAN (Red Hat).

Changes in CHARMAP and WIDTH:

    Total added characters in newly generated CHARMAP: 5185
    Total removed characters in newly generated WIDTH: 1
    Total added characters in newly generated WIDTH: 170

The removed character from WIDTH is U+1171E AHOM CONSONANT SIGN MEDIAL RA.
It changed like this:

UnicodeData.txt 15.1.0: 1171E;AHOM CONSONANT SIGN MEDIAL RA;Mn;0;NSM;;;;;N;;;;;
UnicodeData.txt 16.0.0: 1171E;AHOM CONSONANT SIGN MEDIAL RA;Mc;0;L;;;;;N;;;;;

EastAsianWidth.txt 15.1.0: 1171D..1171F   ; N  # Mn     [3] AHOM CONSONANT SIGN MEDIAL LA..AHOM CONSONANT SIGN MEDIAL LIGATING RA
EastAsianWidth.txt 16.0.0: 1171E          ; N  # Mc         AHOM CONSONANT SIGN MEDIAL RA

I.e it changed from Mn (Mark Nonspacing) to Mc (Mark Spacing
combining). So it should now have width 1 instead of 0, therefore it
is OK that it was removed from WIDTH, characters not in WIDTH get
width 1 by default.

Nothing suspicious when browsing the list of the 170 added characters.

Changes in ctype:

    alpha: Added 4452 characters in new ctype which were not in old ctype
    combining: Added 51 characters in new ctype which were not in old ctype
    combining_level3: Added 43 characters in new ctype which were not in old ctype
    graph: Added 5185 characters in new ctype which were not in old ctype
    lower: Added 25 characters in new ctype which were not in old ctype
    print: Added 5185 characters in new ctype which were not in old ctype
    punct: Missing 33 characters of old ctype in new ctype
    punct: Added 766 characters in new ctype which were not in old ctype
    tolower: Added 27 characters in new ctype which were not in old ctype
    totitle: Added 27 characters in new ctype which were not in old ctype
    toupper: Added 27 characters in new ctype which were not in old ctype
    upper: Added 27 characters in new ctype which were not in old ctype

Nothing suspicous in the additions.

About the 33 characters removed from `punct`:

U+0363 - U+036F are identical in UnicodeData.txt. Difference in DerivedCoreProperties.txt:

DerivedCoreProperties.txt 15.1.0: not there.
DerivedCoreProperties.txt 16.0.0: 0363..036F    ; Alphabetic # Mn  [13] COMBINING LATIN SMALL LETTER A..COMBINING LATIN SMALL LETTER X

So that’s the reason why they are added to `alpha` and removed from `punct`.

Same for U+1DD3 - U+1DE6, they are identical in UnicodeData.txt but there is a difference in DerivedCoreProperties.txt:

DerivedCoreProperties.txt 15.1.0: 1DE7..1DF4    ; Alphabetic # Mn  [14] COMBINING LATIN SMALL LETTER ALPHA..COMBINING LATIN SMALL LETTER U WITH DIAERESIS
DerivedCoreProperties.txt 16.0.0: 1DD3..1DF4    ; Alphabetic # Mn  [34] COMBINING LATIN SMALL LETTER FLATTENED OPEN A ABOVE..COMBINING LATIN SMALL LETTER U WITH DIAERESIS

So they became `Alphabetic` and were thus added to `alpha` and removed from `punct`.

Resolves: BZ #32168

Reviewed-by: Carlos O'Donell <carlos@redhat.com>
2024-09-27 14:43:38 +02:00
..
charmaps Update to Unicode 16.0.0 [BZ #32168] 2024-09-27 14:43:38 +02:00
locales Update to Unicode 16.0.0 [BZ #32168] 2024-09-27 14:43:38 +02:00
tests Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tests-mbwc tests-mbwc: Silence gcc 14 -Werror=format-overflow= 2024-06-27 16:49:26 +02:00
tst-fmon-locales
tst-localedef-hardlinks.root
unicode-gen Update to Unicode 16.0.0 [BZ #32168] 2024-09-27 14:43:38 +02:00
am_ET.UTF-8.in
az_AZ.UTF-8.in
be_BY.UTF-8.in
ber_DZ.UTF-8.in
ber_MA.UTF-8.in
bg_BG.UTF-8.in
br_FR.UTF-8.in
bs_BA.UTF-8.in
bug-iconv-trans.c
bug-setlocale1-static.c
bug-setlocale1.c
bug-usesetlocale.c
C.UTF-8.in
ckb_IQ.UTF-8.in
cmn_TW.UTF-8.in
collate-test.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
crh_UA.UTF-8.in
cs_CZ.in
cs_CZ.UTF-8.in
csb_PL.UTF-8.in
cv_RU.UTF-8.in localedata: cv_RU: update translation 2024-05-23 14:39:35 +02:00
cy_GB.UTF-8.in
da_DK.ISO-8859-1.in
de_DE.ISO-8859-1.in
Depend
dsb_DE.UTF-8.in
dump-ctype.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
dz_BT.UTF-8.in
en_US.ISO-8859-1.in
en_US.UTF-8.in
eo.UTF-8.in
es_ES.UTF-8.in
et_EE.UTF-8.in
fa_IR.UTF-8.in
fi_FI.UTF-8.in
fil_PH.UTF-8.in
fr_CA.UTF-8.in
fr_FR.UTF-8.in
fur_IT.UTF-8.in
gen-locale.sh locale: Handle loading a missing locale twice (Bug 14247) 2024-04-22 16:03:00 -04:00
gez_ER.UTF-8@abegede.in
ha_NG.UTF-8.in
hr_HR.ISO-8859-2.in
hr_HR.UTF-8.in
hsb_DE.UTF-8.in
hu_HU.UTF-8.in
ig_NG.UTF-8.in
ik_CA.UTF-8.in
is_IS.UTF-8.in
kk_KZ.UTF-8.in
ku_TR.UTF-8.in
ky_KG.UTF-8.in
ln_CD.UTF-8.in
lt_LT.UTF-8.in
ltg_LV.UTF-8.in Define ISO 639-3 "ltg" (Latgalian) and add ltg_LV locale 2024-06-17 10:53:16 +02:00
lv_LV.UTF-8.in Change lv_LV collation to agree with the recent change in CLDR 2024-02-08 08:13:37 +01:00
Makefile Define ISO 639-3 "ltg" (Latgalian) and add ltg_LV locale 2024-06-17 10:53:16 +02:00
mdf_RU.UTF-8.in localedata: add mdf_RU locale 2024-05-08 14:27:40 +02:00
mi_NZ.UTF-8.in
ml_IN.UTF-8.in
mn_MN.UTF-8.in
mr_IN.UTF-8.in
mt_MT.UTF-8.in
nan_TW.UTF-8@latin.in
nb_NO.UTF-8.in
om_KE.UTF-8.in
or_IN.UTF-8.in
os_RU.UTF-8.in
pl_PL.UTF-8.in
ps_AF.UTF-8.in
README
rif_MA.UTF-8.in
ro_RO.UTF-8.in
ru_RU.UTF-8.in
sah_RU.UTF-8.in
sc_IT.UTF-8.in
se_NO.UTF-8.in
show-ucs-data.c
si_LK.UTF-8.in
sort-test.sh Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
sq_AL.UTF-8.in
sr_RS.UTF-8.in
SUPPORTED Define ISO 639-3 "ltg" (Latgalian) and add ltg_LV locale 2024-06-17 10:53:16 +02:00
sv_SE.ISO-8859-1.in
sv_SE.UTF-8.in
syr.UTF-8.in
szl_PL.UTF-8.in
tg_TJ.UTF-8.in
th_TH.UTF-8.in Adapt collation in th_TH locale to use the iso14651_t1_common file and sync the collation with CLDR 2023-09-21 10:34:35 +02:00
tk_TM.UTF-8.in
tr_TR.UTF-8.in
tst-c-utf8-consistency.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-ctype-de_DE.ISO-8859-1.in
tst-ctype.c support: Add FAIL test failure helper 2024-07-26 13:21:34 +01:00
tst-ctype.sh Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-digits.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-fmon.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-fmon.data Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-fmon.sh Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-iconv-emojis-trans.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-iconv-math-trans.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-langinfo-newlocale-static.c
tst-langinfo-newlocale.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-langinfo-setlocale-static.c
tst-langinfo-setlocale.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-langinfo-static.c
tst-langinfo.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-langinfo.sh Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-leaks.c
tst-locale-loadlocale.c locale: Handle loading a missing locale twice (Bug 14247) 2024-04-22 16:03:00 -04:00
tst-locale.sh Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-localedef-hardlinks.c support: Use macros for *stat wrappers 2024-08-16 16:05:20 +02:00
tst-mbswcs1.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-mbswcs2.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-mbswcs3.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-mbswcs4.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-mbswcs5.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-mbswcs6.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-numeric.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-numeric.data Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-numeric.sh Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-rpmatch.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-rpmatch.sh Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-setlocale2.c
tst-setlocale3.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-setlocale.c
tst-sscanf.c
tst-strfmon1.c
tst-trans.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-trans.sh Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-wctype.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
tst-wctype.input
tst-xlocale1.c
tst-xlocale2.c
tt_RU.UTF-8.in
tt_RU.UTF-8@iqtelif.in
ug_CN.UTF-8.in
uk_UA.UTF-8.in
uz_UZ.UTF-8.in
vi_VN.UTF-8.in
xfrm-test.c Update copyright dates with scripts/update-copyrights 2024-01-01 10:53:40 -08:00
yi_US.UTF-8.in
yo_NG.UTF-8.in
zh_CN.UTF-8.in

		       POSIX locale descriptions
				  and
		    POSIX character set descriptions

Ulrich Drepper			Time-stamp: <2004/11/27 13:06:54 drepper>
drepper@redhat.com


This directory contains the data needed to build the locale data files
to use the internationalization features of the GNU libc.

POSIX.2 describes the `localedef' utility which is part of the GNU libc.
You need this program to "compile" the locale description in a form
suitable for fast access by the GNU libc functions.  Any compilation is
based on a given character set.

Once you run `make install' for the GNU libc the data files are
automatically installed in the right place, ready for use by the
`localedef' program.

To compile the locale data files you simply have to decide which locale
(based on the location and the language) and which character set you
use.  E.g., French speaking Canadians would use the locale `fr_CA' and
the character set `ISO_8859-1,1987'.  Calling `localedef' to get the
desired data should happen like this:

	localedef -i fr_CA -f ISO-8859-1 fr_CA

This will place the 6 output files in the appropriate directory where
the GNU libc functions can find them.  Please note that you need
permission to write to this directory ($(prefix)/share/locale, where
$(prefix) is the value you specified while configuring GNU libc).  If
you do not have the necessary permissions, you can write the files into an
arbitrary directory by giving a path including a '/' character instead
of `fr_CA'.  E.g., to put the new files in a subdirectory of the
current directory simply use

	localedef -i fr_CA -f ISO-8859-1 ./fr_CA

How to use these data files is described in the GNU libc manual,
especially in the section describing the `setlocale' function.

All problems should be reported using

  https://sourceware.org/bugzilla/


One more note: the `POSIX' locale definition is not meant to be used
as an input file for `localedef'.  It is rather there to show the
values with are built in the libc binaries as default values when no
legal locale is found or the "C" or "POSIX" locale is selected.


		       The collation test suite
		       ########################

This package also contains a (beginning of a) test suite for the
collation functions in the GNU libc.  The files are provided sorted.
The test program shuffles the lines and sort them afterwards.

Some of the files are provided in 8bit form, i.e., not only ASCII
characters.  So the tools you use to process the files should be 8bit
clean.

To run the test program the appropriate locale information must be
installed.  Therefore the localedef program is used to generate this
data used the locale and charmap description files contained here.
Since we cannot run the localedef program in case of cross-compilation
no tests at all are performed.


~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Local Variables:
 mode:text
 eval:(load-library "time-stamp")
 eval:(make-local-variable 'write-file-hooks)
 eval:(add-hook 'write-file-hooks 'time-stamp)
 eval:(setq time-stamp-format '(time-stamp-yyyy/mm/dd time-stamp-hh:mm:ss user-login-name))
End: