Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Miscellaneous historical and para-IPA modifier letters #849

Draft
wants to merge 20 commits into
base: diffbase-for-miscellaneous-historical-and-para-IPA-modifier-letters
Choose a base branch
from
Draft

Miscellaneous historical and para-IPA modifier letters #849

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
81dcf2e
UnicodeData.txt lines from Kirk
eggrobin Jun 5, 2024
11eb244
lb=AL
eggrobin Jun 5, 2024
da0798c
Latin
eggrobin Jun 5, 2024
c0b22dd
Diacritic for the modifier letters
eggrobin Jun 5, 2024
d246c4c
Regenerate UCD
eggrobin Jun 5, 2024
db75d4d
DoNotEmit.txt lines from Kirk
eggrobin Jun 5, 2024
2ae5fa8
Other_Lowercase
eggrobin Jun 5, 2024
6fcff9d
Regenerate UCD
eggrobin Jun 5, 2024
8f6e8f4
Merge remote-tracking branch 'la-vache/main' into miscellaneous-histo…
eggrobin Jun 6, 2024
b5bc73e
Millerian reshuffling
eggrobin Jul 25, 2024
f170bf0
Regenerate UCD
eggrobin Jul 25, 2024
1c1dbbf
Merge branch 'diffbase-for-miscellaneous-historical-and-para-IPA-modi…
eggrobin Jul 25, 2024
20d5615
Merge branch '8-affricate-ligatures' into miscellaneous-historical-an…
eggrobin Aug 15, 2024
e116606
A test that fails sensibly.
eggrobin Aug 15, 2024
d31d80b
Soft_Dotted
eggrobin Aug 15, 2024
854753f
Regenerate UCD
eggrobin Aug 15, 2024
fcaadde
Merge remote-tracking branch 'la-vache/main' into miscellaneous-histo…
eggrobin Oct 15, 2024
c6ecabc
Merge branch 'diffbase-for-miscellaneous-historical-and-para-IPA-modi…
eggrobin Oct 15, 2024
69a376c
Python 3.8 reached eol (#948)
eggrobin Oct 15, 2024
af57359
Merge remote-tracking branch 'la-vache/main' into miscellaneous-histo…
eggrobin Oct 16, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/pythonpackage.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python-version: [3.8]
python-version: [3.12]

steps:
- uses: actions/checkout@v3
Expand Down
6 changes: 4 additions & 2 deletions unicodetools/data/ucd/dev/DerivedAge.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# DerivedAge-17.0.0.txt

Check warning on line 1 in unicodetools/data/ucd/dev/DerivedAge.txt

View workflow job for this annotation

GitHub Actions / Draft unless approved

Not in the 17.0 pipeline 

While the Unicode Technical Committee has provisionally assigned these
characters, they have not been accepted for Unicode 17.0, nor for any
specific version of Unicode.

The Age property values for new characters are likely incorrect right
now. They will be recomputed after the UTC accepts their encoding and
this pull request is updated for the target version.
# Date: 2024-10-15, 01:32:01 GMT
# Date: 2024-10-15, 01:37:57 GMT
# © 2024 Unicode®, Inc.
# Unicode and the Unicode Logo are registered trademarks of Unicode, Inc. in the U.S. and other countries.
# For terms of use and license, see https://www.unicode.org/terms_of_use.html
Expand Down Expand Up @@ -2067,7 +2067,9 @@

1DF1F..1DF24 ; 17.0 # [6] LATIN SMALL LETTER D-ETH DIGRAPH..LATIN SMALL LETTER T-THETA DIGRAPH
1DF2B..1DF2C ; 17.0 # [2] LATIN SMALL LETTER DEZH DIGRAPH WITH CURL..LATIN SMALL LETTER TESH DIGRAPH WITH CURL
1DF3E..1DF3F ; 17.0 # [2] LATIN SMALL LETTER BARRED TURNED H..LATIN SMALL LETTER BARRED W
1DFD8..1DFE8 ; 17.0 # [17] MODIFIER LETTER SMALL BARRED TURNED H..MODIFIER LETTER SMALL CAPITAL D

# Total code points: 8
# Total code points: 27

# EOF
37 changes: 27 additions & 10 deletions unicodetools/data/ucd/dev/DerivedCoreProperties.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# DerivedCoreProperties-17.0.0.txt
# Date: 2024-10-15, 01:32:34 GMT
# Date: 2024-10-15, 01:38:32 GMT
# © 2024 Unicode®, Inc.
# Unicode and the Unicode Logo are registered trademarks of Unicode, Inc. in the U.S. and other countries.
# For terms of use and license, see https://www.unicode.org/terms_of_use.html
Expand Down Expand Up @@ -1370,6 +1370,8 @@ FFDA..FFDC ; Alphabetic # Lo [3] HALFWIDTH HANGUL LETTER EU..HALFWIDTH HANG
1DF00..1DF09 ; Alphabetic # L& [10] LATIN SMALL LETTER FENG DIGRAPH WITH TRILL..LATIN SMALL LETTER T WITH HOOK AND RETROFLEX HOOK
1DF0A ; Alphabetic # Lo LATIN LETTER RETROFLEX CLICK WITH RETROFLEX HOOK
1DF0B..1DF2C ; Alphabetic # L& [34] LATIN SMALL LETTER ESH WITH DOUBLE BAR..LATIN SMALL LETTER TESH DIGRAPH WITH CURL
1DF3E..1DF3F ; Alphabetic # L& [2] LATIN SMALL LETTER BARRED TURNED H..LATIN SMALL LETTER BARRED W
1DFD8..1DFE8 ; Alphabetic # Lm [17] MODIFIER LETTER SMALL BARRED TURNED H..MODIFIER LETTER SMALL CAPITAL D
1E000..1E006 ; Alphabetic # Mn [7] COMBINING GLAGOLITIC LETTER AZU..COMBINING GLAGOLITIC LETTER ZHIVETE
1E008..1E018 ; Alphabetic # Mn [17] COMBINING GLAGOLITIC LETTER ZEMLJA..COMBINING GLAGOLITIC LETTER HERU
1E01B..1E021 ; Alphabetic # Mn [7] COMBINING GLAGOLITIC LETTER SHTA..COMBINING GLAGOLITIC LETTER YATI
Expand Down Expand Up @@ -1440,7 +1442,7 @@ FFDA..FFDC ; Alphabetic # Lo [3] HALFWIDTH HANGUL LETTER EU..HALFWIDTH HANG
30000..3134A ; Alphabetic # Lo [4939] CJK UNIFIED IDEOGRAPH-30000..CJK UNIFIED IDEOGRAPH-3134A
31350..323AF ; Alphabetic # Lo [4192] CJK UNIFIED IDEOGRAPH-31350..CJK UNIFIED IDEOGRAPH-323AF

# Total code points: 142767
# Total code points: 142786

# ================================================

Expand Down Expand Up @@ -2134,10 +2136,12 @@ FF41..FF5A ; Lowercase # L& [26] FULLWIDTH LATIN SMALL LETTER A..FULLWIDTH L
1D7CB ; Lowercase # L& MATHEMATICAL BOLD SMALL DIGAMMA
1DF00..1DF09 ; Lowercase # L& [10] LATIN SMALL LETTER FENG DIGRAPH WITH TRILL..LATIN SMALL LETTER T WITH HOOK AND RETROFLEX HOOK
1DF0B..1DF2C ; Lowercase # L& [34] LATIN SMALL LETTER ESH WITH DOUBLE BAR..LATIN SMALL LETTER TESH DIGRAPH WITH CURL
1DF3E..1DF3F ; Lowercase # L& [2] LATIN SMALL LETTER BARRED TURNED H..LATIN SMALL LETTER BARRED W
1DFD8..1DFE8 ; Lowercase # Lm [17] MODIFIER LETTER SMALL BARRED TURNED H..MODIFIER LETTER SMALL CAPITAL D
1E030..1E06D ; Lowercase # Lm [62] MODIFIER LETTER CYRILLIC SMALL A..MODIFIER LETTER CYRILLIC SMALL STRAIGHT U WITH STROKE
1E922..1E943 ; Lowercase # L& [34] ADLAM SMALL LETTER ALIF..ADLAM SMALL LETTER SHA

# Total code points: 2577
# Total code points: 2596

# ================================================

Expand Down Expand Up @@ -2979,13 +2983,15 @@ FF41..FF5A ; Cased # L& [26] FULLWIDTH LATIN SMALL LETTER A..FULLWIDTH LATIN
1D7C4..1D7CB ; Cased # L& [8] MATHEMATICAL SANS-SERIF BOLD ITALIC EPSILON SYMBOL..MATHEMATICAL BOLD SMALL DIGAMMA
1DF00..1DF09 ; Cased # L& [10] LATIN SMALL LETTER FENG DIGRAPH WITH TRILL..LATIN SMALL LETTER T WITH HOOK AND RETROFLEX HOOK
1DF0B..1DF2C ; Cased # L& [34] LATIN SMALL LETTER ESH WITH DOUBLE BAR..LATIN SMALL LETTER TESH DIGRAPH WITH CURL
1DF3E..1DF3F ; Cased # L& [2] LATIN SMALL LETTER BARRED TURNED H..LATIN SMALL LETTER BARRED W
1DFD8..1DFE8 ; Cased # Lm [17] MODIFIER LETTER SMALL BARRED TURNED H..MODIFIER LETTER SMALL CAPITAL D
1E030..1E06D ; Cased # Lm [62] MODIFIER LETTER CYRILLIC SMALL A..MODIFIER LETTER CYRILLIC SMALL STRAIGHT U WITH STROKE
1E900..1E943 ; Cased # L& [68] ADLAM CAPITAL LETTER ALIF..ADLAM SMALL LETTER SHA
1F130..1F149 ; Cased # So [26] SQUARED LATIN CAPITAL LETTER A..SQUARED LATIN CAPITAL LETTER Z
1F150..1F169 ; Cased # So [26] NEGATIVE CIRCLED LATIN CAPITAL LETTER A..NEGATIVE CIRCLED LATIN CAPITAL LETTER Z
1F170..1F189 ; Cased # So [26] NEGATIVE SQUARED LATIN CAPITAL LETTER A..NEGATIVE SQUARED LATIN CAPITAL LETTER Z

# Total code points: 4586
# Total code points: 4605

# ================================================

Expand Down Expand Up @@ -3480,6 +3486,7 @@ FFF9..FFFB ; Case_Ignorable # Cf [3] INTERLINEAR ANNOTATION ANCHOR..INTERLI
1DA84 ; Case_Ignorable # Mn SIGNWRITING LOCATION HEAD NECK
1DA9B..1DA9F ; Case_Ignorable # Mn [5] SIGNWRITING FILL MODIFIER-2..SIGNWRITING FILL MODIFIER-6
1DAA1..1DAAF ; Case_Ignorable # Mn [15] SIGNWRITING ROTATION MODIFIER-2..SIGNWRITING ROTATION MODIFIER-16
1DFD8..1DFE8 ; Case_Ignorable # Lm [17] MODIFIER LETTER SMALL BARRED TURNED H..MODIFIER LETTER SMALL CAPITAL D
1E000..1E006 ; Case_Ignorable # Mn [7] COMBINING GLAGOLITIC LETTER AZU..COMBINING GLAGOLITIC LETTER ZHIVETE
1E008..1E018 ; Case_Ignorable # Mn [17] COMBINING GLAGOLITIC LETTER ZEMLJA..COMBINING GLAGOLITIC LETTER HERU
1E01B..1E021 ; Case_Ignorable # Mn [7] COMBINING GLAGOLITIC LETTER SHTA..COMBINING GLAGOLITIC LETTER YATI
Expand All @@ -3502,7 +3509,7 @@ E0001 ; Case_Ignorable # Cf LANGUAGE TAG
E0020..E007F ; Case_Ignorable # Cf [96] TAG SPACE..CANCEL TAG
E0100..E01EF ; Case_Ignorable # Mn [240] VARIATION SELECTOR-17..VARIATION SELECTOR-256

# Total code points: 2749
# Total code points: 2766

# ================================================

Expand Down Expand Up @@ -6898,6 +6905,8 @@ FFDA..FFDC ; ID_Start # Lo [3] HALFWIDTH HANGUL LETTER EU..HALFWIDTH HANGUL
1DF00..1DF09 ; ID_Start # L& [10] LATIN SMALL LETTER FENG DIGRAPH WITH TRILL..LATIN SMALL LETTER T WITH HOOK AND RETROFLEX HOOK
1DF0A ; ID_Start # Lo LATIN LETTER RETROFLEX CLICK WITH RETROFLEX HOOK
1DF0B..1DF2C ; ID_Start # L& [34] LATIN SMALL LETTER ESH WITH DOUBLE BAR..LATIN SMALL LETTER TESH DIGRAPH WITH CURL
1DF3E..1DF3F ; ID_Start # L& [2] LATIN SMALL LETTER BARRED TURNED H..LATIN SMALL LETTER BARRED W
1DFD8..1DFE8 ; ID_Start # Lm [17] MODIFIER LETTER SMALL BARRED TURNED H..MODIFIER LETTER SMALL CAPITAL D
1E030..1E06D ; ID_Start # Lm [62] MODIFIER LETTER CYRILLIC SMALL A..MODIFIER LETTER CYRILLIC SMALL STRAIGHT U WITH STROKE
1E100..1E12C ; ID_Start # Lo [45] NYIAKENG PUACHUE HMONG LETTER MA..NYIAKENG PUACHUE HMONG LETTER W
1E137..1E13D ; ID_Start # Lm [7] NYIAKENG PUACHUE HMONG SIGN FOR PERSON..NYIAKENG PUACHUE HMONG SYLLABLE LENGTHENER
Expand Down Expand Up @@ -6958,7 +6967,7 @@ FFDA..FFDC ; ID_Start # Lo [3] HALFWIDTH HANGUL LETTER EU..HALFWIDTH HANGUL
30000..3134A ; ID_Start # Lo [4939] CJK UNIFIED IDEOGRAPH-30000..CJK UNIFIED IDEOGRAPH-3134A
31350..323AF ; ID_Start # Lo [4192] CJK UNIFIED IDEOGRAPH-31350..CJK UNIFIED IDEOGRAPH-323AF

# Total code points: 141277
# Total code points: 141296

# ================================================

Expand Down Expand Up @@ -8285,6 +8294,8 @@ FFDA..FFDC ; ID_Continue # Lo [3] HALFWIDTH HANGUL LETTER EU..HALFWIDTH HAN
1DF00..1DF09 ; ID_Continue # L& [10] LATIN SMALL LETTER FENG DIGRAPH WITH TRILL..LATIN SMALL LETTER T WITH HOOK AND RETROFLEX HOOK
1DF0A ; ID_Continue # Lo LATIN LETTER RETROFLEX CLICK WITH RETROFLEX HOOK
1DF0B..1DF2C ; ID_Continue # L& [34] LATIN SMALL LETTER ESH WITH DOUBLE BAR..LATIN SMALL LETTER TESH DIGRAPH WITH CURL
1DF3E..1DF3F ; ID_Continue # L& [2] LATIN SMALL LETTER BARRED TURNED H..LATIN SMALL LETTER BARRED W
1DFD8..1DFE8 ; ID_Continue # Lm [17] MODIFIER LETTER SMALL BARRED TURNED H..MODIFIER LETTER SMALL CAPITAL D
1E000..1E006 ; ID_Continue # Mn [7] COMBINING GLAGOLITIC LETTER AZU..COMBINING GLAGOLITIC LETTER ZHIVETE
1E008..1E018 ; ID_Continue # Mn [17] COMBINING GLAGOLITIC LETTER ZEMLJA..COMBINING GLAGOLITIC LETTER HERU
1E01B..1E021 ; ID_Continue # Mn [7] COMBINING GLAGOLITIC LETTER SHTA..COMBINING GLAGOLITIC LETTER YATI
Expand Down Expand Up @@ -8365,7 +8376,7 @@ FFDA..FFDC ; ID_Continue # Lo [3] HALFWIDTH HANGUL LETTER EU..HALFWIDTH HAN
31350..323AF ; ID_Continue # Lo [4192] CJK UNIFIED IDEOGRAPH-31350..CJK UNIFIED IDEOGRAPH-323AF
E0100..E01EF ; ID_Continue # Mn [240] VARIATION SELECTOR-17..VARIATION SELECTOR-256

# Total code points: 144549
# Total code points: 144568

# ================================================

Expand Down Expand Up @@ -9082,6 +9093,8 @@ FFDA..FFDC ; XID_Start # Lo [3] HALFWIDTH HANGUL LETTER EU..HALFWIDTH HANGU
1DF00..1DF09 ; XID_Start # L& [10] LATIN SMALL LETTER FENG DIGRAPH WITH TRILL..LATIN SMALL LETTER T WITH HOOK AND RETROFLEX HOOK
1DF0A ; XID_Start # Lo LATIN LETTER RETROFLEX CLICK WITH RETROFLEX HOOK
1DF0B..1DF2C ; XID_Start # L& [34] LATIN SMALL LETTER ESH WITH DOUBLE BAR..LATIN SMALL LETTER TESH DIGRAPH WITH CURL
1DF3E..1DF3F ; XID_Start # L& [2] LATIN SMALL LETTER BARRED TURNED H..LATIN SMALL LETTER BARRED W
1DFD8..1DFE8 ; XID_Start # Lm [17] MODIFIER LETTER SMALL BARRED TURNED H..MODIFIER LETTER SMALL CAPITAL D
1E030..1E06D ; XID_Start # Lm [62] MODIFIER LETTER CYRILLIC SMALL A..MODIFIER LETTER CYRILLIC SMALL STRAIGHT U WITH STROKE
1E100..1E12C ; XID_Start # Lo [45] NYIAKENG PUACHUE HMONG LETTER MA..NYIAKENG PUACHUE HMONG LETTER W
1E137..1E13D ; XID_Start # Lm [7] NYIAKENG PUACHUE HMONG SIGN FOR PERSON..NYIAKENG PUACHUE HMONG SYLLABLE LENGTHENER
Expand Down Expand Up @@ -9142,7 +9155,7 @@ FFDA..FFDC ; XID_Start # Lo [3] HALFWIDTH HANGUL LETTER EU..HALFWIDTH HANGU
30000..3134A ; XID_Start # Lo [4939] CJK UNIFIED IDEOGRAPH-30000..CJK UNIFIED IDEOGRAPH-3134A
31350..323AF ; XID_Start # Lo [4192] CJK UNIFIED IDEOGRAPH-31350..CJK UNIFIED IDEOGRAPH-323AF

# Total code points: 141254
# Total code points: 141273

# ================================================

Expand Down Expand Up @@ -10470,6 +10483,8 @@ FFDA..FFDC ; XID_Continue # Lo [3] HALFWIDTH HANGUL LETTER EU..HALFWIDTH HA
1DF00..1DF09 ; XID_Continue # L& [10] LATIN SMALL LETTER FENG DIGRAPH WITH TRILL..LATIN SMALL LETTER T WITH HOOK AND RETROFLEX HOOK
1DF0A ; XID_Continue # Lo LATIN LETTER RETROFLEX CLICK WITH RETROFLEX HOOK
1DF0B..1DF2C ; XID_Continue # L& [34] LATIN SMALL LETTER ESH WITH DOUBLE BAR..LATIN SMALL LETTER TESH DIGRAPH WITH CURL
1DF3E..1DF3F ; XID_Continue # L& [2] LATIN SMALL LETTER BARRED TURNED H..LATIN SMALL LETTER BARRED W
1DFD8..1DFE8 ; XID_Continue # Lm [17] MODIFIER LETTER SMALL BARRED TURNED H..MODIFIER LETTER SMALL CAPITAL D
1E000..1E006 ; XID_Continue # Mn [7] COMBINING GLAGOLITIC LETTER AZU..COMBINING GLAGOLITIC LETTER ZHIVETE
1E008..1E018 ; XID_Continue # Mn [17] COMBINING GLAGOLITIC LETTER ZEMLJA..COMBINING GLAGOLITIC LETTER HERU
1E01B..1E021 ; XID_Continue # Mn [7] COMBINING GLAGOLITIC LETTER SHTA..COMBINING GLAGOLITIC LETTER YATI
Expand Down Expand Up @@ -10550,7 +10565,7 @@ FFDA..FFDC ; XID_Continue # Lo [3] HALFWIDTH HANGUL LETTER EU..HALFWIDTH HA
31350..323AF ; XID_Continue # Lo [4192] CJK UNIFIED IDEOGRAPH-31350..CJK UNIFIED IDEOGRAPH-323AF
E0100..E01EF ; XID_Continue # Mn [240] VARIATION SELECTOR-17..VARIATION SELECTOR-256

# Total code points: 144530
# Total code points: 144549

# ================================================

Expand Down Expand Up @@ -12685,6 +12700,8 @@ FFFC..FFFD ; Grapheme_Base # So [2] OBJECT REPLACEMENT CHARACTER..REPLACEME
1DF00..1DF09 ; Grapheme_Base # L& [10] LATIN SMALL LETTER FENG DIGRAPH WITH TRILL..LATIN SMALL LETTER T WITH HOOK AND RETROFLEX HOOK
1DF0A ; Grapheme_Base # Lo LATIN LETTER RETROFLEX CLICK WITH RETROFLEX HOOK
1DF0B..1DF2C ; Grapheme_Base # L& [34] LATIN SMALL LETTER ESH WITH DOUBLE BAR..LATIN SMALL LETTER TESH DIGRAPH WITH CURL
1DF3E..1DF3F ; Grapheme_Base # L& [2] LATIN SMALL LETTER BARRED TURNED H..LATIN SMALL LETTER BARRED W
1DFD8..1DFE8 ; Grapheme_Base # Lm [17] MODIFIER LETTER SMALL BARRED TURNED H..MODIFIER LETTER SMALL CAPITAL D
1E030..1E06D ; Grapheme_Base # Lm [62] MODIFIER LETTER CYRILLIC SMALL A..MODIFIER LETTER CYRILLIC SMALL STRAIGHT U WITH STROKE
1E100..1E12C ; Grapheme_Base # Lo [45] NYIAKENG PUACHUE HMONG LETTER MA..NYIAKENG PUACHUE HMONG LETTER W
1E137..1E13D ; Grapheme_Base # Lm [7] NYIAKENG PUACHUE HMONG SIGN FOR PERSON..NYIAKENG PUACHUE HMONG SYLLABLE LENGTHENER
Expand Down Expand Up @@ -12804,7 +12821,7 @@ FFFC..FFFD ; Grapheme_Base # So [2] OBJECT REPLACEMENT CHARACTER..REPLACEME
30000..3134A ; Grapheme_Base # Lo [4939] CJK UNIFIED IDEOGRAPH-30000..CJK UNIFIED IDEOGRAPH-3134A
31350..323AF ; Grapheme_Base # Lo [4192] CJK UNIFIED IDEOGRAPH-31350..CJK UNIFIED IDEOGRAPH-323AF

# Total code points: 152738
# Total code points: 152757

# ================================================

Expand Down
Loading
Loading