Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Partially test consistency of grapheme cluster segmentation with canonical equivalence, and fix it for LGCs #645

Merged
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
58 commits
Select commit Hold shift + click to select a range
cc76245
A test which I expected to fail, but not in this way
eggrobin Dec 1, 2023
e23d1c1
Pre-16 and NFKCQC
eggrobin Dec 1, 2023
24fe8e1
🤪
eggrobin Dec 2, 2023
328c761
Canonical closure tests
eggrobin Dec 29, 2023
2d0ceaf
Generate canonical closures
eggrobin Dec 29, 2023
3880c4f
Some interesting sequences
eggrobin Dec 29, 2023
b3b53c0
Some very crappy code
eggrobin Dec 29, 2023
22dfd8c
Drop Hangul and make sure we have all overlaps
eggrobin Dec 29, 2023
a742327
Split it into its own part and look at chaining compositions, not dec…
eggrobin Jan 3, 2024
182cc3a
despam
eggrobin Jan 3, 2024
53459b0
spots
eggrobin Jan 3, 2024
5f16271
Regenerate UCD
eggrobin Jan 3, 2024
747f982
Some comments.
eggrobin Jan 3, 2024
695c95e
Allow a single non-decomposable starter at either end of the chain
eggrobin Jan 4, 2024
9fea9ea
Deduplicate parts 4 and 5
eggrobin Jan 4, 2024
7362f2d
Remove redundant test cases in NFC (covered by the NFC column of othe…
eggrobin Jan 5, 2024
cdd391a
Clean things up
eggrobin Jan 5, 2024
7bcb9b4
more cleanup
eggrobin Jan 5, 2024
cf4275c
more cleanup
eggrobin Jan 5, 2024
3cb23ac
More testing
eggrobin Jan 7, 2024
e41b3ea
Fix the QC properties
eggrobin Jan 7, 2024
0c312ce
stray import
eggrobin Jan 7, 2024
361a977
factor
eggrobin Jan 7, 2024
0380b27
report all failures
eggrobin Jan 7, 2024
85c2b67
Failing test
eggrobin Jan 10, 2024
6188e19
an attempt at error messages
eggrobin Jan 10, 2024
afc7d8c
comma
eggrobin Jan 10, 2024
29b341f
table and less escaping
eggrobin Jan 10, 2024
0497007
Try to get the errors only once
eggrobin Jan 10, 2024
4ca3390
We have screwed up since the beginning of time.
eggrobin Jan 10, 2024
80acf01
Revert invariant tests
eggrobin Jan 10, 2024
93c9570
Report various kinds of errors
eggrobin Jan 10, 2024
281f70b
report parse errors
eggrobin Jan 10, 2024
70a4ee2
Break everything
eggrobin Jan 10, 2024
03b74f2
make it a bit more readable hopefully
eggrobin Jan 10, 2024
4ac8e84
Revert "Break everything"
eggrobin Jan 10, 2024
3ba16f5
It is only an error if it is not what we expect.
eggrobin Jan 10, 2024
546071e
Revert "Revert invariant tests"
eggrobin Jan 10, 2024
008fa45
Put the condition in the right place
eggrobin Jan 10, 2024
40c4eab
Merge branch 'invariant-test-in-diff' into canonically-consistent-gra…
eggrobin Jan 10, 2024
1c84e41
Document our past mistakes, don’t expect them to go away
eggrobin Jan 10, 2024
c107514
Merge branch 'normalization-woes' into canonically-consistent-graphem…
eggrobin Jan 10, 2024
85eca4e
bad expectations
eggrobin Jan 10, 2024
963735f
fix it
eggrobin Jan 10, 2024
a93e7d1
Regenerate UCD
eggrobin Jan 10, 2024
47ae9c4
Fehlermeldungszeilen
eggrobin Jan 12, 2024
cdb3107
Merge remote-tracking branch 'la-vache/main' into invariant-test-in-diff
eggrobin Jan 12, 2024
bbee45c
Merge branch 'invariant-test-in-diff' into canonically-consistent-gra…
eggrobin Jan 12, 2024
7a6220b
Markus’s suggestions
eggrobin Jan 20, 2024
89cdf7a
Merge remote-tracking branch 'la-vache/main' into normalization-woes
eggrobin Jan 20, 2024
e1a01ed
More honest primaryCompositesByMeowNFDCodePoint maps
eggrobin Jan 20, 2024
b0b4cf6
Regenerate UCD
eggrobin Jan 20, 2024
910039c
Merge branch 'normalization-woes' of https://github.com/eggrobin/unic…
eggrobin Jan 20, 2024
c21622e
spotless
eggrobin Jan 20, 2024
66e7296
Merge remote-tracking branch 'la-vache/main' into normalization-woes
eggrobin Jan 22, 2024
2c57460
Merge branch 'normalization-woes' into canonically-consistent-graphem…
eggrobin Jan 23, 2024
f58c609
Merge remote-tracking branch 'la-vache/main' into canonically-consist…
eggrobin Jan 23, 2024
6830f83
Merge remote-tracking branch 'la-vache/main' into canonically-consist…
eggrobin Jan 26, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading