Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Build default lexical models from Unicode unilex data #70

Open
mcdurdin opened this issue Feb 27, 2020 · 0 comments · May be fixed by #71
Open

Build default lexical models from Unicode unilex data #70

mcdurdin opened this issue Feb 27, 2020 · 0 comments · May be fixed by #71
Labels
enhancement New feature or request
Milestone
Future

Comments

@mcdurdin
Copy link
Member

https://github.com/unicode-org/unilex/tree/master/data/frequency

I reckon we could get a long way with default models. Not perfect for all languages but maybe a decent base for others to work on.

Also they appear to be TSV files -- just need to strip off a line or two at the start!
@mcdurdin mcdurdin added the enhancement New feature or request label Feb 27, 2020
@mcdurdin mcdurdin added this to the P10S1 milestone Feb 27, 2020
@mcdurdin mcdurdin linked a pull request Feb 27, 2020 that will close this issue
Draft
@mcdurdin mcdurdin modified the milestones: P10S1, P10S2 Mar 6, 2020
@mcdurdin mcdurdin modified the milestones: P10S2, P10S3 Mar 21, 2020
@mcdurdin mcdurdin modified the milestones: P10S3, P10S4 Apr 3, 2020
@mcdurdin mcdurdin modified the milestones: P10S4, P10S5 Apr 18, 2020
@mcdurdin mcdurdin modified the milestones: P10S5, P10S6 May 1, 2020
@mcdurdin mcdurdin modified the milestones: P10S6, P10S7 May 18, 2020
@mcdurdin mcdurdin modified the milestones: P10S7, P10S8 May 29, 2020
@mcdurdin mcdurdin modified the milestones: P10S8, P10S9 Jun 13, 2020
@mcdurdin mcdurdin modified the milestones: P10S9, P10S10 Jun 29, 2020
@mcdurdin mcdurdin modified the milestones: P10S10, P10S11 Jul 11, 2020
@mcdurdin mcdurdin modified the milestones: P10S11, P10S12 Jul 26, 2020
@mcdurdin mcdurdin modified the milestones: P10S12, P10S13 Aug 9, 2020
@mcdurdin mcdurdin modified the milestones: P10S13, P10S14 Aug 23, 2020
@mcdurdin mcdurdin removed this from the P10S14 milestone Sep 4, 2020
@mcdurdin mcdurdin added this to the P10S15 milestone Sep 4, 2020
@mcdurdin mcdurdin modified the milestones: P10S15, P10S16 Sep 20, 2020
@mcdurdin mcdurdin modified the milestones: P10S16, P10S17 Oct 2, 2020
@mcdurdin mcdurdin modified the milestones: P10S17, P10S18 Oct 17, 2020
@mcdurdin mcdurdin modified the milestones: P10S18, P10S19 Nov 3, 2020
@mcdurdin mcdurdin modified the milestones: P10S19, P10S20 Nov 15, 2020
@mcdurdin mcdurdin modified the milestones: P10S20, B14S1 Nov 27, 2020
@mcdurdin mcdurdin modified the milestones: B14S1, B14S2 Dec 12, 2020
@mcdurdin mcdurdin modified the milestones: B14S2, B14S3 Dec 27, 2020
@mcdurdin mcdurdin modified the milestones: B14S3, B14S4 Jan 12, 2021
@mcdurdin mcdurdin modified the milestones: B14S4, B14S5 Jan 22, 2021
@darcywong00 darcywong00 modified the milestones: B14S5, Future May 13, 2021
@mcdurdin mcdurdin added this to Keyman Nov 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
Keyman
Status: No status
Milestone
Future
Development

Successfully merging a pull request may close this issue.

Feat/unilex keymanapp/lexical-models
2 participants
@mcdurdin @darcywong00