Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add dictionary component #19

Open
1 of 11 tasks
oubiwann opened this issue Aug 30, 2018 · 0 comments
Open
1 of 11 tasks

Add dictionary component #19

oubiwann opened this issue Aug 30, 2018 · 0 comments

Comments

@oubiwann
Copy link
Member

oubiwann commented Aug 30, 2018 •
edited
Loading

Component creation and ingest:

  • Create component namespace
  • Setup docker for RedisSearch
  • Create RedisSearch connection function(s)
  • Define a plain text, human readable format
  • Create functions that convert plain text dictionary files to the format(s) needed by RedisSearch for ingest
  • Upon startup, the dictionary component should read all dictionary files, index them, and load them into RedisSearch

Post-ingest, programmatic access:

For part of speech, standardize on what is used in OpenNLP (see https://www.ling.upenn.edu/courses/Fall_2003/ling001/penn_treebank_pos.html)
@oubiwann oubiwann changed the title Add dictionary support to language component Add dictionary component Sep 10, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@oubiwann