Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update marmotMorphologicalAnalyzer.md #11

Open
wants to merge 1 commit into
base: wiki
Choose a base branch
from
Open

Update marmotMorphologicalAnalyzer.md #11

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions marmotMorphologicalAnalyzer.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,8 @@ $ java -Xmx5G -cp marmot.jar marmot.morph.cmd.Trainer\<br>
Where 2 and 3 are the columns that hold features you want to use.
The word form must be in column 0 and all other columns (the lemma in the example) are ignored.

**Warning:** The dictionary should not include the symbols `-` or `.` as these are treated specially by the format reader.

# Token Features #

While the morphological dictionary allows for simple feature integrating it does not provide a way to include word forms not know at training time. If MarMoT is to be used in a pipeline the token-feature-index is a more powerful alternative.
Expand Down