Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Language Models are not restricted to natural language #148

Open
cmungall opened this issue Nov 12, 2024 · 0 comments
Open

Language Models are not restricted to natural language #148

cmungall opened this issue Nov 12, 2024 · 0 comments

Comments

@cmungall
Copy link
Member

aio:LanguageModel ! Language Model "A model designed to predict the next word in a sequence or assign probabilities to sequences of words in natural language."

language models are also applied to protein sequences etc

Also the definition is technically long, because tokens != words in NL.

we could solve this with a triad pattern

  • LM
    • Natural Language LM
    • Protein LM
    • ...

But this is overkill

Recommendation: change text to

A model designed to predict the next token in a sequence or assign probabilities to sequences of tokens in natural language or language-like structure

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant