Skip to content

Commit

Permalink
Add explanation of embeddings
Browse files Browse the repository at this point in the history
  • Loading branch information
InAnYan committed Aug 14, 2024
1 parent 36e6a3d commit 8d9b768
Showing 1 changed file with 10 additions and 1 deletion.
11 changes: 10 additions & 1 deletion en/ai/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,16 @@ In this window you can see the following elements:

## How does the AI functionality work?

In the background, JabRef analyses the linked PDF files of library entries. The information used after the indexing is then supplied to the AI, which, to be precise, in our case is a Large Language Model (LLM). The LLM is currently not stored on your computer. Instead, we have many integrations with AI providers (OpenAI, Mistral AI, Hugging Face), so you can choose the one you like the most. These AI providers are available only remotely via the internet. In short: we send chunks of text to AI service and then receive processed responses. In order to use it you need to configure JabRef to use your API key.
In the background, JabRef analyzes the linked PDF files of library entries. The information used after the indexing is then supplied to the AI,
which, to be precise, in our case is a Large Language Model (LLM). The LLM is currently not stored on your computer. Instead, we have many
integrations with AI providers (OpenAI, Mistral AI, Hugging Face), so you can choose the one you like the most. These AI providers are available
only remotely via the internet. In short: we send chunks of text to AI service and then receive processed responses. In order to use it you need
to configure JabRef to use your API key.

JabRef processes linked files this way: the file is split into parts of fixed-length (also called *chunks*), and then an *embedding* is generated. Embedding is a
representation of a part of text. It's a vector that represents the meaning of the text. This vector has a crucial property: texts with
similar meaning have vectors that are close to (this is called *vector similarity*)! So, whenever you ask AI a question, JabRef tries to find relevant pieces
of text from the indexed files using vector similarity.

## More information

Expand Down

0 comments on commit 8d9b768

Please sign in to comment.