From a194301dc170ebd3c2b49d0f7a45108af9fec7e4 Mon Sep 17 00:00:00 2001 From: Aleksey Lymar Date: Wed, 8 Aug 2018 18:36:49 +0300 Subject: [PATCH 1/2] docs: update pretrained embeddings readme --- docs/index.rst | 2 +- docs/intro/pretrained_vectors.rst | 23 ++++++++++++++++++----- 2 files changed, 19 insertions(+), 6 deletions(-) diff --git a/docs/index.rst b/docs/index.rst index 09a70d56fb..fb4fd44874 100644 --- a/docs/index.rst +++ b/docs/index.rst @@ -11,7 +11,7 @@ Welcome to DeepPavlov's documentation! Conceptual overview Features Configuration files - Pre-trained word vectors + Pre-trained embeddings Parameters evolution Tutorials diff --git a/docs/intro/pretrained_vectors.rst b/docs/intro/pretrained_vectors.rst index 1ecb3a88f6..cac3a6e7e1 100644 --- a/docs/intro/pretrained_vectors.rst +++ b/docs/intro/pretrained_vectors.rst @@ -1,5 +1,18 @@ -Pre-trained word vectors -======================== +Pretrained embeddings +============================ + +ELMo +---- + +| We are publishing :class:`Russian language ELMo embeddings model ` for tensorflow-hub. +| ELMo (Embeddings from Language Models) representations are pre-trained contextual representations from + large-scale bidirectional language models. See a paper `Deep contextualized word representations + `__ for more information about the algorithm and a detailed analysis. +| These vectors where trained on `Russian Wikipedia `__. + + +fastText +-------- We are publishing pre-trained word vectors for Russian language. These vectors were trained on joint `Russian @@ -14,13 +27,13 @@ You can get vectors either in binary or in text (vec) formats both for fastText and GloVe. License -------- +~~~~~~~ The pre-trained word vectors are distributed under the `License Apache 2.0 `__. Downloads ---------- +~~~~~~~~~ The models can be downloaded from: @@ -39,7 +52,7 @@ The models can be downloaded from: +-----------------------+---------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ Word vectors training parameters --------------------------------- +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ These word vectors were trained with following parameters ([...] is for default value): From 472889353adf35becc56487f03edd81b57cc592c Mon Sep 17 00:00:00 2001 From: Aleksey Lymar Date: Wed, 8 Aug 2018 18:48:46 +0300 Subject: [PATCH 2/2] docs: fix pre-trained embeddings header --- docs/intro/pretrained_vectors.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/intro/pretrained_vectors.rst b/docs/intro/pretrained_vectors.rst index cac3a6e7e1..82cb8a77c2 100644 --- a/docs/intro/pretrained_vectors.rst +++ b/docs/intro/pretrained_vectors.rst @@ -1,4 +1,4 @@ -Pretrained embeddings +Pre-trained embeddings ============================ ELMo