Skip to content

Commit

Permalink
Daily Pathway examples refresh
Browse files Browse the repository at this point in the history 
Co-authored-by: Manul from Pathway <[email protected]>
GitOrigin-RevId: 5711a4ca44ab8f169fb509fec74aeb15e19feda4
  • Loading branch information
@Pathway-Dev
Pathway-Dev and Manul from Pathway committed Nov 21, 2024
1 parent 25325a6 commit 6637394
Show file tree
Hide file tree
Showing 3 changed files with 68 additions and 71 deletions.
20 changes: 5 additions & 15 deletions examples/notebooks/showcases/live_vector_indexing_pipeline.ipynb
View file
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@
"---\n",
"::\n",
"\n",
"Pathway Vectorstore enables building a document index on top of you documents without the\n",
"Pathway Vectorstore enables building a document index on top of your documents without the\n",
"complexity of ETL pipelines, managing different containers for storing, embedding, and serving.\n",
"It allows for easy to manage, always up-to-date, LLM pipelines accesible using a RESTful API\n",
"and with integrations to popular LLM toolkits such as Langchain and LlamaIndex.\n",
Expand Down Expand Up @@ -101,7 +101,7 @@
"outputs": [],
"source": [
"!pip install pathway litellm\n",
"# !pip install unstructured[all-docs]\n",
" !pip install unstructured[all-docs]\n",
"!mkdir -p sample_documents\n",
"![ -f sample_documents/repo_readme.md ] || wget 'https://gist.githubusercontent.com/janchorowski/dd22a293f3d99d1b726eedc7d46d2fc0/raw/pathway_readme.md' -O 'sample_documents/repo_readme.md'\n",
"\n"
Expand Down Expand Up @@ -536,19 +536,9 @@
"An example parser that can read PDFs, Word documents and other formats is provided with `parsers.ParseUnstructured`:"
]
},
{
"cell_type": "code",
"execution_count": null,
"id": "34",
"metadata": {},
"outputs": [],
"source": [
"# !pip install unstructured[all-docs] # if you will need to parse complex documents"
]
},
{
"cell_type": "markdown",
"id": "35",
"id": "34",
"metadata": {},
"source": [
"```python\n",
Expand All @@ -565,7 +555,7 @@
},
{
"cell_type": "markdown",
"id": "36",
"id": "35",
"metadata": {
"lines_to_next_cell": 2
},
Expand All @@ -582,7 +572,7 @@
},
{
"cell_type": "markdown",
"id": "37",
"id": "36",
"metadata": {},
"source": [
"### Running in production\n",
Expand Down
110 changes: 55 additions & 55 deletions examples/notebooks/tutorials/asynctransformer.ipynb
View file
Original file line number Diff line number Diff line change
Expand Up @@ -162,11 +162,11 @@
"output_type": "stream",
"text": [
" | value | ret | __time__ | __diff__\n",
"^Z3QWT29... | 2 | 3 | 1732080873292 | 1\n",
"^3CZ78B4... | 2 | 3 | 1732080873492 | 1\n",
"^YYY4HAB... | 6 | 7 | 1732080873492 | 1\n",
"^3HN31E1... | 6 | 7 | 1732080873892 | 1\n",
"^X1MXHYY... | 12 | 13 | 1732080873892 | 1\n"
"^Z3QWT29... | 2 | 3 | 1732167279834 | 1\n",
"^3CZ78B4... | 2 | 3 | 1732167280036 | 1\n",
"^YYY4HAB... | 6 | 7 | 1732167280036 | 1\n",
"^3HN31E1... | 6 | 7 | 1732167280436 | 1\n",
"^X1MXHYY... | 12 | 13 | 1732167280436 | 1\n"
]
}
],
Expand Down Expand Up @@ -410,12 +410,12 @@
"output_type": "stream",
"text": [
" | group | value | ret | __time__ | __diff__\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732080877214 | 1\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732080877314 | -1\n",
"^Z3QWT29... | 2 | 3 | 4 | 1732080877314 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732080877514 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732080877716 | -1\n",
"^YYY4HAB... | 1 | 2 | 3 | 1732080877716 | 1\n"
"^Z3QWT29... | 2 | 1 | 2 | 1732167283850 | 1\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732167283952 | -1\n",
"^Z3QWT29... | 2 | 3 | 4 | 1732167283952 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732167284152 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732167284352 | -1\n",
"^YYY4HAB... | 1 | 2 | 3 | 1732167284352 | 1\n"
]
}
],
Expand Down Expand Up @@ -537,18 +537,18 @@
"output_type": "stream",
"text": [
" | group | value | ret | __time__ | __diff__\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732080877962 | 1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732080877962 | 1\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732080878262 | -1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732080878262 | -1\n",
"^Z3QWT29... | 2 | 4 | 5 | 1732080878262 | 1\n",
"^3HN31E1... | 4 | 2 | 3 | 1732080878262 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732080878364 | 1\n",
"^3CZ78B4... | 3 | 1 | 2 | 1732080878364 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732080878462 | -1\n",
"^3CZ78B4... | 3 | 1 | 2 | 1732080878462 | -1\n",
"^YYY4HAB... | 1 | 2 | 3 | 1732080878462 | 1\n",
"^3CZ78B4... | 3 | 2 | 3 | 1732080878462 | 1\n"
"^Z3QWT29... | 2 | 1 | 2 | 1732167284622 | 1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732167284622 | 1\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732167284922 | -1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732167284922 | -1\n",
"^Z3QWT29... | 2 | 4 | 5 | 1732167284922 | 1\n",
"^3HN31E1... | 4 | 2 | 3 | 1732167284922 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732167285022 | 1\n",
"^3CZ78B4... | 3 | 1 | 2 | 1732167285022 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732167285122 | -1\n",
"^3CZ78B4... | 3 | 1 | 2 | 1732167285122 | -1\n",
"^YYY4HAB... | 1 | 2 | 3 | 1732167285122 | 1\n",
"^3CZ78B4... | 3 | 2 | 3 | 1732167285122 | 1\n"
]
}
],
Expand Down Expand Up @@ -581,16 +581,16 @@
"output_type": "stream",
"text": [
" | group | value | ret | __time__ | __diff__\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732080878584 | 1\n",
"^3CZ78B4... | 3 | 2 | 3 | 1732080878684 | 1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732080878784 | 1\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732080878884 | -1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732080878884 | -1\n",
"^Z3QWT29... | 2 | 4 | 5 | 1732080878884 | 1\n",
"^3HN31E1... | 4 | 2 | 3 | 1732080878884 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732080878984 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732080879084 | -1\n",
"^YYY4HAB... | 1 | 2 | 3 | 1732080879084 | 1\n"
"^Z3QWT29... | 2 | 1 | 2 | 1732167285260 | 1\n",
"^3CZ78B4... | 3 | 2 | 3 | 1732167285360 | 1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732167285460 | 1\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732167285562 | -1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732167285562 | -1\n",
"^Z3QWT29... | 2 | 4 | 5 | 1732167285562 | 1\n",
"^3HN31E1... | 4 | 2 | 3 | 1732167285562 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732167285660 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732167285760 | -1\n",
"^YYY4HAB... | 1 | 2 | 3 | 1732167285760 | 1\n"
]
}
],
Expand Down Expand Up @@ -633,18 +633,18 @@
"output_type": "stream",
"text": [
" | group | value | ret | __time__ | __diff__\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732080879222 | 1\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732080879222 | 1\n",
"^3CZ78B4... | 3 | 1 | 2 | 1732080879222 | 1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732080879222 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732080879722 | -1\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732080879722 | -1\n",
"^3CZ78B4... | 3 | 1 | 2 | 1732080879722 | -1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732080879722 | -1\n",
"^YYY4HAB... | 1 | 2 | 3 | 1732080879722 | 1\n",
"^Z3QWT29... | 2 | 4 | 5 | 1732080879722 | 1\n",
"^3CZ78B4... | 3 | 2 | 3 | 1732080879722 | 1\n",
"^3HN31E1... | 4 | 2 | 3 | 1732080879722 | 1\n"
"^YYY4HAB... | 1 | 5 | 6 | 1732167285914 | 1\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732167285914 | 1\n",
"^3CZ78B4... | 3 | 1 | 2 | 1732167285914 | 1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732167285914 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732167286414 | -1\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732167286414 | -1\n",
"^3CZ78B4... | 3 | 1 | 2 | 1732167286414 | -1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732167286414 | -1\n",
"^YYY4HAB... | 1 | 2 | 3 | 1732167286414 | 1\n",
"^Z3QWT29... | 2 | 4 | 5 | 1732167286414 | 1\n",
"^3CZ78B4... | 3 | 2 | 3 | 1732167286414 | 1\n",
"^3HN31E1... | 4 | 2 | 3 | 1732167286414 | 1\n"
]
}
],
Expand Down Expand Up @@ -688,16 +688,16 @@
"output_type": "stream",
"text": [
" | group | value | ret | __time__ | __diff__\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732080879822 | 1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732080879822 | 1\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732080880122 | -1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732080880122 | -1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732080880224 | 1\n",
"^3CZ78B4... | 3 | 1 | 2 | 1732080880224 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732080880324 | -1\n",
"^3CZ78B4... | 3 | 1 | 2 | 1732080880324 | -1\n",
"^YYY4HAB... | 1 | 2 | 3 | 1732080880324 | 1\n",
"^3CZ78B4... | 3 | 2 | 3 | 1732080880324 | 1\n"
"^Z3QWT29... | 2 | 1 | 2 | 1732167286566 | 1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732167286566 | 1\n",
"^Z3QWT29... | 2 | 1 | 2 | 1732167286868 | -1\n",
"^3HN31E1... | 4 | 3 | 4 | 1732167286868 | -1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732167286968 | 1\n",
"^3CZ78B4... | 3 | 1 | 2 | 1732167286968 | 1\n",
"^YYY4HAB... | 1 | 5 | 6 | 1732167287068 | -1\n",
"^3CZ78B4... | 3 | 1 | 2 | 1732167287068 | -1\n",
"^YYY4HAB... | 1 | 2 | 3 | 1732167287068 | 1\n",
"^3CZ78B4... | 3 | 2 | 3 | 1732167287068 | 1\n"
]
}
],
Expand Down
9 changes: 8 additions & 1 deletion examples/notebooks/tutorials/udf.ipynb
View file
Original file line number Diff line number Diff line change
Expand Up @@ -900,7 +900,14 @@
"name": "stdout",
"output_type": "stream",
"text": [
"inc_async(0.2) finishing\n"
"inc_async(0.2) finishing"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"\n"
]
},
{
Expand Down

0 comments on commit 6637394

Please sign in to comment.