v1.21.0

1.21.0 (2024-09-19)

Features

• AbstractGraph: add adjustable rate limit (2859fb7)
• add copy for smart_scraper_multi_concat (9e3171b)
• add scrape_do_integration (94e69a0)
• add togheterai (8f615ad)
• added Bedrock and Mistral to exec info (8a37c6b)
• ConcatNode.py added for heavy merge operations (bd4b26d)
• fetch_node improved (167f970)
• refactoring of the tokenization function (ec6b164)
• removed semchunk and used tikton (1a7f21f)
• return urls in searchgraph (afb6eb7)
• updated pydantic to v2 (eb89549)

Bug Fixes

• Add mistral-common dependency (7681a45)
• Added support for nested structure (66ea166)
• AbstractGraph: Bedrock init issues (63a5d18), closes #633
• correctly parsing output when using structured_output (8e74ac5)
• Error in pyproject dependencies (5b5cb5b)
• fetch_node condition (3f45c17)
• Fixed pydantic error on SearchGraphs (039ba2e)
• ScreenshotScraper: impose dynamic imports (b8ef937)
• Ollama: instance model from correct package (398b2c5)
• OmniScraerGraph working. (c3d1b7c)
• parse node (947ebd2)
• Parse Node scraping link and img urls allowing OmniScraper to work (66a3b6d)
• SmartScraper: pass llm_model to ParseNode (5242166)
• DeepSeek: proper model initialization (74dfc69)
• pyproject.toml (812c73d)
• pyproject.toml dependencies (b805aea)
• Refactor code to use CustomOpenAiCallbackManager for exclusive access to get_openai_callback (e657113)
• Removed link_urls and img_ulrs from FetchNode output (57337a0)
• screenshot scraper (388630c)
• screenshot_scraper (ef7a589)
• ScreenShotScraper: static import of optional dependencies (52fe441)
• temporary fix for parse_node (f2bb22d)
• update all nodes that were using MergeNode or IteratorNode (a92dddb)
• update generate answernode (c348f67)
• update pyproject.toml (932412e)

chore

• examples: create Together AI examples (34942de)

Docs

• Updated the graph_config in the documentation. (57a58e1)

Refactor

• Output parser code (28b85a3)

CI

• release: 1.16.0-beta.1 [skip ci] (d7f6036)
• release: 1.16.0-beta.2 [skip ci] (1c37d5d)
• release: 1.16.0-beta.3 [skip ci] (886c987)
• release: 1.16.0-beta.4 [skip ci] (ba5c7ad)
• release: 1.17.0-beta.1 [skip ci] (13efd4e)
• release: 1.17.0-beta.10 [skip ci] (af28885)
• release: 1.17.0-beta.11 [skip ci] (a73fec5)
• release: 1.17.0-beta.2 [skip ci] (08afc92)
• release: 1.17.0-beta.3 [skip ci] (fc55418)
• release: 1.17.0-beta.4 [skip ci] (5e99071)
• release: 1.17.0-beta.5 [skip ci] (16ab1bf)
• release: 1.17.0-beta.6 [skip ci] (50c9c6b)
• release: 1.17.0-beta.7 [skip ci] (4347afb), closes #633
• release: 1.17.0-beta.8 [skip ci] (85c374e)
• release: 1.17.0-beta.9 [skip ci] (77d0fd3)
• release: 1.19.0-beta.1 [skip ci] (eddcb79), closes #633 #633
• release: 1.19.0-beta.10 [skip ci] (92f5df2)
• release: 1.19.0-beta.11 [skip ci] (edfb185)
• release: 1.19.0-beta.12 [skip ci] (bd2afef)
• release: 1.19.0-beta.2 [skip ci] (23a260c)
• release: 1.19.0-beta.3 [skip ci] (38cba96)
• release: 1.19.0-beta.4 [skip ci] (24c38f9)
• release: 1.19.0-beta.5 [skip ci] (7621a7c)
• release: 1.19.0-beta.6 [skip ci] (ed8e173)
• release: 1.19.0-beta.7 [skip ci] (4ab26a2)
• release: 1.19.0-beta.8 [skip ci] (88b2c46)
• release: 1.19.0-beta.9 [skip ci] (7ad6f21)
• release: 1.20.0-beta.1 [skip ci] (cc8392e), closes #633 #633 #633 #633
• release: 1.20.0-beta.2 [skip ci] (4f8b55d)
• release: 1.20.0-beta.3 [skip ci] (cca783c)
• release: 1.20.0-beta.4 [skip ci] (c81f970)
• release: 1.20.0-beta.5 [skip ci] (b0fef3f)