v0.12.1

0.12.1 (2024-10-25)

Features

• /dataset/visiblity route to the server to set visibility with (ed2c4c0)
• add /topic/clone to the ts-sdk (8b6fe7e)
• add debounce for getCounts, search and suggestedQueries (992d8cc)
• add glasskube argocd app (afc7497)
• add group products checkmark to crawl settings (a4e23c7)
• add group variants flag (070a6a5)
• add ImageConfig for sending images to the llm (1f12579)
• add kustomization (9480d6d)
• add noResultsLink + styling: cleanup dark for active tab and search toggle (93a83f2)
• add noResultsLink + styling: cleanup dark for active tab and search toggle (84479c6)
• add open and onOpenChange as params for search component (cde5fa2)
• add packages kustomization (92ce2b0)
• add prices and images to ecomm chat (9097194)
• add search component example code (9b9d818)
• add shopify option to frontend (745d4ea)
• add shopify scraping (d3a6609)
• add site path to search results (60ad84a)
• add the ability to remove strings from titles and content during crawl (8517c98)
• add trieve hackernews application (9b5620e)
• add web component (4ca266c)
• added route to the backend for group_variants (6b2c7d5)
• added useImages to the frontend as a parameter (c2db61c)
• allow custom pre and post tags for highlights (c2f3777)
• allow for specifying allow_external_links and allow_backward_links (aeb9495)
• allow rag to use group search w/ a size of 1 (95debf6)
• allow user to specify that chunks' links should be included in generated output (baa9d39)
• authorization for webhook (e0c060c)
• auto focus input field (81a0567)
• bm25 settings when creating new dataset (e1346c7)
• change snake case to camel case (82035db)
• checkpoint where scraping of Trieve site + docs works correctly (a84bf93)
• clone topic and message route (4471cb8)
• clone topic in chat frontend (71c20d6)
• consistently link to the id anchor when possible from chunks in the search component, + cleanup: remove happy-dom (0f6ff50)
• create inital builderio webhook (c4d7ef2)
• create operator and impl system for content (3f472a4)
• delete applicationset (0e29e5a)
• docusarus theme plugin respects color scheme (2082bc3)
• docusaurus search plugin (6c1c393)
• event data explorer (a3303c6)
• fix button element position (23602b4)
• fixups and auth (2defca7)
• frontend page to toggle visibility + server dataset config for (78ea4d4)
• get all event types + bugfix: escape quotes properly for analytics (bc302dc)
• get page and deny access if no permission is given (8457683)
• group search in component (ea76b78)
• headless analytics (a59466d)
• jinja baseline (990aca5)
• json parsing (9810fae)
• lazy load search component (743a068)
• let embeddings share, gpu, update hash, increase splade-query doc memory (72dfab6)
• link custom events to actual events (c7724e5)
• make headings less noticable & extract heading heirarchy from chunks (6d08f4b)
• move package into folder (596740f)
• move to HEAD (8c0187d)
• new org modal in org select page (2250568)
• page.html renders template arguments passed through and react (646ec78)
• prevent switching modes (84c7039)
• properly shrink on page width decrease (f1f63e0)
• remove @radix-ui/react-dialog and downshift (90abf0a)
• remove kustomization (22175f0)
• remove syntax highlighting to reduce bundle size (28e51df)
• reverted previous code, added the rest needed for end to end (d84d6e1)
• send json blobs to llm for better parsing (5f5270b)
• set argocd source to pmig/trieve HEAD (5b0fd13)
• show first 3 lines of results (1943428)
• show vote score on dashboard rag table (8c97b2e)
• special logic to skip sending message to firecrawl (0ca6b5b)
• switch glasskube argocd deployment to main branch (46ee59b)
• unpublish (e0c060c)
• upgrade glasskube to v0.24.0 (3c8661e)
• upgrade to the latest trieve-gcp package (3fafd77)
• upload chunks (7cd24e7)
• use correct color theming for search component (7bbd21b)
• use same clickhouse and postgres message ids (5fc7799)
• use tmp deployment branch (2733380)
• utility functions to get TR-QueryId on all RAG based routes (c1dfa03)
• validation for bm25 (3213aa1)
• webhook request type (285e825)

Cleanup

• add get datset by tracking_id to the openapi + bugfix: delete dataset by tracking_id (f41d397)
• allow user to opt out of autocomplete search mode (653043f)
• allow user to use distance_factor or boost_factor for semantic_boost (6ae80ed)
• avoid panic when ditto api key is not set (5c343d8)
• cargo fmt (35d4ddd)
• clippy (e0c060c)
• clippy again (e0c060c)
• clippy and server (1f2f2fa)
• component styling + allow it to create its own TrieveSDK (e8bf984)
• default get total pages to true in search playground (fa71713)
• fix floating effect below bottom nav on search-component (25064cb)
• fixed frontend compile err (7da2bac)
• ignore clippy too many args (b064266)
• lower Qdrant conn timeout to 10s (bbb00df)
• make it optional (d03ebef)
• more fixes (44f6fa5)
• more types (fe5aae4)
• prevent empty chunks in crawl (3aee601)
• remove errant prints from old PRs (f468101)
• remove lodash from search-component (7504842)
• remove lodash-es from search component (7cb65bc)
• remove max depth as a crawl option field (12121a5)
• require non star include URL for external URLs (bfb540c)
• spacing (e0c060c)
• update crawl settings dashboard display (6950c0d)
• update firecrawl to v39 (e9ddc36)
• update mintlify widget (f814543)
• update to latest firecrawl + better logic for subsequent headings (c43d9c8)
• upgrade free plan usage (05dd442)

Bug Fixes

• add path after summary if summary is present (b854b23)
• autofocus chatInput on open (5510dae)
• clickhouse: do not force default database (b38d422)
• crawl options UI not including site_url and allow_external_links in spots (620e905)
• create embeddings on non receiving thread (1d3bc06)
• disable keycloak builtin ingress (97bf136)
• eslint (5cb6c43)
• fix crawl duplicates from www vs non www (05e0fd6)
• fix viewing group search results in query details (59e7e09)
• fixed embedding generation (4c58eb6)
• handle untagged delta and finish_reason on generate_from_chunks streaming (b153229)
• handle untagged delta and finish_reason on stream_response (287d679)
• keep track of message id for voting (5dcf9c1)
• keyboard nav for search component (a420342)
• metadata in result card nested too deeply (f816e63)
• prevent abort signals from printing console.error's (2a952cc)
• RAG on specified chunks on group page (3503945)
• remove session_state parameter (feb0aa6)
• remove trailing slahes from URLs when processing a crawl (b44042c)
• remove use of error.name instead just use error (653979d)
• request profile and email scopes (0b4ec80)
• sanitize organization name to prevent html injections (4559110)
• stream response false was still sending back a stream (d144bbe)
• support non-uuid claim subjects (23db60f)
• update release CI action to push dittofeed and crawl worker (7636b56)
• use the search events search id in RAG route (4b04a36)

Other

• add example configuration (8566b5f)
• add keycloak extra service with gcp backend config POC (383fc7f)
• add LICENSE for components in package.json and in folder (95f7562)
• change to single ingress for all services and add gcp managed certificate (08cfa7e)
• fix keycloak backendconfig (e52d95f)
• move combined ingress to base (a60aa4d)
• release v0.12.1 (01d1526)

Docs

• add additional docstrings and titles (fc80008)
• add more documentation of group_variants and CrawlShopifyOptions (8aa928e)
• add TR-QueryID response header to the redoc spec (f60a300)
• cleanup response types for /chunk/search (f59a834)
• update example to use responsive: true in docusarus (38e1614)
• update TR-Dataset and TR-Organization to be uuid::Uuid everywhere (2345823)
• updated example to have a 200 ms wait time (84fda93)

Refactoring

• using ScrapingOptions enum instead of is_shopify / (667e9ba)