changelog.md

Version 2.13.0 (18.09.2020)

Core

• [fea] Added extra parameter to clients stats
• [fea] Added update, delete, truncate statement in DSL
• [fix] Added support for equal_positions in sql suggester
• [fix] Crash on distinct whith composite index
• [fix] Crash on query whith incorrect index type after index conversion

Reindexer tool

• [fix] Crash on upsert array object as first json tag

Version 2.12.2 (15.09.2020)

Go connector

• [fix] Cproto connection freezes if timeout occurs while reading from socket

Version 2.12.1 (10.09.2020)

• [fix] Crash on fulltext build, if typos map exceed 2GB
• [fix] Crash on DSL query with IN (string,...) conditions

Go connector

• [fix] Cproto connection freezes on async transaction timeout

Version 2.12.0 (02.09.2020)

Core

• [fea] WAL size settings via #config namespace
• [fea] WAL updates filtering
• [fea] Return error for queries with EqualPosition to fields with IS NULL condition

Reindexer server

• [fea] Transactions HTTP API
• [fea] Add RPC-transactions limit for each connection
• [fea] More advanced JSON DSL validation for queries

Go connector

• [fea] Items cache size limits setting
• [fix] Fix SEGFAULT on unauthorized builtin server

Version 2.11.2 (25.08.2020)

Core

• [fix] Fulltext snippet location in text
• [fix] Unneeded force replication fixed

Go connector

• [fix] Reset state on reconnect to different server

Version 2.11.1 (14.08.2020)

Core

• [fix] Increased performance of queries with custom sort order
• [fix] Fixed behavior of SQL UPDATE statement with true/false/null values
• [fix] Do not reset expire_after value of ttl indexes after copying tx
• [fix] Error loading of system records (indexes/tags/replState) after copying tx
• [fix] To config added default value of optimization_sort_workers
• [fix] Windows specific error with IN () condition executed by comparator

Reindexer server

• [fea] Removed default limit=10 in GET :db/namespaces/:ns/items method
• [fea] Added REINDEXER_NOREUSEIDLE env var for disable server connection reuse

Go connector

• [fix] Fixed async tx goroutines leak

Version 2.11.0 (29.07.2020)

Core

• [fix] Crash with SEGV or assert on ordered queries after copying tx
• [fix] Correct normalization of SELECT COUNT(*) SQL queries
• [fea] More efficient replication startup on active master updates
• [fix] Namespace indexes optimization after load was not started
• [fix] Centos 7 build fixed

Version 2.10.0 (05.07.2020)

Core

• [fea] Cascade replication
• [fea] MsgPack format support for query and updates
• [fea] Initial JsonSchema v4 support.
• [fea] Query strict mode support - Check indexes or fields names before query execution

Reindexer server

• [fea] MsgPack format support for http and cproto

Python connector

• [fea] Moved to separate repository

Version 2.9.2 (24.06.2020)

• [fix] Optimize indexes after ns load
• [fix] Correct Drop fields by json path
• [opt] Execution plan with wide IN condition to low selectivity indexes

Version 2.9.1 (10.06.2020)

Core

• [fix] Fulltext search kb layout filter with symbols like ',' ']'
• [fix] Segfault with distinct on field with different types

Reindexer tool

• [fix] Behavior of --help command line argument
• [fix] Do not report error on restore exiting namespaces with compatible indexes

Reindexer server

• [fix] Backtrace behavior with musl builds

Go connector

• [fix] Turn cgo backtrace symbolizer off by default (fixes random crashes on go 1.14)
• [fix] Alpine linux build

Version 2.9.0 (15.05.2020)

Core

• [fea] Output relevancy rank information to json format
• [fea] Optimized query to #memstats. Now it's O(1)
• [fea] Added app_name field #clientsstats
• [fix] Fixed SQL suggestion behavior on concatenated tokens

Go connector

• [fix] Fixed and enabled multiple dsn support in cproto

Version 2.8.1 (12.05.2020)

• [fix] unexpected "terminate called"

Version 2.8.0 (24.04.2020)

Core

• [fea] Fulltext - rank by word position
• [fea] Explain information improved
• [fix] Memory corruption on copying tx-es

Reindexer tool

• [fix] Fixed crash on query with joins

Reindexer server

• [del] Removed useless "storage_enabled" flag from GET db/namespaces method response

Face

• [fea] Query builder refactored
• [fea] New document page now modal

Misc

• [ci] Ubuntu 20.04 build added

Version 2.7.1 (14.04.2020)

Go connector

• [rev] Disabled multiple dsn support in cproto

Version 2.7.0 (10.04.2020)

Core

• [fix] Requests with general sort and offset without limit can produce wrong sort
• [fix] Full text synonyms can not work after transactions
• [fea] More efficient arrays packing from json source
• [fix] NOT operator in full text queries
• [fix] Tuple memory leak on Update by condition
• [fea] Multi-word synonyms support
• [fix] Potential large memory allocation on DISTINCT queries
• [fix] Potential crash with aggregation on object fields

Reindexer server

• [fea] Optional snappy network traffic compression
• [fea] OnWALUpdates now used shared buffers - can seriously decrease memory usage with many slave
• [fix] Replication fixes on bad network connections
• [fix] Connection ID overflow, and bad connID error fixed

Reindexer tool

• [fea] Added --createdb flag.
• [fea] Improved behavior while input is redirected

Go connector

• [fix] Enable to create multiple instances of builtinserver
• [fea] Multiple dsn support in cproto

Face

• [fix] Fixed precepts of new item
• [fea] Rename namespace feature
• [fea] Namespace config moved to dedicated page

Version 2.6.4 (31.03.2020)

Reindexer server

• [fix] Wrong conn id full fix

Version 2.6.3 (27.03.2020)

Core

• [fix] Full text search ranking with synonyms
• [fea] Distinct execution plan optimization
• [fix] Crash on incorrect json in config (array, when object expected)
• [fix] Crash on concurrent full text updates/selects
• [fix] Search by second field in full text, while term present in first field
• [fea] Multiple dsn support in cproto client

Reindexer server

• [fix] Do not create users.yml in in-memory only mode
• [fix] Wrong conn id fix

Reindexer tool

• [fix] Hang on error in batch mode
• [fix] db name begins with cproto or builtin correct handling

go connector

• [fix] Hang on parsing recursive types references in struct

Version 2.6.2 (13.03.2020)

Core

• [fea] Multiple distinct in single query using indexes
• [fix] Unload by idle timeout feature is disabled
• [fea] Update Query now can update object or array of objects

Reindexer server

• [fea] Enable tx.Rollback after tx.Commit
• [fix] Crash on Upsert to tables with composite pk with non indexed fields as part of PK
• [fea] Stronger txID & queryID validation and isolation between clients
• [fix] Correct lsn & id invalidation after UpdateQuery
• [fea] Clients connection statistics added

go connector

• [fea] Enable tx.Rollback after tx.Commit,
• [fea] Added read tx.Query support
• [fea] Log warning about reindexer library and client mismatch
• [fix] Unmarshall []bool indexed fields
• [fix] Unsafe Query flag reset after recycle from sync.Pool
• [fea] DB.SetDefaultQueryDebug now copies default ns settings

Version 2.6.1 (02.03.2020)

Core

• [fea] Synonyms feature in fulltext search
• [fea] New full_match_boost parameter in fulltext search
• [fix] last_updated_time of ns will not change on restart

Reindexer server

• [fea] Enable server startup without storage
• [fea] Backward compatibility of tx replication with old reindexer versions

go connector

• [fix] Windows build

Version 2.6.0 (21.02.2020)

Core

• [fea] Atomic applying transaction with namespace copy & replace
• [fea] Transaction performance statistics
• [fix] Equal position behavior fixed
• [fea] Sort queries by right namespace field
• [fix] UPDATE statement fixes
• [fix] Transaction replication fixes
• [fix] Select fields filter fix for right namespace

Reindexer server

• [fea] web static resources are embeded to server binary by default

Version 2.5.5 (07.02.2020)

Reindexer server

• [fix] Fixed backward compat of RPC with 2.5.2-

Version 2.5.3 (06.02.2020)

Core

• [fea] Added rename namespace API
• [fea] Improved -dev package behavior
• [fix] Transactions memory consumption are seriously decreased

Reindexer tool

• [fea] Added \namespace rename command

Reindexer server

• [add] Added HTTP API method /namespaces/rename
• [fix] Fixed docker image

go connector

• [fea] Auto pass list of detected C/C++ dependencies libraries to go
• [fea] Added RenameNamespace function

Version 2.4.6 (24.01.2020)

Core

• [fea] Replication of transactions
• [fea] EqualPosition support in sql in dsl
• [fix] Forced sort fixes
• [fix] Distinct keyword fixes in sql-dsl parsers/encoders
• [fix] Sql auto-complete fixes
• [fix] Replication lsn mismatch fix
• [fix] Merge queries with joins fix

Reindexer tool

• [fix] Mac OS X table-view paging fix

Version 2.4.5 (30.12.2019)

Core

• [fix] Fix: forced replication can lead to infinite loop
• [fea] Add .pkg file and autotest in -dev package
• [fix] Replication of meta in forcedSync

go connector

• [fea] Canceling of connecting to server if the deadline is expired

Reindexer tool

• [fix] Fix of incorrect paging when output to file or stdout redirection
• [fix] Fix of suggest of '<key word>'

Version 2.4.4 (17.12.2019)

Core

• [fix] Do not lock preResult values if from cache fixed potential assert on queries with join with used join cache
• [fix] Fix assert in sort by composite indexes
• [fea] Add composite values parsing for SQL select
• [fix] Make circular accumulator for stddev performance statistic
• [fix] Fix unhandled exception while caclulating perf stat

go connector

• [fix] RawBuffer leak due to unclosed iterators in transactions

Version 2.4.3 (06.12.2019)

Core

• [fea] Add '' as a special escaping symbol to FtDSL
• [fix] Merge-join queries fixes and optimizations
• [fix] Fix hit_count_to_cache overflow for idset cache

Reindexer server

• [fea] Add master's config check on slave connect
• [fea] Disable automatic database creation on RPC-connect
• [fix] Add force-resync after online replication errors
• [fix] Fix lsn overflow after convertion to int

go connector

• [fea] Add replication status to memstats

Version 2.4.2 (21.11.2019)

Core

• [fix] Joins optimizations

go connector

• [fix] cjson lock + deep copy performance fixes

Version 2.4.1 (15.11.2019)

Core

• [fea] Sort by expressions
• [fea] Optimized lock time for joins with small preresult set
• [fea] Added more info about replication state to #memstat namespace
• [fix] LSN on row-based query replication (possible assert on server startup)
• [fix] Replication clusterID for namespaces without storage
• [fix] PK precepts replication

Reindexer server

• [fix] Query results row calculation for http queries with limit

Reindexer tool

• [fea] Table pagination
• [fea] Queries cancellation

go connector

• [fix] Tags race on concurrent transactions

Version 2.3.4 (29.10.2019)

go connector

• [fix] Iterator.NextObj(): performance fix

Core

• [fix] Fix of Windows build

Version 2.3.3 (29.10.2019)

Core

• [fix] disabled OR operator for Fulltext indexes
• [fix] replication: using row records instead of statements for UpdateQuery/DeleteQuery (performance improvement)

Reindexer server

• [fea] new statistics parameter: items count (for prometheus)

Reindexer tool

• [fix] UpdateQuery/DeleteQuery crash fix
• [fea] Cancelling queries execution by Ctrl+C

go connector

• [fea] Iterator.NextObj() unmarshals data to any user provided struct

Version 2.3.2 (25.10.2019)

Core

• [fix] wrong WAL ring buffer size calculation on load from storage
• [fix] Make storage autorepair optional
• [fix] firstSortIndex assert on sort by hash indexes

Version 2.3.0 (11.10.2019)

Core

• [fix] Possible deadlock on tx, if it is canceled by timeout
• [fea] Join optimization (use indexes from left ns, instead of scan) if possible
• [fix] Replication races fixes
• [fea] Atomic namespace replace on forced sync replication
• [fea] Try to auto repair storage if reindexer does not shutdown correctly

Reindexer tool

• [fea] Table mode output

Reindexer server

• [fea] Added columns pre calculation for table output in GET /query request

go connector

• [fea] Added averaged cgo limiter usage statistics
• [fea] CGOSymbolizer added, output mixed go/c++ backtraces on crash

Face

• [fea] Improved SQL editor component
• [fix] Fixed behavior of keyboard shortcuts
• [fix] Total count of update/select operation in perf stats

Version 2.2.4 (30.09.2019)

Core

• [fix] Idset cache invalidation on upsert/delete null values to indexes
• [fix] Possible crash if sort orders disabled
• [fix] Wrong lowercasing field name on SQL UPDATE query
• [fea] Delete & Update queries in transactions

Reindexer tool

• [fea] Add command databases for operating with databases
• [fea] Add suggestions for commands and databases names
• [fix] Replxx dependency reverted to stable version
• [fea] Using default dsn cproto:://127.0.0.1:6534/

go connector

• [fea] Delete & Update queries in transactions

Version 2.2.3 (18.09.2019)

Core

• [fix] Fulltext queries sort by another field
• [fea] Number of background threads for sort optimization can be changed from #config namespace
• [fix] Sort optimization choose logic is improoved

go connector

• [fix] leak seq from chan
• [fix] check ctx.Done while waiting on cgo limiter

Version 2.2.2 (15.09.2019)

Core

• [fea] More effective usage of btree index for GT/LT and sort in concurent read write operations
• [fix] Potential crash on index update or deletion
• [fea] Timeout of background indexes optimization can be changed from #config namespace

Reindexer server

• [fea] User list moved from users.json to users.yml
• [fea] Hash is used insead of plain password in users.yml file
• [fix] Pass operation timeout from cproto client to core

Version 2.2.1 (07.09.2019)

Core

• [fea] Updated behaviour of Or InnerJoin statement
• [fea] Store backups of system records in storage
• [fix] Replicator can start before db initalization completed
• [fix] Search prefixes if enabled only postfixes

Reindexer server

• [fea] Added prometheus /metrics handler

Face

• [fea] Fulltext config editor
• [fea] Quick copy item's JSON from list view

Version 2.2.0 (27.08.2019)

Core

• [fea] Dynamic switch of replication role
• [fea] Facets by array fields
• [fea] JOIN now can be used in expression with another query conditions
• [fea] Support rocksdb as storage engine
• [fix] Race on concurent read from system namespaces
• [fix] Replication config sync fixed

Reindexer tool

• [fea] Add repair storage function

go connector

• [fix] Async tx goroutine fixed
• [fix] Replication in builtin mode fixed

Version 2.1.4 (15.08.2019)

• [fea] Reindexer server will not start if storage is corrupted, startwitherrors config flag is used to override
• [fix] Do not write to WAL empty update queries
• [fix] Replication config sync

Version 2.1.3 (14.08.2019)

Core

• [fea] Added two way sync of replication config and namespace
• [fea] Memory usage of indexes decreased (tsl::sparesmap has been added)
• [fea] Added non-normalized query in queries stats
• [fea] Add truncate namespace function
• [fix] Fixed unexpected hang and huge memory alloc on select by uncommited indexes
• [fix] Correct usage of '*' entry as default in namespaces config
• [fix] Memory statistics calculation are improoved
• [fix] Slave will not try to clear expired by ttl records

Version 2.1.2 (04.08.2019)

Core

• [fea] Added requests execution timeouts and cancelation contexts
• [fea] Join memory consumption optimization
• [fea] Current database activity statistics
• [fea] Use composite indexes for IN condition to index's fields
• [fea] Reset perfomance and queries statistics by write to corresponding namespace
• [fix] Crashes on index removal
• [fix] Do not lock namespace on tx operations
• [fix] SQL dumper will not add exceeded bracets
• [fea] Added updated_at field to namespace attributes

go connector

• [fea] Added requests execution timeouts and cancelation contexts
• [fea] Added async tx support
• [fea] Removed (moved to core) updated_at legacy code

Version 2.1.1 (12.06.2019)

Core

• [fix] sparse index crashes on type conflicts
• [fix] fixed memory stats for dataSize of string hash indexes

Reindexer server

• [fix] possible crash on http meta update
• [fix] return back item data via cproto on UpdateQuery operation

go connector

• [fix] Build builinserver with libunwind conflict fixed
• [fix] Query.Update panic fixed
• [fix] Stronger check of namespace's item's type (PkgPath is included to check)

Version 2.1.0 (08.06.2019)

Core

• [fea] Bracets in DSL & SQL queries
• [fix] Crash on LRUCache fast invalidation
• [fix] Relaxed JSON validation. Symbols with codes < 0x20 now are valid
• [fix] '\0' symbol in JSON will not broke parser
• [fea] Backtrace with line numbers for debug builds
• [fix] Replication fixes
• [fea] Support for jemalloc pprof features
• [fea] Detect tcmalloc pprof features in runtime
• [opt] Optimized memory statistics calculation

Reindexer server

• [fea] Return back item after update with atomic on update functions

Golang connector

• [fea] Add timeout/deadline support
• [fea] Add *Ctx methods with context.Context
• [fea] Return back item after update with atomic on update functions

Face

• [fea] Added table view of memory statistics
• [fea] Added red mark of error in SQL editor

Version 2.0.3 (04.04.2019)

Core

• [fea] Facets API improoved. Multiply fields and SORT features
• [fea] TTL added
• [fea] LIKE condition added
• [fea] Add expressions support in SQL UPDATE statement
• [fix] Invalid JSON generation with empty object name
• [fix] Unneccessary updating of tagsmatcher on transactions
• [fix] LRUCache invalidation crash fix

Reindexer server

• [fea] Added metadata maniplulation methods

Face

• [fea] Added metadata maniplulation GUI
• [fix] Performance statistics GUI improovements

Version 2.0.2 (08.03.2019)

Core

• [fea] Update fields of documents, with SQL UPDATE statement support
• [fea] Add SQL query suggestions
• [fea] Add DISTINCT support to SQL query
• [fea] Queries to non nullable indexes with NULL condition will return error
• [fix] Fixes of full text search, raised on incremental index build
• [fix] Queries with forced sort order can return wrong sequences
• [fix] RPC client&replicator multithread races
• [fix] DISTINCT condition to store indexes
• [fix] Caches crash on too fast data invalidation
• [fix] Disable execiton of delete query from namespace in slave mode
• [fix] Rebuild fulltext index if configuration changed
• [fix] Fixed handling SQL numeric conditions values with extra leading 0

Golang connector

• [fea] Query.Update method added
• [doc] Updated documentation and mapping for system Namespaces struct
• [fix] Support of POD types derived custom types
• [fix] Added MATCH condition support (alias EQ) to DSL

Reindexer server

• [fix] Report error if config file is not found

Reindexer tool

• [fea] Add UPDATE statement support

Face

• [fea] Add SQL query suggest
• [fea] GUI for database configuration
• [fea] GUI and charts for performance and memory statistics

Version 2.0.0 (07.01.2019)

Core

• [fea] Master-slave replication added (beta). Documentation
• [fea] Transactions support
• [fea] min/max/stddev values added to perfstat
• [fea] storage lazy load option added

Reindexer tool

• [fea] \subscribe command added

Version 1.10.4 (20.12.2018)

Core

• [fix] int64 and double conversion in JSON parser loose precision
• [fea] DELETE FROM SQL statement added
• [fix] SELECT *,COUNT(*) will not return items
• [fix] Crash on condition with arguments of different type to same index
• [fea] Aggregation function name added to aggregations results
• [fix] Incorrect limit/offset calculation on queries with SORT by non indexed fields

Go connector

• [fix] Struct verificator incorrect validation of composite reindex tags
• [fea] Pool usage statistics added to DB.Status() method

Reindexer server

• [fea] Added fields namespaces and enable_cache to GET|POST /db/:db/query method

Face

• [fea] Query builder added
• [fea] Delete all button added to items page
• [fea] Aggregations results view
• [fea] Edit/Delete function of query results added
• [fea] JSON index configuration editor
• [fea] Memory usage statistics round precision

Version 1.10.3 (02.12.2018)

Core

• [fix] Potential crash on delete from store string index
• [fix] Slow cache cleanup
• [fix] Print precision of double values decreased to actual double range

Reindexer server

• [fix] Invalid http redirects, if compiled with -DLINK_RESOURCES

Reindexer tool

• [fix] Unhandled exception in case trying of create output file in unexisting directory
• [fix] RPC client optimizations and races fixes
• [fea] \bench command added

Version 1.10.2 (20.11.2018)

Core

• [fea] Indexes rebuilding now is non blocking background task, concurrent R-W queries performance increased
• [fix] Fulltext index incremental rebuild memory grow fixed

Reindexer server

• [fix] Logger buffer increased, and will not block on errors
• [fix] DELETE Query method fixed
• [fix] urldecode of database names fixed

Reindexer tool

• [fix] Pretty print fixed

Version 1.10.1 (06.11.2018)

Core

• [fea] Incremental fulltext search index rebuild
• [fea] Async C++ RPC client
• [fix] Fixed incorrect behaviour with non indexed field conditions
• [fix] Extra non indexed fields tests added
• [fix] Json parser memleak fixed

Reindexer server

• [fea] REST API documentation improoved
• [fea] Optimized performance

Reindexer tool

• [fea] Operation speed is improoved

Version 1.10.0 (29.10.2018)

Core

• [fea] Added explain query feature
• [fea] Added min, max and facets aggregation functions
• [fea] Added EqualPosition query function
• [fea] In SQL query parser/printer added is NULL condition
• [fea] Native bool data type support
• [fea] Filter nested fields in SelectFilter statement
• [fix] Fix crash on comparator with Join queries
• [fix] Incorrect sort order using with Join queries in join cache optimization step
• [ref] Composite indexes now using json_paths for list of fields
• [ref] Storage format has been changed, and incompatible with this version. To migrate date from previous version use reindexer_tool

Go connector

• [fea] reindexer.Status method added, to check connector status after initialization
• [fea] OpenNamespace now register namespace <-> struct mapping without server connection requiriment
• [fix] int type is now converted to int32/int64 depends on architecture

Python connector

• [fea] Python connector v.0.0.1 is released.

Reindexer server

• [fea] Added fields filter to method GET /api/v1/:db/:namespace:/items mathed
• [fea] Added method DELETE /api/v1/:db/query
• [fea] Added poll loop backend (osx,bsd)
• [ref] json_path renamed to json_paths, and now array
• [ref] Binary cproto protocol has been optimized and changed. Please consider to update clients
• [fix] EnumMeta method has been fixed
• [fix] ModifyItem will retry attempt if tags <-> names state is invalidated

Face

• [fea] Added EXPLAIN query stats view
• [fea] Added tags selector component for json_paths to index create/modify form

Version 1.9.7 (28.09.2018)

Core

• [fea] Storing index configuration in storage
• [fea] Concurent R-W queries performance optimization
• [fea] Added indexes runtime performance statistics
• [fix] Incorrect NOT behaviour on queries with only comparators
• [fix] Race condition on shutdown
• [fix] Type conversion on queries without indexes

Go connector

• [fea] Added public AddIndex/DropIndex/UpdateIndex methods
• [ref] ConfigureIndex method deprecated
• [ref] appendable logic has been moved from C++ core to golang connector
• [fix] Multiple database support in embeded mode.

Reindexer tool

• [fix] Fixed restoring namespaces with index names non equal to json paths

Version 1.9.6 (03.09.2018)

Core

• [fea] Merge with Join queries support
• [fea] Sort by multiple columns/indexes
• [fix] Case insensivity for index/namespaces names
• [fix] Sparse indexes behavior fixed
• [fix] Full text index - correct calculatuon of distance between words
• [fix] Race condition on concurent ConfigureIndex requests

Reindexer server

• [fea] Added modify index method

Go connector

• [fea] New builtinserver binding: builtin mode for go application + bundled server for external clients
• [fea] Improoved validation of go struct reindex tags

Version 1.9.5 (04.08.2018)

Core

• [fea] Sparse indexes
• [fix] Fixed errors on conditions to unindexed fields
• [fix] Fulltext terms relevancy, then query contains 2 terms included to single word
• [fea] Customizable symbols set of "words" symbols for fulltext
• [fix] Incorrect behavior on addition index with duplicated json path of another index

Reindexer tool

• [fix] Fixed deadlock on linux
• [fix] Fixed \dump command namespace list parsing

Reindexer server

• [fea] Added method /api/v1/check with system information about memory consumption, uptime and version
• [fea] Passing to RPC client information about version and uptime
• [fea] Optional embed web resources to server binary

Face

• [fix] Incorrect urlencode for document update API url
• [fix] Namespace view layout updated, jsonPath added to table

Go connector

• [fix] Fixed error after closing connection by timeout
• [fix] Caches invalidation on server restart

Version 1.9.4 (25.07.2018)

Core

• [fea] Conditions to any fields, even not indexed
• [fea] cproto network client added
• [fix] Query execution plan optimizator fixes.

Reindexer tool

• [fea] Command line editor. tool has been mostly rewritten at all
• [fea] Interopertion with standalone server

Reindexer server

• [fea] Pagination in the GET sqlquery HTTP method
• [fea] Filtration in the GET items HTTP method

Face

• [fea] Table view of items page
• [fea] Filtration in the items page
• [fea] SQL queries history

Version 1.9.3 (20.06.2018)

Core

• [fea] Added system namespaces #memstats #profstats #queriesstats #namespaces with executuin and profiling statistics
• [fea] Added system namespace #config with runtime profiling configuration
• [fix] Join cache memory limitation
• [fix] Fixed bug with cjson parsing in nested objects on delete
• [fix] 32 bit reference counter for records instead of 16 bit
• [fix] Crash on load namespaces from storage with custom sort order
• [fix] Crash on select from composite index, after delete last shared string copy for sub part of composite index
• [fix] Full text build threads limited to 8

Reindexer Server

• [fea] Load data in multiple threads on startup
• [fea] Auto rebalance connection between worker threads
• [fix] "Authorization" http header case insensitivity lookup
• [fix] Unexpected exit on SIGPIPE
• [fix] Namespaces names are now url decoded

Go connector

• [fea] Ability to pass extra options to bindings
• [ref] cgo buffers cleanup optimization

Version 1.9.2 (04.06.2018)

Core

• [fea] SQL parser performance improved
• [fea] Caching of intermediate join results
• [fix] Assert on error cjson parser disabled: server will not crash on application errors
• [fix] Relaxed check of fields type on index addition and loading from storage
• [fix] Potential field data corruption on runtime index addition

Reindexer server

• [fix] Correct grow of input buffer for http and cproto connections
• [ref] HTTP parser and router refactored.
• [fix] gprof handlers fixes
• [fix] packages dependencies fixed, installation errors on centos fixes, path to webroot fixed
• [ci] added sanity tests of packages installations

Go connector

• [fea] Checking for duplicate names in json struct's tags on OpenNamespace
• [fea] Checking DeepCopy interface for correct return value on OpenNamespace
• [fix] Fixed error with sync payload types, on json queries
• [fix] Local imports of ./repo in benchmarks package broke gb

Version 1.9.1 (17.05.2018)

Reindexer server

• [fix] path to queries API

Face

• [fix] error on create indexes
• [fix] show 'new database windows 'in case of start without any databases

Version 1.9.0 (16.05.2018)

C++ core

• [fea] Search digits by words representation (now only for Russian language) in ft1
• [fix] Forced flush all batched writes to disk on exit
• [fix] Incorrect total count for queries without where clause
• [fea] custom collate now accepts sequence of letters
• [fix] Build issues with clang 3.9
• [fix] Cmake build dependencies, leveldb and snappy optionally added as ExternalProject
• [port] Windows and BSD build
• [port] 32 bit build

Reindexer tool

• [fea] Ability to input/output dump from stdin/stdout

Reindexer server

• [ref] Flags create_if_missed and drop_on_format_error are removed from namespaces API
• [fix] Correct behavior on logging different loggers to the same file
• [fix] CPU profiler error in case of
• [port] Ability to run as Windows service and cmake Windows NSIS installer

Go connector

• [fea] Removed cproto connector dependency on cgo
• [fea] cproto connector are compiled by default

Version 1.8.1 (26.04.2018)

C++ core

• [fix] Fix KeyValue::operator == for strings (IdSetCache isn't worked due this)
• [fix] Describe for composite indexes will return name alias
• [fix] Check for invalid PK indexes: Throw error on '-' (scan) PK
• [fix] Add missed comma in IndexDef JSON serializer
• [fix] Relevancy in case when first term from query found in non boosted field first
• [opt] Optimize AND performance in ft1
• [fea] Add extra debug output to ft1

Go connector

• [fix] Golang SQL query pseudo pre-parser accept all whitespace chars, not only ' '
• [fix] Correct composite PK handling in QueryTest
• [fix] Support of multiply index options in struct tag

Version 1.8.0 (17.04.2018)

C++ core

• [fea] Support of custom letters order set for string collates
• [fea] Full text indexing memory consumption optimization
• [fea] Thread russian letter ё as е in full text index
• [fix] Fixed incorrect behavior of full text search with term *<stop-word>
• [fix] Fixed full text behavior with FtDSL started with +
• [fix] Fix conflict of with leveldb's and reindexer's tcmalloc library

Reindexer server

• [fea] Added daemonize mode to reindexer_server
• [fix] init.d script fixes
• [fea] Added CPU profiling mode to built-in HTTP pprof server

Version 1.7.0 (05.04.2018)

C++ core

• [fea] Support join, marge, aggregations in json DSL & SQL queris
• [fea] Added multiline form and comments in SQL query
• [fix] Last symbol of documents was not used by fulltext indexer
• [fix] Potential data corruption after removing index

Go connector

• [fea] Batching of free c-buffers calls
• [fea] Added cgo limiter for deleteQuery call

Reindexer server beta

• [fea] POST /api/v1/:db/sqlquery method
• [fea] Added sort_order to GET /api/v1/db method

Version 1.6.0 (18.03.2018)

C++ core

• [fea] Composite indexes direct queries support
• [fea] Fulltext support functions snippet and highlight
• [fix] Added utf8 strings validation
• [fix] WrSerializer::Printf incorrect buffer maxlen calculation
• [ref] utf8 collates does not allocate extra memory
• [ref] sort by unordered indexes optimizations
• [ref] Join queries optimizations

Go connector

• [ref] Raise panic on Query reuse in Join
• [fea] Composite indexes direct queries support

Reindexer server beta

• [fea] Write components logs to separate files
• [ref] Protocol breaking changes

Version 1.5.0 (02.03.2018)

Reindexer server beta released:

• [fea] Added cmake package target for RPM & DEB based systems
• [fea] sysv5 initscript added
• [fea] Binary cproto RPC protocol introduced
• [fea] Graceful server shutdown on SIGTERM and SIGINT
• [fea] Multiply databases support was implemented
• [fea] HTTP REST API changed: db name added to path, optional HTTP basic authorization (disabled by default)
• [fea] HTTP REST API for add/drop indexes added
• [fea] Configuration moved to separate .yml file

C++ Core

• [ref] Item and Reindexer classes API has been redesigned. C++ tests was refactored to run with new API
• [fix] Potential race conditions and memory leak was fixed
• [fix] Fixed Query optimization bug. Queries with Join and precondition with GT/LT condition can return incorrect results
• [fea] Add/Drop indexes without reloading data
• [ref] Redundant Makefiles removed
• [del] Ugly RenameNamespace & CloneNamespace API was removed
• [fix] Fixed unnecessary copy results of precondition Join Query

Go connector

• [fea] cproto connector to standalone server
• [fix] Potential races was fixed
• [del] Tx now alias to Batch. Old update logic was deprecated
• [fix] Limit cgo execution to 2K goroutines to avoid exceed of OS threads limit
• [ref] EnableStorage method was deprecated
• [fix] Query builder did not reset opOR after InnerJoin

Misc