v0.13.5

What's Changed

• Numeric: refactoring and truncate for BigQuery by @Amogh-Bharadwaj in #1746
• S3: add endpoint field to UI by @Amogh-Bharadwaj in #1749
• Create peer select UI: Split Kafka peers into 3 by @Amogh-Bharadwaj in #1752
• wal heartbeat: allow overriding query with env variable by @serprex in #1725
• Enable oneSync always by @iskakaushik in #1755
• qrep pgvalue by @serprex in #1733
• feat(cdc): reload peers on flow resume by @iskakaushik in #1763
• CDC scripting by @serprex in #1756
• switching to local protobuf plugins in CI by @heavycrystal in #1762
• Add edit peer UI that is accessible from the peer page by @iskakaushik in #1764
• fix: close and recreate destination connections during syncflow when needed by @iamKunalGupta in #1735
• Snowflake: use sysdate() for peerdb synced at by @Amogh-Bharadwaj in #1769
• Read and dial timeouts of 1 hour for clickhouse by @Amogh-Bharadwaj in #1772

New Contributors

• @zachblume made their first contribution in #1745

Full Changelog: v0.13.3...v0.13.5

v0.13.3

Full Changelog: v0.13.2...v0.13.3

v0.13.2

New Contributors

• @exitxhu made their first contribution in #1681

Full Changelog: v0.13.1...v0.13.2

v0.13.1

What's Changed

• fix: watermark columns not displaying in QRep mirror creation by @heavycrystal in #1651

Full Changelog: v0.13.0...v0.13.1

v0.13.0

What's Changed

This release of PeerDB stars the introduction of a brand new ElasticSearch connector for query replication. Secondly, it ships an in-house min.io bucket integration for the Clickhouse peer, boosting its usability. Also included is a major effort towards perfection of Postgres to Postgres CDC and improved performance of replication to queues. Improvements to UI, tests and telemetry are featured as well.

• ⚙️ Elasticsearch connector for QRep by @heavycrystal in #1618
• 📦 In-house S3 stage for Clickhouse by @Amogh-Bharadwaj in #1634
• 🔄 PgValue variant bypassing QValue for more efficient & correct PG<>PG mirroring by @serprex in #1565
• 🌐 Lua: peerdb.LuaRowTable by @serprex in #1612
• ⚡ Parallelized Lua script execution with serialized output by @serprex in #1613
• 🖥️ UI Create Peer: replace dropdown with columns of buttons by @serprex in #1611
• ❄️ Snowflake: Addition of dynamic numeric columns by @Amogh-Bharadwaj in #1590
• 📊 Queues: communicate flushes back to source in order to keep slot size down by @serprex in #1626
• 💻 UI for opting into PG type system by @Amogh-Bharadwaj in #1630
• 🎯 Eventhubs E2E foundation by @Amogh-Bharadwaj in #1631
• 🛠️ AWS: add credentials loading mechanism using SDK config by @iamKunalGupta in #1507
• 🧪 Framework for ES tests + basic QRep test by @heavycrystal in #1644
• 🖼️ UI: Better Create QRep by @Amogh-Bharadwaj in #1643
• 🗑️ Soft delete false for Snowflake initial load by @Amogh-Bharadwaj in #1647
• 🔔 Alerting: enhance telemetry logging by @iamKunalGupta in #1642

Full Changelog: v0.12.2...v0.13.0

v0.12.2

What's Changed

• grpc: use NewClient by @serprex in #1587
• Touch up Scripts UI by @serprex in #1592
• Warehouse numeric interface by @Amogh-Bharadwaj in #1591
• BigQuery: add flag-gated time partitioning by @Amogh-Bharadwaj in #1588
• UI Peer dropdowns: add tembo and crunchy by @Amogh-Bharadwaj in #1599
• Lua: add unchanged_columns field to Record by @serprex in #1608
• UI: split initial load table into 2 by @Amogh-Bharadwaj in #1607
• UI Mirror page: better overview by @Amogh-Bharadwaj in #1605

Full Changelog: v0.12.1...v0.12.2

v0.12.1

v0.12.1 release

v0.12.0

What's Changed

Version 12 of PeerDB features a new wing to the product - queues. This release introduces support for mirrors to Kafka, PubSub and Azure Eventhubs with transformations using Lua scripts. Documentation for this feature is ongoing at: https://docs.peerdb.io/lua/reference
This version also provides new UI indicators for the mirror page, improved data type mapping and performance/robustness boosts for initial load and CDC.

• Kafka and Lua scripting by @serprex in #1461
• Add scripting to eventhubs by @serprex in #1571
• UI: Create Eventhub Peer and Eventhub Mirror by @Amogh-Bharadwaj in #1566
• PubSub support @serprex in #1524
• UI: Initial load status for initial load tab by @Amogh-Bharadwaj in #1522
• UI CDC: Show inserts, updates and deletes by @Amogh-Bharadwaj in #1525
• UI: Scripts console by @Amogh-Bharadwaj in #1547
• UI: Also show partitioned tables in table picker by @Amogh-Bharadwaj in #1574
• Initial Load: Improved parallelism performance @serprex in #683
• Change QValue into an interface by @serprex in #1528
• Peerdb stats: add source and dest table info for qrep run by @Amogh-Bharadwaj in #1540
• Faster replication connection reset by @serprex in #1549
• qrep: list views, materialized views, & foreign tables in drop down by @serprex in #1550
• Snowflake: null out numerics >38 digits by @serprex in #1554
• UI: Add create mirror buttons by @Amogh-Bharadwaj in #1556
• queues: default script json encodes record by @serprex in #1557
• Eventhub peer refactor by @Amogh-Bharadwaj in #1563
• QRep: Adjust start value for TID watermark column by @Amogh-Bharadwaj in #1569
• kafka/pubsub: PEERDB_QUEUE_FLUSH_TIMEOUT_SECONDS by @serprex in #1559

New Contributors

• @yasinzaehringer-paradime made their first contribution in #1537

Full Changelog: v0.11.4...v0.12.0

v0.11.4

Full Changelog: v0.11.3...v0.11.4

v0.11.3

What's Changed

This release includes some data type improvements for Snowflake, along with some more improvements and test additions to boost robustness

• column exclusion - properly handle schema changes by @heavycrystal in #1512
• UI: remove pub load check by @Amogh-Bharadwaj in #1510
• SF storage integration fixes by @heavycrystal in #1517
• Geospatial data types: set SRID for geometry by @Amogh-Bharadwaj in #1514
• Mirror page: actions dropdown by @Amogh-Bharadwaj in #1513
• Snowflake: Support interval data type by @Amogh-Bharadwaj in #1515
• Add heartbeats to account for QRepPartitionIsSynced by @Amogh-Bharadwaj in #1518
• test for column exclusion with schema changes by @heavycrystal in #1519
• Refactor peer validate check functions by @Amogh-Bharadwaj in #1521

Full Changelog: v0.11.2...v0.11.3