Release 2.18.0 #7596

pallavisontakke · 2025-01-16T12:22:27Z

This release contains performance improvements and bug fixes since
the 2.17.2 release. We recommend that you upgrade at the next
available opportunity.

Features

Add support for transition tables #6901: Add hypertable support for transition tables.
Table access method for compressed hypertables #7104: Hypercore table access method.
Push down ORDER BY for realtime caggs #7271: Push down order by in real-time continuous aggregate queries.
Add ALTER TABLE SET ACCESS METHOD support #7295: Support alter table set access method on hypertable.
Vectorized aggregation with grouping by one fixed-size column #7341: Vectorized aggregation with grouping by one fixed-size by-value compressed column (such as arithmetic types).
Remove custom hashagg code #7390: Disable custom hashagg planner code.
Change parameter name to enable Hypercore TAM #7411: Change parameter name to enable hypercore table access method.
Add GUC for hypercore_use_access_method default #7412: Add GUC for hypercore_use_access_method default.
Add GUC for segmentwise recompression #7413: Add GUC for segmentwise recompression.
Add support for merging chunks #7433: Add support for merging chunks.
Add index creation on orderby columns #7436: Add index creation on order by columns.
Add aliases for compression functions and views #7443: Add hypercore function and view aliases.
Allow DROP NOT NULL on column of compressed table #7455: Support drop not null on compressed hypertables.
Vectorize aggregate FILTER clause #7458: Support vecorized aggregation with aggregate filter clauses that are also vectorizable.
Optimize segmentwise recompression #7482: Optimize recompression of partially compressed chunks.
Prevent building against pg versions with broken ABI #7486: Prevent building against postgres versions with broken ABI.
Add optional force argument to refresh_continuous_aggregate #7521: Add optional force argument to refresh_continuous_aggregate.
Apply sort transform optimizations to compressed chunks #7528: Transform sorting on time_bucket to sorting on time for compressed chunks in some cases.
Add hint when hypertable creation fails #7565: Add hint when hypertable creation fails.
Add a cagg config parameter to override the instance-level timescaledb.enable_tiered_reads GUC #7587: Add include_tiered_data parameter to add_continuous_aggregate_policy API.

Bugfixes

Remove obsolete job #7378: Remove obsolete job referencing policy_job_error_retention.
Update bgw job table when altering procedure #7409: Update bgw_job table when altering procedure.
[Bug]: "Aggregated Compressed Column Not Found" Error on Aggregation Query in TimescaleDB #7410: Fix the aggregated compressed column not found error on aggregation query.
Fix datetime parse error in chunk constraint creation #7426: Fix datetime parsing error in chunk constraint creation.
Verify that heap tuple is valid before using #7432: Verify that the heap tuple is valid before using.
Fix segfault when setting chunk replica identity #7434: Fixes the segfault when internally setting the replica identity for a given chunk.
Emit error on transition table trigger for chunks #7488: Emit error for transition table trigger on chunks.
Fix error: invalid child of chunk append #7514: Fix the error: invalid child of chunk append.
Fix CAgg migration performance regression #7517: Fixes the performance regression on cagg_migrate procedure.
Restart scheduler on error #7527: Restart scheduler on error.
Fix NULL handling for in-memory tuple filtering #7557: Fix null handling for in-memory tuple filtering.
Improve transaction check in refresh_cagg #7566: Improve transaction check in CAgg refresh.
Fix NaN-handling for vectorized aggregation #7584: Fix NaN-handling for vectorized aggregation.

Thanks

@bharrisau for reporting the segfault when creating chunks.
@k-rus for suggesting the improvement to add a hint when hypertable creation fails.
@pgloader for reporting the issue in an internal background job.
@staticlibs for sending Pull Request to improve the transaction check in CAgg refresh.
@uasiddiqi for reporting the aggregated compressed column not found error.

@bharrisau

This release contains performance improvements and bug fixes since the 2.17.2 release. We recommend that you upgrade at the next available opportunity. **Features** * timescale#6901: Add hypertable support for transition tables. * timescale#7104: Hypercore table access method. * timescale#7271: Push down `order by` in real-time continuous aggregate queries. * timescale#7295: Support `alter table set access method` on hypertable. * timescale#7341: Vectorized aggregation with grouping by one fixed-size by-value compressed column * timescale#7390: Disable custom `hashagg` planner code. * timescale#7411: Change parameter name to enable hypercore table access method. * timescale#7412: Add GUC for `hypercore_use_access_method` default. * timescale#7413: Add GUC for segmentwise recompression. * timescale#7433 Add support for merging chunks * timescale#7436 Add index creation on orderby columns * timescale#7443: Add hypercore function and view aliases. * timescale#7455: Support `drop not null` on compressed hypertables. * timescale#7458: Support vecorized aggregation with aggregate `filter` clauses that are also vectorizable. * timescale#7482: Optimize recompression of partially compressed chunks. * timescale#7486: Prevent building against postgres versions with broken ABI. * timescale#7521 Add optional `force` argument to `refresh_continuous_aggregate` * timescale#7528 Transform sorting on `time_bucket` to sorting on time for compressed chunks in some cases. * timescale#7565 Add hint when hypertable creation fails * timescale#7587 Add `include_tiered_data` parameter to `add_continuous_aggregate_policy` API **Bugfixes** * timescale#7378: Remove obsolete job referencing `policy_job_error_retention`. * timescale#7409: Update `bgw_job` table when altering procedure. * timescale#7410: Fix the `aggregated compressed column not found` error on aggregation query. * timescale#7426: Fix `datetime` parsing error in chunk constraint creation. * timescale#7432: Verify that the heap tuple is valid before using. * timescale#7434: Fixes the segfault when internally setting the replica identity for a given chunk. * timescale#7488: Emit error for transition table trigger on chunks. * timescale#7514: Fix the error: `invalid child of chunk append`. * timescale#7517 Fixes performance regression on `cagg_migrate` procedure * timescale#7527 Restart scheduler on error * timescale#7557: Fix null handling for in-memory tuple filtering. * timescale#7566 Improve transaction check in CAgg refresh * timescale#7584 Fix NaN-handling for vectorized aggregation **Thanks** * @bharrisau for reporting the segfault when creating chunks. * @k-rus for suggesting the improvement * @pgloader for reporting the issue in an internal background job. * @staticlibs for sending PR to improve transaction check in CAgg refresh * @uasiddiqi for reporting the `aggregated compressed column not found` error.

codecov · 2025-01-16T12:33:26Z

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 82.31%. Comparing base (59f50f2) to head (dff3199).
Report is 700 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #7596      +/-   ##
==========================================
+ Coverage   80.06%   82.31%   +2.24%     
==========================================
  Files         190      238      +48     
  Lines       37181    44139    +6958     
  Branches     9450    11101    +1651     
==========================================
+ Hits        29770    36334    +6564     
- Misses       2997     3425     +428     
+ Partials     4414     4380      -34

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Formatting and a couple of other changes.

billy-the-fish

Couple of small suggestions.

billy-the-fish · 2025-01-17T08:54:17Z

CHANGELOG.md

+* #7341: Vectorized aggregation with grouping by one fixed-size by-value compressed column (such as arithmetic types).
+* #7390: Disable custom `hashagg` planner code.
+* #7411: Change parameter name to enable hypercore table access method.
+* #7412: Add GUC for `hypercore_use_access_method` default.


Suggested change

* #7412: Add GUC for `hypercore_use_access_method` default.

* #7412: Add [GUC](https://www.postgresql.org/docs/current/acronyms.html#:~:text=GUC) for the `hypercore_use_access_method` default.

billy-the-fish · 2025-01-17T09:04:32Z

CHANGELOG.md

+* #7410: Fix the `aggregated compressed column not found` error on aggregation query.
+* #7426: Fix `datetime` parsing error in chunk constraint creation.
+* #7432: Verify that the heap tuple is valid before using.
+* #7434: Fixes the segfault when internally setting the replica identity for a given chunk.


Suggested change

* #7434: Fixes the segfault when internally setting the replica identity for a given chunk.

* #7434: Fix the segfault when internally setting the replica identity for a given chunk.

billy-the-fish · 2025-01-17T09:04:56Z

CHANGELOG.md

+* #7434: Fixes the segfault when internally setting the replica identity for a given chunk.
+* #7488: Emit error for transition table trigger on chunks.
+* #7514: Fix the error: `invalid child of chunk append`.
+* #7517: Fixes the performance regression on `cagg_migrate` procedure.


Suggested change

* #7517: Fixes the performance regression on `cagg_migrate` procedure.

* #7517: Fix the performance regression on the `cagg_migrate` procedure.

billy-the-fish · 2025-01-17T09:05:42Z

CHANGELOG.md

+
+**Thanks**
+* @bharrisau for reporting the segfault when creating chunks.
+* @k-rus for suggesting the improvement to add a hint when hypertable creation fails.


Suggested change

* @k-rus for suggesting the improvement to add a hint when hypertable creation fails.

* @k-rus for suggesting that we add a hint when hypertable creation fails.

billy-the-fish · 2025-01-17T09:06:18Z

CHANGELOG.md

+* @bharrisau for reporting the segfault when creating chunks.
+* @k-rus for suggesting the improvement to add a hint when hypertable creation fails.
+* @pgloader for reporting the issue in an internal background job.
+* @staticlibs for sending Pull Request to improve the transaction check in CAgg refresh.


Suggested change

* @staticlibs for sending Pull Request to improve the transaction check in CAgg refresh.

* @staticlibs for sending the pull request that improves the transaction check in CAgg refresh.

github-actions bot assigned pallavisontakke Jan 16, 2025

pallavisontakke requested review from fabriziomello, atovpeko, philkra, svenklemm, mkindahl, billy-the-fish and akuzm January 16, 2025 12:24

philkra added this to the TimescaleDB 2.18.0 milestone Jan 16, 2025

Modify release notes

dff3199

Formatting and a couple of other changes.

mkindahl approved these changes Jan 17, 2025

View reviewed changes

billy-the-fish approved these changes Jan 17, 2025

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Release 2.18.0 #7596

Release 2.18.0 #7596

pallavisontakke commented Jan 16, 2025 •

edited

Loading

codecov bot commented Jan 16, 2025 •

edited

Loading

billy-the-fish left a comment

billy-the-fish Jan 17, 2025

billy-the-fish Jan 17, 2025

billy-the-fish Jan 17, 2025

billy-the-fish Jan 17, 2025

billy-the-fish Jan 17, 2025

	* #7412: Add GUC for `hypercore_use_access_method` default.
	* #7412: Add [GUC](https://www.postgresql.org/docs/current/acronyms.html#:~:text=GUC) for the `hypercore_use_access_method` default.

	* #7434: Fixes the segfault when internally setting the replica identity for a given chunk.
	* #7434: Fix the segfault when internally setting the replica identity for a given chunk.

	* #7517: Fixes the performance regression on `cagg_migrate` procedure.
	* #7517: Fix the performance regression on the `cagg_migrate` procedure.

	* @k-rus for suggesting the improvement to add a hint when hypertable creation fails.
	* @k-rus for suggesting that we add a hint when hypertable creation fails.

	* @staticlibs for sending Pull Request to improve the transaction check in CAgg refresh.
	* @staticlibs for sending the pull request that improves the transaction check in CAgg refresh.

Release 2.18.0 #7596

Are you sure you want to change the base?

Release 2.18.0 #7596

Conversation

pallavisontakke commented Jan 16, 2025 • edited Loading

codecov bot commented Jan 16, 2025 • edited Loading

Codecov Report

billy-the-fish left a comment

Choose a reason for hiding this comment

billy-the-fish Jan 17, 2025

Choose a reason for hiding this comment

billy-the-fish Jan 17, 2025

Choose a reason for hiding this comment

billy-the-fish Jan 17, 2025

Choose a reason for hiding this comment

billy-the-fish Jan 17, 2025

Choose a reason for hiding this comment

billy-the-fish Jan 17, 2025

Choose a reason for hiding this comment

pallavisontakke commented Jan 16, 2025 •

edited

Loading

codecov bot commented Jan 16, 2025 •

edited

Loading