Acryl DataHub v0.8.31.1

Bugfixes for CLI

Full Commit Log

• datahub-project#4223 @tc350981 feat(notebook): add data models for Notebook entity
• datahub-project#4450 @pedro93 feat(frontend) Adds multiple group claim support
• datahub-project#4442 @anshbansal feat(ingestion): snowflake, bigquery - enhancements to log and bugfix
• datahub-project#4333 @anshbansal doc: add guide for ui tabs
• datahub-project#4443 @jjoyce0510 Fixing privilege option display bug
• datahub-project#4451 @gabe-lyons fix tableau connector when it cannot connect to URI
• datahub-project#4237 @tc350981 (docs) add RFC file to introduce Notebook entity data model
• datahub-project#4446 @kevinneville fix: Replace old repository link with new link
• datahub-project#4447 @cuong-pham getting database directly from upstream tables incase there are multiple databases in upstreamDatabases
• datahub-project#4436 @treff7es Passing entity properly on deletion
• datahub-project#4433 @rslanka Fix bug in the SchemaField type computation for AVRO logical types

Full Changelog: v0.8.31...v0.8.31.1

Acryl DataHub v0.8.31.1rc1

Bugfixes for CLI

Full Commit Log

• datahub-project#4223 @tc350981 feat(notebook): add data models for Notebook entity
• datahub-project#4450 @pedro93 feat(frontend) Adds multiple group claim support
• datahub-project#4442 @anshbansal feat(ingestion): snowflake, bigquery - enhancements to log and bugfix
• datahub-project#4333 @anshbansal doc: add guide for ui tabs
• datahub-project#4443 @jjoyce0510 Fixing privilege option display bug
• datahub-project#4451 @gabe-lyons fix tableau connector when it cannot connect to URI
• datahub-project#4237 @tc350981 (docs) add RFC file to introduce Notebook entity data model
• datahub-project#4446 @kevinneville fix: Replace old repository link with new link
• datahub-project#4447 @cuong-pham getting database directly from upstream tables incase there are multiple databases in upstreamDatabases
• datahub-project#4436 @treff7es Passing entity properly on deletion
• datahub-project#4433 @rslanka Fix bug in the SchemaField type computation for AVRO logical types

Full Changelog: v0.8.31...v0.8.31.1rc1

Acryl DataHub v0.8.31

Bugfix release to prevent failing reindexing of system metadata index in elasticsearch

Full Commit Log

• datahub-project#4440 @pedro93 fix(cli) Makes filtered search deletes include BOTH removed and non-removed
• datahub-project#4444 @pedro93 fix(cli) Adds elasticsearch mapping
• datahub-project#4432 @leifker feat(protobuf): Gradle protobuf example project

Acryl DataHub v0.8.30.0

Release Highlights

• Adds platform instance id to the container id generation, and support for migrating the old container ids to the new ones via the datahub migrate CLI.

Full Changelog: v0.8.29.2...v0.8.30.0

Acryl DataHub v0.8.30

Merge branch 'datahub-project:master' into master

Acryl DataHub v0.8.29.2

Release Highlights

• Fix problem introduced in v0.8.29.1 with air gapped environments
• Query timeseries aspects via CLI
• Various CLI fixes

Changelog

• datahub-project#4372 @Ankit-Keshari-Vituity Refactoring the quries into a single one to get the search results on Home Page
• datahub-project#4395 @rslanka feat(ingestion): cli - Add the ability to query the latest timeseries aspect value via the get command.
• datahub-project#4332 @JorgenEvens fix(ingest): handle endpoints without 200 response in openapi
• datahub-project#4391 @rslanka fix(ingestion): Invoke SqlLineageSQLParser's implementation in a separate process
• datahub-project#4345 @Abhiram98 fix(ingestion): redshift - read all tables
• datahub-project#4397 @WaStCo fix(query_combiner): add try block to handle queries of type str
• datahub-project#4335 @dexter-mh-lee Add flag to enable cache
• datahub-project#4388 @set5think build(ingestion): update markupsafe pinning for Airflow compatibility
• datahub-project#4408 @rslanka fix(ingestion): Fix mypy error stateful committable & restore mypy version.
• datahub-project#4400 @jjoyce0510 feat(autocomplete): Show recent searches + improved autocomplete
• datahub-project#4406 @anshbansal fix: telemetry failure should not cause CLI failure
• datahub-project#4354 @jjoyce0510 feat(*): Support setting owner type when assigning ownership
• datahub-project#4404 @aditya-radhakrishnan fix(containers) - configure domain resolver for containers
• datahub-project#4208 @MugdhaHardikar-GSLab feat(spark-lineage): add support for custom env and platform_instance

Full Changelog: v0.8.29.1...v0.8.29.2

Acryl Datahub v0.8.29.1

Known issues

• Regression related to mixpanel connectivity causing CLI failure in air-gapped environments

Release Highlights

• Improved logging for CLI

Changelog

• datahub-project#4386 @anshbansal fix: add missing logo
• datahub-project#4368 @cccs-eric fix(ingest) Azure AD: support nested groups (datahub-project#4367)
• datahub-project#4344 @anshbansal feat(ingestion): improve logging, docs for bigquery, snowflake, redshift
• datahub-project#4390 @gabe-lyons Revert "Fixed Bug: Alpha slider doesn’t move, only the color slider is movable in tag color picker (datahub-project#4359)"
• datahub-project#4393 @RyanHolstien docs(model): update docs on extending metadata model, remove inaccurate faq
• datahub-project#4178 @leifker feat(ingestion): add java protobuf schema ingestion
• datahub-project#4380 @jjoyce0510 fix(oidc): Update group membership each login (and make group extraction disabled by default)
• datahub-project#4382 @gabe-lyons fix(browse): fix browse double click issue
• datahub-project#4353 @dexter-mh-lee fix(removed): Make sure removed entities do not appear on recommendations
• datahub-project#4377 @mayurinehate feat(GE): add option to disable sql parsing, use default parser
• datahub-project#4359 @Ankit-Keshari-Vituity Fixed Bug: Alpha slider doesn’t move, only the color slider is movable in tag color picker
• datahub-project#4373 @maaaikoool fix(docs): change cabify link
• datahub-project#4381 @gabe-lyons fix(ui): some small ui fixes for lineage

Acryl Datahub v0.8.29

Release Highlights

• Memory leak detection in datahub cli
• Fix Bigquery ingestion bug
• Add database_alias functionality in Mysql

Changelog

• datahub-project#4360 @maaaikoool Add cabify as adopter
• datahub-project#4365 @dexter-mh-lee fix(vulnerabilities): Fix vulnerabilities in datahub-frontend
• datahub-project#4361 @jjoyce0510 fix(ui): Supporting unknown data platform type
• datahub-project#4363 @rslanka feat(ingest): Add memory leak detection capability to the datahub cli command.
• datahub-project#4366 @RyanHolstien fix(metadata-jobs): fix root context for springboot
• datahub-project#4340 @leifker feat(build): upgrade to gradle 6 for toolchain to support java 11
• datahub-project#4357 @anshbansal feat: change quickstart to use head tag for actions
• datahub-project#4356 @treff7es fix(ingest): bigquery - Fixing missing attribute error if credential was not set
• datahub-project#4319 @vcs9 feat(ingest): mysql - add database_alias functionality
• datahub-project#4352 @dexter-mh-lee fix(ci): fix model generation workflow
• datahub-project#4351 @jjoyce0510 fix(frontend): Fix common OIDC issues

Acryl DataHub v0.8.28.1

Patch Release Highlights

• Support Snowflake in Great Expectations integration
• Improve variable substitution into Recipes
• Improve configuration for BigQuery credentials (usage and bigquery)

Full Changelog: v0.8.28.0...v0.8.28.1

Acryl DataHub v0.8.28

Release Highlights

First Milestone: Column-Level Lineage is complete! The Metadata Model now supports “fine-grained” lineage for Datasets; see documentation here for details, including adding fine-grained lineage to a dataset or a datajob.

Define Dataset-to-Dataset lineage via YAML. As demonstrated in the February 2022 Town Hall, you can now set Dataset-level lineage via YAML. This is great for teams that have more bespoke lineage needs that cannot be auto-extracted by the current set of supported ingestion sources.

Track all changes to entities using the Timeline API. This unified timeline of changes to entities in the metadata graph provides a robust picture of how your metadata has evolved over time. Upcoming work will support surfacing this detail via the DataHub UI. See the overview from Town Hall here.

Miscellaneous Metadata Ingestion Updates:

• Incubating: PowerBI Ingestion Source
• BigQuery Profiling: ability to disable profiling by partition
• Tableau improvements: Workbooks are now modeled as “Containers”

Full Changelog: v0.8.27.2...v0.8.28.0