-
Notifications
You must be signed in to change notification settings - Fork 180
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Fix issue reported by the community in slack with lineage in Cosmos 1…
….1 (#526) Fix the following issue, that was reported in [slack](https://apache-airflow.slack.com/archives/C059CC42E9W/p1694212778764869) by a user named Sai: "After upgrading to cosmos 1.1, I see the below error in Airflow logs. I don't have any OpenLineage integrations. Is there a way to stop emitting this error?" ``` [2023-09-08, 22:28:07 UTC] {taskinstance.py:1318} INFO - Marking task as SUCCESS. dag_id=high_freq_core_dbt, task_id=dbt_front.daily_company_user_metrics.daily_company_user_metrics_run, execution_date=20230908T183000, start_date=20230908T222730, end_date=20230908T222807 [2023-09-08, 22:28:07 UTC] {manager.py:61} ERROR - Failed to extract metadata 'TaskInstance' object has no attribute 'openlineage_events_completes' task_type=DbtRunLocalOperator airflow_dag_id=high_freq_core_dbt task_id=dbt_front.daily_company_user_metrics.daily_company_user_metrics_run airflow_run_id=scheduled__2023-09-08T18:30:00+00:00 Traceback (most recent call last): File "/home/airflow/python-venvs/data-pipelines/lib/python3.10/site-packages/openlineage/airflow/extractors/manager.py", line 45, in extract_metadata task_metadata = extractor.extract_on_complete(task_instance) File "/home/airflow/python-venvs/data-pipelines/lib/python3.10/site-packages/openlineage/airflow/extractors/base.py", line 116, in extract_on_complete return self._get_openlineage_facets( File "/home/airflow/python-venvs/data-pipelines/lib/python3.10/site-packages/openlineage/airflow/extractors/base.py", line 124, in _get_openlineage_facets facets: OperatorLineage = get_facets_method(*args) File "/home/airflow/python-venvs/data-pipelines/lib/python3.10/site-packages/cosmos/operators/local.py", line 318, in get_openlineage_facets_on_complete for completed in task_instance.openlineage_events_completes: AttributeError: 'TaskInstance' object has no attribute 'openlineage_events_completes' ``` The issue was reported to happen using: * Airflow version: v2.5.1 * dbt version: 1.5.1 * without any intentional setup of OpenLineage Since the issue was reported, I learned that `get_openlineage_facets_on_complete` is called even if `execute` fails because `get_openlineage_facets_on_failure` is not currently implemented. Closes: #530 (Rust dependency issue reported)
- astronomer-cosmos-v1.8.1
- astronomer-cosmos-v1.8.1a1
- astronomer-cosmos-v1.8.0
- astronomer-cosmos-v1.8.0a5
- astronomer-cosmos-v1.8.0a4
- astronomer-cosmos-v1.8.0a3
- astronomer-cosmos-v1.8.0a2
- astronomer-cosmos-v1.8.0a1
- astronomer-cosmos-v1.7.1
- astronomer-cosmos-v1.7.1a3
- astronomer-cosmos-v1.7.1a2
- astronomer-cosmos-v1.7.1a1
- astronomer-cosmos-v1.7.0a1
- astronomer-cosmos-v1.6.1a1
- astronomer-cosmos-v1.6.0
- astronomer-cosmos-v1.6.0a8
- astronomer-cosmos-v1.6.0a7
- astronomer-cosmos-v1.6.0a6
- astronomer-cosmos-v1.6.0a5
- astronomer-cosmos-v1.6.0a4
- astronomer-cosmos-v1.6.0a3
- astronomer-cosmos-v1.6.0a2
- astronomer-cosmos-v1.6.0a1
- astronomer-cosmos-v1.5.1
- astronomer-cosmos-v1.5.1a3
- astronomer-cosmos-v1.5.1a2
- astronomer-cosmos-v1.5.1a1
- astronomer-cosmos-v1.5.0
- astronomer-cosmos-v1.5.0rc2
- astronomer-cosmos-v1.5.0rc1
- astronomer-cosmos-v1.5.0a9
- astronomer-cosmos-v1.5.0.a8
- astronomer-cosmos-v1.5.0a7
- astronomer-cosmos-v1.5.0a6
- astronomer-cosmos-v1.5.0a5
- astronomer-cosmos-v1.5.0a4
- astronomer-cosmos-v1.5.0a3
- astronomer-cosmos-v1.5.0a2
- astronomer-cosmos-v1.5.0a1
- astronomer-cosmos-v1.4.3
- astronomer-cosmos-v1.4.2
- astronomer-cosmos-v1.4.1
- astronomer-cosmos-v1.4.1rc1
- astronomer-cosmos-v1.4.0
- astronomer-cosmos-v1.4.0rc1
- astronomer-cosmos-v.1.4.0a4
- astronomer-cosmos-v1.4.0a2
- astronomer-cosmos-v1.4.0a1
- astronomer-cosmos-v1.3.2
- astronomer-cosmos-v1.3.1
- astronomer-cosmos-v1.3.0
- astronomer-cosmos-v1.3.0a4
- astronomer-cosmos-v1.3.0a3
- astronomer-cosmos-v1.3.0a2
- astronomer-cosmos-v1.3.0a1
- astronomer-cosmos-v1.2.5
- astronomer-cosmos-v1.2.4
- astronomer-cosmos-v1.2.3
- astronomer-cosmos-v1.2.2
- astronomer-cosmos-v1.2.1
- astronomer-cosmos-v1.2.0
- astronomer-cosmos-v1.2.0a1
- astronomer-cosmos-v1.1.3
- astronomer-cosmos-v1.1.2
- astronomer-cosmos-v1.1.1
- astronomer-cosmos-v1.1.1a1
- astronomer-cosmos-1.7.0
Showing
3 changed files
with
57 additions
and
18 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters