Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

using postgres as hive metastore #27

Merged
merged 3 commits into from
Jun 8, 2024
Merged

using postgres as hive metastore #27

merged 3 commits into from
Jun 8, 2024

Conversation

Tianhao-Gu
Copy link
Collaborator

@Tianhao-Gu Tianhao-Gu commented Jun 7, 2024

Using PostgreSQL instead of the default Derby DB will resolve the concurrency issues

Copy link

codecov bot commented Jun 7, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 52.50%. Comparing base (25f67eb) to head (bf150c7).

Additional details and impacted files
@@           Coverage Diff           @@
##             main      #27   +/-   ##
=======================================
  Coverage   52.50%   52.50%           
=======================================
  Files           3        3           
  Lines          80       80           
=======================================
  Hits           42       42           
  Misses         38       38           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

config/hive-site-template.xml Show resolved Hide resolved
config/hive-site-template.xml Outdated Show resolved Hide resolved
config/hive-site-template.xml Show resolved Hide resolved
config/hive-site-template.xml Show resolved Hide resolved
docker-compose.yaml Show resolved Hide resolved
docker-compose.yaml Show resolved Hide resolved
docker-compose.yaml Outdated Show resolved Hide resolved
scripts/setup.sh Show resolved Hide resolved
@MrCreosote
Copy link
Member

I assume we're going to need to reload data again once this is up in rancher yeah?

@Tianhao-Gu
Copy link
Collaborator Author

I assume we're going to need to reload data again once this is up in rancher yeah?

Yea. Unfortunately.

@Tianhao-Gu
Copy link
Collaborator Author

Tianhao-Gu commented Jun 7, 2024

Now I can test concurrent querying of the table from both the development and user notebooks, and it works fine.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is getting big enough we might want to consider porting it to python

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@Tianhao-Gu Tianhao-Gu merged commit 1d4b779 into main Jun 8, 2024
9 checks passed
@Tianhao-Gu Tianhao-Gu deleted the dev_using_postgres branch June 8, 2024 11:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants