Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ADAP-1167: Add table format telemetry reporting to Athena adapter #403

Open
wants to merge 17 commits into
base: main
Choose a base branch
from

Conversation

VanTudor
Copy link
Contributor

Description

Send out table format telemetry data in the Athena Adapter

Checklist

  • This PR considers the contributing guide
  • This PR is small and focused on a single feature or bug fix
  • This PR includes unit testing, or unit testing is not necessary
  • This PR includes functional testing, or functional testing is not necessary

@VanTudor VanTudor requested a review from a team as a code owner January 13, 2025 12:25
Copy link

cla-bot bot commented Jan 13, 2025

Thanks for your pull request, and welcome to our community! We require contributors to sign our Contributor License Agreement and we don't seem to have your signature on file. Check out this article for more information on why we have a CLA.

In order for us to review and merge your code, please submit the Individual Contributor License Agreement form attached above above. If you have questions about the CLA, or if you believe you've received this message in error, please reach out through a comment on this PR.

CLA has not been signed by users: @VanTudor

@cla-bot cla-bot bot added the cla:yes The PR author has signed the CLA label Jan 13, 2025
@VanTudor VanTudor marked this pull request as draft January 13, 2025 13:25
@VanTudor VanTudor deployed to dbt-bigquery January 21, 2025 08:56 — with GitHub Actions Active
@@ -60,6 +60,10 @@
seeds__expected_target_post = "id,status\n" + "\n".join([f"{i},{i}" for i in range(PARALLELISM)])


@pytest.mark.flaky
@pytest.mark.skip(
reason="Unreliable test in practice. No apparent reliable way to trigger a retry, which causes the test to fail. Disabled until we get a resolution here https://github.com/dbt-labs/dbt-athena/pull/657/files#r1922043351"
Copy link
Contributor Author

@VanTudor VanTudor Jan 21, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Drawing attention to this

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This test seems to fail randomly, irrespective of my changes. E.g. https://github.com/dbt-labs/dbt-athena/actions/runs/12756721311/job/35555467442#step:6:595

uses: ./.github/workflows/_integration-tests.yml
strategy:
fail-fast: false
max-parallel: 1
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I did these workflow changes so that TestIcebergRetriesDisabled is isolated in a separate job and so that it's forced to run in series. This is to rule out that parallel test runs write to the same place, causing the test to fail.

However, I ended up disabling that test (see comment below). I think it's debatable whether to still keep the workflow changes here (as scaffolding). I'm leaning towards yes, but happy to remove this stuff, in case you disagree.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla:yes The PR author has signed the CLA
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant