Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactoring tests to be more faster, more better, more stronger #141

Merged
merged 18 commits into from
Dec 18, 2023
Merged

Refactoring tests to be more faster, more better, more stronger #141

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
ae06945
Remove the TEST_BROKER constant and allow the `KAFKA_BROKER` env over…
rtyler May 25, 2023
470d637
Switch from relying on a singular endpoint constant for dynamodb and S3
rtyler May 25, 2023
a042ee0
Add some debug traits for checking tests
rtyler May 26, 2023
9422a37
Add some environment variables to allow tests to run more flexibly
rtyler May 26, 2023
243ce79
Structuring the Cargo.toml to put dependencies behind `s3` and `azure…
rtyler May 26, 2023
f9451a9
WIP refactoring TestScope code into the helpers
rtyler May 26, 2023
903d053
Properly run clippy with feature flags
rtyler May 27, 2023
216f763
Copy test fixtures in Rust rather than relying on shell scripts
rtyler Jun 14, 2023
67269cc
Exclude DynamoDB locking mechanisms for `azure` builds
rtyler Jun 14, 2023
d6380c2
Correct the port for the localstack endpoint
rtyler Jun 15, 2023
3bb36c2
Force a region to be set whenever kafka-delta-ingest is launched in t…
rtyler Jun 15, 2023
1883735
Add more Debug traits
rtyler Dec 7, 2023
77e62b7
Use the localstack endpoint when running S3 tests
rtyler Dec 8, 2023
df097c6
Upgrade to deltalake 0.12
rtyler Dec 8, 2023
ec3175e
Upgrade to deltalake 0.16.5
rtyler Dec 9, 2023
0b9072d
build on 0.16.5 properly, test timeout still
rtyler Dec 12, 2023
fc90494
Allow hitting HTTP endpoints in tests
rtyler Dec 17, 2023
91172ac
Adjust the measurement of the writer progress based on the bytes written
rtyler Dec 17, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 9 additions & 5 deletions .github/workflows/build.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,21 +30,25 @@ jobs:
profile: default
toolchain: stable
override: true
- name: build and lint with clippy
run: cargo clippy
- name: Build and lint for S3
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Consider using

matrix:
  feature: ["s3", "azure"]

run: cargo clippy --features s3
- name: Build and lint for Azure
run: cargo clippy --features azure

test:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v2
- name: Install minimum stable with clippy and rustfmt
uses: actions-rs/toolchain@v1
with:
with:
profile: default
toolchain: stable
override: true
- name: Teststack setup
run: docker-compose up setup
- name: Run tests
run: cargo test
- name: Run s3 feature tests
run: cargo test --features s3
- name: Run azure feature tests
run: cargo test --features azure

Loading
Loading