Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(ci): remove duplicated workflows in main-cron #12593

Merged
merged 2 commits into from
Sep 29, 2023
Merged

chore(ci): remove duplicated workflows in main-cron #12593

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
70223da
bump timeout
kwannoel Sep 29, 2023
9411fe4
merge duplicate workflows
kwannoel Sep 29, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
96 changes: 3 additions & 93 deletions ci/workflows/main-cron.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -99,7 +99,7 @@ steps:
config: ci/docker-compose.yml
mount-buildkite-agent: true
- ./ci/plugins/upload-failure-logs
timeout_in_minutes: 10
timeout_in_minutes: 12
retry: *auto-retry

- label: "end-to-end source test (release)"
Expand Down Expand Up @@ -245,25 +245,6 @@ steps:
timeout_in_minutes: 5
retry: *auto-retry

- label: "connector node integration test Java {{matrix.java_version}}"
command: "ci/scripts/connector-node-integration-test.sh -p ci-release -v {{matrix.java_version}}"
depends_on:
- "build"
- "build-other"
plugins:
- docker-compose#v4.9.0:
run: rw-build-env
config: ci/docker-compose.yml
mount-buildkite-agent: true
- ./ci/plugins/upload-failure-logs
matrix:
setup:
java_version:
- "11"
- "17"
timeout_in_minutes: 10
retry: *auto-retry

- label: "end-to-end iceberg sink test (release)"
command: "ci/scripts/e2e-iceberg-sink-test.sh -p ci-release"
depends_on:
Expand All @@ -289,7 +270,7 @@ steps:
config: ci/docker-compose.yml
mount-buildkite-agent: true
- ./ci/plugins/upload-failure-logs
timeout_in_minutes: 5
timeout_in_minutes: 10
retry: *auto-retry

- label: "e2e java-binding test (release)"
Expand All @@ -308,23 +289,6 @@ steps:
timeout_in_minutes: 10
retry: *auto-retry

- label: "S3 source check on AWS (json parser)"
command: "ci/scripts/s3-source-test.sh -p ci-release -s run"
depends_on: build
plugins:
- seek-oss/aws-sm#v2.3.1:
env:
S3_SOURCE_TEST_CONF: ci_s3_source_test_aws
- docker-compose#v4.9.0:
run: rw-build-env
config: ci/docker-compose.yml
mount-buildkite-agent: true
environment:
- S3_SOURCE_TEST_CONF
- ./ci/plugins/upload-failure-logs
timeout_in_minutes: 20
retry: *auto-retry

- label: "S3 source check on AWS (json parser)"
command: "ci/scripts/s3-source-test.sh -p ci-release -s json_file"
depends_on: build
Expand Down Expand Up @@ -478,7 +442,7 @@ steps:
config: ci/docker-compose.yml
mount-buildkite-agent: true
- ./ci/plugins/upload-failure-logs
timeout_in_minutes: 21
timeout_in_minutes: 25
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Timeout of standalone test bumped also.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since it is TLE in main-cron

retry: *auto-retry

- label: "end-to-end test for opendal (parallel)"
Expand All @@ -495,46 +459,6 @@ steps:
timeout_in_minutes: 14
retry: *auto-retry

- label: "end-to-end test (parallel, in-memory)"
command: "ci/scripts/e2e-test-parallel-in-memory.sh -p ci-release"
depends_on: "build"
plugins:
- docker-compose#v4.9.0:
run: rw-build-env
config: ci/docker-compose.yml
mount-buildkite-agent: true
- ./ci/plugins/upload-failure-logs
timeout_in_minutes: 12
retry: *auto-retry

- label: "end-to-end iceberg sink test"
command: "ci/scripts/e2e-iceberg-sink-test.sh -p ci-release"
depends_on:
- "build"
- "build-other"
plugins:
- docker-compose#v4.9.0:
run: rw-build-env
config: ci/docker-compose.yml
mount-buildkite-agent: true
- ./ci/plugins/upload-failure-logs
timeout_in_minutes: 5
retry: *auto-retry

- label: "end-to-end iceberg sink v2 test"
command: "ci/scripts/e2e-iceberg-sink-v2-test.sh -p ci-release"
depends_on:
- "build"
- "build-other"
plugins:
- docker-compose#v4.9.0:
run: sink-test-env
config: ci/docker-compose.yml
mount-buildkite-agent: true
- ./ci/plugins/upload-failure-logs
timeout_in_minutes: 10
retry: *auto-retry

- label: "end-to-end clickhouse sink test"
command: "ci/scripts/e2e-clickhouse-sink-test.sh -p ci-release"
depends_on:
Expand Down Expand Up @@ -563,20 +487,6 @@ steps:
timeout_in_minutes: 10
retry: *auto-retry

- label: "e2e java-binding test"
command: "ci/scripts/java-binding-test.sh -p ci-release"
depends_on:
- "build"
- "build-other"
plugins:
- docker-compose#v4.9.0:
run: rw-build-env
config: ci/docker-compose.yml
mount-buildkite-agent: true
- ./ci/plugins/upload-failure-logs
timeout_in_minutes: 10
retry: *auto-retry

- label: "connector node integration test Java {{matrix.java_version}}"
command: "ci/scripts/connector-node-integration-test.sh -p ci-release -v {{matrix.java_version}}"
depends_on:
Expand Down
Loading