Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NU-1848: Improve missing Flink Kafka Source / Sink TypeInformation #7116

Merged
merged 10 commits into from
Nov 18, 2024

schemedkafka inested of schemedkafka

7a6a235
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

NU-1848: Improve missing Flink Kafka Source / Sink TypeInformation #7116

schemedkafka inested of schemedkafka
7a6a235
Select commit
Loading
Failed to load commit list.
GitHub Actions / REPORT-IntegrationTests-2.13 succeeded Nov 17, 2024 in 1s

42 passed, 0 failed and 1 skipped

Tests passed successfully

Report Passed Failed Skipped Time
components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.xml 4✅ 22s
components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec.xml 1✅ 5s
designer/processReports/target/it-reports/TEST-pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec.xml 3✅ 3s
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec.xml 1✅ 399ms
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec.xml 9✅ 1⚪ 137s
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec.xml 2✅ 3s
engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec.xml 1✅ 18s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest.xml 1✅ 11s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest.xml 1✅ 31s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest.xml 1✅ 31s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest.xml 2✅ 61s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest.xml 1✅ 13s
engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest.xml 2✅ 258ms
security/target/it-reports/TEST-pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec.xml 1✅ 6s
utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest.xml 6✅ 2s
utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest.xml 6✅ 3s

✅ components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest.xml

4 tests were completed in 22s with 4 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest 4✅ 22s

✅ pl.touk.nussknacker.openapi.functional.OpenApiScenarioIntegrationTest

✅ should should enrich scenario with data
✅ should call enricher with primitive request body
✅ should call enricher with request body
✅ should call enricher returning string

✅ components/openapi/target/it-reports/TEST-pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec.xml

1 tests were completed in 5s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec 1✅ 5s

✅ pl.touk.nussknacker.openapi.functional.OpenAPIServiceSpec

✅ service returns customers

✅ designer/processReports/target/it-reports/TEST-pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec.xml

3 tests were completed in 3s with 3 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec 3✅ 3s

✅ pl.touk.nussknacker.processCounts.influxdb.InfluxCountsReporterSpec

✅ invokes counts for point in time data
✅ invokes query for date range
✅ should detect restarts one SingleDifference mode

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec.xml

1 tests were completed in 399ms with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec 1✅ 399ms

✅ pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSlotsCountSpec

✅ deploy scenario with too low task manager slots counts

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec.xml

10 tests were completed in 137s with 9 passed, 0 failed and 1 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec 9✅ 1⚪ 137s

✅ pl.touk.nussknacker.engine.management.streaming.FlinkStreamingDeploymentManagerSpec

✅ deploy scenario in running flink
⚪ continue on timeout exception during scenario deploy
✅ cancel of not existing job should not fail
✅ be able verify&redeploy kafka scenario
✅ save state when redeploying
✅ snapshot state and be able to deploy using it
✅ should stop scenario and deploy it using savepoint
✅ fail to redeploy if old is incompatible
✅ fail to redeploy if result produced by aggregation is incompatible
✅ extract scenario definition

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec.xml

2 tests were completed in 3s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec 2✅ 3s

✅ pl.touk.nussknacker.engine.management.streaming.FlinkStreamingProcessTestRunnerSpec

✅ should run scenario in test mode
✅ should return correct error messages

✅ engine/flink/management/target/it-reports/TEST-pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec.xml

1 tests were completed in 18s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec 1✅ 18s

✅ pl.touk.nussknacker.engine.management.streaming.JavaConfigDeploymentManagerSpec

✅ deploy java scenario in running flink

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest.xml

1 tests were completed in 11s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest 1✅ 11s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeBinTest

✅ should run scenario and pass data to output

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest.xml

1 tests were completed in 31s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest 1✅ 31s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerAvroTest

✅ avro ping-pong should work

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest.xml

1 tests were completed in 31s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest 1✅ 31s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerJsonTest

✅ json ping-pong should work

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest.xml

2 tests were completed in 61s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest 2✅ 61s

✅ pl.touk.nussknacker.engine.lite.kafka.NuKafkaRuntimeDockerProbesTest

✅ readiness probe
✅ liveness probe

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest.xml

1 tests were completed in 13s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest 1✅ 13s

✅ pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeBinTest

✅ binary version should handle ping pong via http

✅ engine/lite/integration-test/target/it-reports/TEST-pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest.xml

2 tests were completed in 258ms with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest 2✅ 258ms

✅ pl.touk.nussknacker.engine.lite.requestresponse.NuReqRespRuntimeDockerTest

✅ docker image should handle ping pong via http
✅ should get scenario definition via http

✅ security/target/it-reports/TEST-pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec.xml

1 tests were completed in 6s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec 1✅ 6s

✅ pl.touk.nussknacker.ui.security.oauth2.GenericOidcServiceSpec

✅ Basic OpenIDConnect flow

✅ utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest.xml

6 tests were completed in 2s with 6 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest 6✅ 2s

✅ pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateDisabledTest

✅ should validate existing source topic
✅ should validate not existing source topic
✅ should validate existing sink topic
✅ should validate not existing sink topic
✅ should not validate not existing topic when validation disabled
✅ should fetch topics every time when not valid using cache

✅ utils/kafka-components-utils/target/it-reports/TEST-pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest.xml

6 tests were completed in 3s with 6 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest 6✅ 3s

✅ pl.touk.nussknacker.engine.kafka.validator.CachedTopicsExistenceValidatorWhenAutoCreateEnabledTest

✅ should validate existing source topic
✅ should not validate not existing source topic
✅ should validate existing sink topic
✅ should validate not existing sink topic
✅ should not validate not existing topic when validation disabled
✅ should use cache when validating