xfail all the impacted cases when using non-UTC time zone [databricks] #9773

res-life · 2023-11-17T13:44:49Z

xfail all the impacted cases when using non-UTC time zone.

@pytest.mark.xfail(condition = is_not_utc(), reason = 'xfail non-UTC time zone tests because of https://github.com/NVIDIA/spark-rapids/issues/9653')

Signed-off-by: Chong Gao [email protected]

Note:
About DB cases, will post another PR.

Signed-off-by: Chong Gao <[email protected]>

… is not ready

res-life · 2023-11-17T13:55:22Z

build

revans2

Looks good

winningsix

The xfailed case number seems less than previous mentioned number. Any difference from what we tested before?

winningsix · 2023-11-17T14:31:05Z

integration_tests/run_pyspark_from_build.sh

@@ -224,7 +224,7 @@ else
    fi

    # time zone will be tested; use export TZ=time_zone_name before run this script
-    TZ=${TZ:-UTC}
+    export TZ=Iran


revert this before when commit.

winningsix · 2023-11-17T14:37:59Z

integration_tests/src/main/python/parquet_write_test.py

@@ -283,6 +291,7 @@ def writeParquetUpgradeCatchException(spark, df, data_path, spark_tmp_table_fact
                         ('TIMESTAMP_MICROS', TimestampGen(start=datetime(1, 1, 1, tzinfo=timezone.utc), end=datetime(1899, 12, 31, tzinfo=timezone.utc))),
                         ('TIMESTAMP_MILLIS', TimestampGen(start=datetime(1, 1, 1, tzinfo=timezone.utc), end=datetime(1899, 12, 31, tzinfo=timezone.utc)))])
 @pytest.mark.parametrize('rebase', ["CORRECTED","EXCEPTION"])


It seems we don't need another PR to cover databricks? Related test cases already cover different behaviors for spark.sql.parquet.datetimeRebaseModeInRead.

We probably still need to cover databricks eventually. This is for one write test. There are all of the read tests and there are also other write tests too. The issue shows up for any test where we are relying on the default rebase settings. I have not dug into them to see which they are. I would be happy to see us not rely on the default settings any more. But then we need to be sure that we don't lose any test coverage.

I'll first xfail the impacted cases for DB in this PR.
Filed a follow-up issue: #9792, for this issue, I'll fix the cases and then add cases to ensure the coverage.

NVnavkumar

Looks good so far. Awaiting any updates based on databricks testing.

NVnavkumar · 2023-11-17T20:28:16Z

build

res-life · 2023-11-20T01:25:04Z

The xfailed case number seems less than previous mentioned number. Any difference from what we tested before?

Totally 347 cases in 43 files. 347 cases are parametrized case.
Previously in #9482, there are only about 10 files involved.
After removing the skip_if_not_utc in gen_df, more files(about 30 files) appeared.

def gen_df(spark, data_gen, length=2048, seed=0, num_slices=None):
        ......
        if src.contains_ts():      # Remove
             skip_if_not_utc()     # Remove

res-life · 2023-11-20T03:24:09Z

build

winningsix · 2023-11-20T09:27:12Z

if new xfail is due to dbx, we should add is_databricks_runtime for ensure non-dbx can still have them on.

res-life · 2023-11-20T10:13:28Z

build

res-life · 2023-11-20T10:39:52Z

build

res-life · 2023-11-20T10:45:43Z

build

winningsix · 2023-11-21T01:04:40Z

FYI. Those cases failed in my local test using Spark 3.4.1. I will verify more in my local.

Most related to ```test_json_ts_formats_round_trip_ntz_v1``` and ```test_json_ts_formats_round_trip_ntz_v2```

FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-dd-][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-dd-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-dd-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-dd-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-dd-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-dd-'T'HH:mm:ss][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-dd-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-dd-'T'HH:mm][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM/dd-][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM/dd-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM/dd-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM/dd-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM/dd-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM/dd-'T'HH:mm:ss][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM/dd-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM/dd-'T'HH:mm][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-'T'HH:mm:ss][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy-MM-'T'HH:mm][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM-][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM-'T'HH:mm:ss][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-yyyy/MM-'T'HH:mm][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-yyyy-][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-yyyy-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-yyyy-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-yyyy-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-yyyy-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-yyyy-'T'HH:mm:ss][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-yyyy-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-yyyy-'T'HH:mm][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/yyyy-][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/yyyy-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/yyyy-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/yyyy-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/yyyy-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/yyyy-'T'HH:mm:ss][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/yyyy-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/yyyy-'T'HH:mm][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-dd-yyyy-][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-dd-yyyy-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-dd-yyyy-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-dd-yyyy-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-dd-yyyy-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-dd-yyyy-'T'HH:mm:ss][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-dd-yyyy-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM-dd-yyyy-'T'HH:mm][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/dd/yyyy-][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/dd/yyyy-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/dd/yyyy-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/dd/yyyy-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/dd/yyyy-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/dd/yyyy-'T'HH:mm:ss][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/dd/yyyy-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-MM/dd/yyyy-'T'HH:mm][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd-MM-yyyy-][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd-MM-yyyy-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd-MM-yyyy-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd-MM-yyyy-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd-MM-yyyy-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd-MM-yyyy-'T'HH:mm:ss][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd-MM-yyyy-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd-MM-yyyy-'T'HH:mm][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd/MM/yyyy-][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd/MM/yyyy-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd/MM/yyyy-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd/MM/yyyy-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd/MM/yyyy-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd/MM/yyyy-'T'HH:mm:ss][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd/MM/yyyy-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v1[TIMESTAMP_LTZ-dd/MM/yyyy-'T'HH:mm][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(FileSourceScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-dd-][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-dd-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-dd-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-dd-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-dd-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-dd-'T'HH:mm:ss][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-dd-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-dd-'T'HH:mm][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM/dd-][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM/dd-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM/dd-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM/dd-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM/dd-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM/dd-'T'HH:mm:ss][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM/dd-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM/dd-'T'HH:mm][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-'T'HH:mm:ss][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy-MM-'T'HH:mm][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM-][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM-'T'HH:mm:ss][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-yyyy/MM-'T'HH:mm][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-yyyy-][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-yyyy-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-yyyy-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-yyyy-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-yyyy-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-yyyy-'T'HH:mm:ss][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-yyyy-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-yyyy-'T'HH:mm][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/yyyy-][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/yyyy-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/yyyy-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/yyyy-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/yyyy-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/yyyy-'T'HH:mm:ss][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/yyyy-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/yyyy-'T'HH:mm][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-dd-yyyy-][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-dd-yyyy-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-dd-yyyy-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-dd-yyyy-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-dd-yyyy-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-dd-yyyy-'T'HH:mm:ss][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-dd-yyyy-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM-dd-yyyy-'T'HH:mm][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/dd/yyyy-][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/dd/yyyy-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/dd/yyyy-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/dd/yyyy-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/dd/yyyy-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/dd/yyyy-'T'HH:mm:ss][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/dd/yyyy-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-MM/dd/yyyy-'T'HH:mm][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd-MM-yyyy-][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd-MM-yyyy-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd-MM-yyyy-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd-MM-yyyy-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd-MM-yyyy-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd-MM-yyyy-'T'HH:mm:ss][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd-MM-yyyy-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd-MM-yyyy-'T'HH:mm][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd/MM/yyyy-][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd/MM/yyyy-'T'HH:mm:ss.SSSXXX][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd/MM/yyyy-'T'HH:mm:ss[.SSS][XXX]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd/MM/yyyy-'T'HH:mm:ss.SSS][DATAGEN_SEED=1700475048, INJECT_OOM, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd/MM/yyyy-'T'HH:mm:ss[.SSS]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd/MM/yyyy-'T'HH:mm:ss][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd/MM/yyyy-'T'HH:mm[:ss]][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s... FAILED ../../src/main/python/json_test.py::test_json_ts_formats_round_trip_ntz_v2[TIMESTAMP_LTZ-dd/MM/yyyy-'T'HH:mm][DATAGEN_SEED=1700475048, ALLOW_NON_GPU(BatchScanExec,ProjectExec)] - py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.s...

winningsix · 2023-11-21T01:08:52Z

Per discussed offline, Spark 311, 330 and 341 are mandatory to verify.

winningsix · 2023-11-21T01:27:59Z

integration_tests/src/main/python/cast_test.py

@@ -151,6 +151,7 @@ def test_cast_string_date_non_ansi():
                                      StringGen('[0-9]{1,4}-[0-3][0-9]-[0-5][0-9][ |T][0-3][0-9]:[0-6][0-9]:[0-6][0-9]'),


Not sure why test_cast_string_date_valid_format(In L65 above) and test_cast_string_date_non_ansi(In L144 above) are not touched. No requirement for Spark.

winningsix · 2023-11-21T01:42:09Z

integration_tests/src/main/python/cast_test.py

@@ -151,6 +151,7 @@ def test_cast_string_date_non_ansi():
                                      StringGen('[0-9]{1,4}-[0-3][0-9]-[0-5][0-9][ |T][0-3][0-9]:[0-6][0-9]:[0-6][0-9]'),
                                      StringGen('[0-9]{1,4}-[0-3][0-9]-[0-5][0-9][ |T][0-3][0-9]:[0-6][0-9]:[0-6][0-9].[0-9]{0,6}Z?')],
                        ids=idfn)


FYI. test_cast_string_date_valid_ansi and test_cast_string_date_valid_format need for xfail as well. It's skipped before Spark 320.

This should be an existing bug.

Yes, per offline discussed. Previous type check missed some cases about date data type which is also timezone aware.

winningsix · 2023-11-21T01:47:27Z

integration_tests/src/main/python/conditionals_test.py

@@ -232,6 +241,7 @@ def test_conditional_with_side_effects_case_when(data_gen):
                conf = test_conf)

 @pytest.mark.parametrize('data_gen', [mk_str_gen('[a-z]{0,3}')], ids=idfn)
+@pytest.mark.xfail(condition = is_not_utc(), reason = 'xfail non-UTC time zone tests because of https://github.com/NVIDIA/spark-rapids/issues/9653')
 def test_conditional_with_side_effects_sequence(data_gen):
    assert_gpu_and_cpu_are_equal_collect(
        lambda spark : unary_op_df(spark, data_gen).selectExpr(


test_conditional_with_side_effects_sequence_cast needed (L255). It's skipped before Spark 320.

winningsix · 2023-11-21T02:39:11Z

@res-life I went through failed cases in my local. I think most of them should be captured by xfail. See full list here #9719 (comment)

Most of them are due to uncovered Spark version. But I do some cases not related to Spark version. I left comments within PR reviews.

res-life · 2023-11-21T10:30:10Z

build

res-life · 2023-11-24T00:50:18Z

build

res-life · 2023-11-24T01:33:30Z

build

res-life · 2023-11-24T01:34:12Z

build

winningsix · 2023-11-24T05:04:02Z

jenkins/spark-premerge-build.sh

+
+    # Temporarily test non-UTC TZ
+    # Only test the impacted 43 files
+    # Split multiple parts to test to avoid OOM: refer to: https://github.com/NVIDIA/spark-rapids/issues/9829


How long does this cost after adding new test suites?

cc @pxLi

hmm seems adding too much duration. The ci_2 now cost ~3h5m even without default run_pyspark_from_build. for testing purposes please also comment out cases after TZ ones to save time, then you will just need to check the independent ci_2 stage time.

Here is testing the 43 files impacted by non-UTC time zone.
I'll select a sub-set of them and revert the default run_pyspark_from_build.

Per discussed offline, let's only include 1 test for each type of result. Minimal list:

parquet scan

orc scan

csv scan

cast

one for TimeZoneAwareExpression

one for UTCTimestamp

super huge log which cannot be loaded in browser, I downloaded and checked TZ part

at least we got some numbers for these TZ cases

start: [2023-11-24T01:47:31.478Z] end: [2023-11-24T03:30:27.328Z]

~1h45m

res-life · 2023-11-24T06:05:08Z

Before the last commit (Test a portion of cases for non-UTC time zone in pre-merge), pre-merge passed which is testing the impacted 43 files for non-UTC timezone.

The last commit revert to the original test and selected a portion of cases for non-UTC.

res-life · 2023-11-24T06:05:49Z

build

winningsix

LGTM. Waiting for pre-merge result.

pxLi

LGTM for pre-merge CI

winningsix · 2023-11-26T23:32:40Z

Could you help list short test summary info before/after your change in #6839 ?
e.g.,

= 0 failed, 8053 passed, 1026 skipped, 1742 xfailed, 11337 xpassed, 95 warnings in 14848.34s (4:07:28) =

winningsix · 2023-11-26T23:38:46Z

build

winningsix

Sorry for approving prematurely it. Let's on hold for merge before Databricks shim test.

winningsix · 2023-11-27T00:42:51Z

jenkins/spark-premerge-build.sh

+    # Test a portion of cases for non-UTC time zone because of limited GPU resources.
+    # Here testing: parquet scan, orc scan, csv scan, cast, TimeZoneAwareExpression, FromUTCTimestamp
+    # Nightly CIs will cover all the cases.
+    TZ=Iran TEST='test_parquet_read_round_trip or test_read_round_trip or test_basic_csv_read or test_cast_string_ts_valid_format or test_unix_timestamp or test_from_utc_timestamp' ./integration_tests/run_pyspark_from_build.sh


I just renamed the title with "databricks" postfix and re-trigger a pre-merge. Let's ensure we don't break databrick shim before merging this PR.

it would not, databricks does not run this script. instead its relying
on a dedicated test script https://github.com/NVIDIA/spark-rapids/blob/branch-23.12/jenkins/databricks/test.sh

but feel free to re-run with databricks trigger as this change does touch the test code

Yes, let's double confirm DBX runtime was passed. Hopefully I am over worried on this.

pxLi · 2023-11-27T01:14:31Z

@res-life filed an issue to track the nightly update #9855

Please notify me when the script is ready thanks

res-life · 2023-11-27T03:33:33Z

build

res-life · 2023-11-27T03:43:26Z

build

winningsix · 2023-11-27T04:52:37Z

@res-life any new findings regards to errors of "connection refused" in pre-merge?

winningsix

LGTM

Chong Gao added 2 commits November 17, 2023 21:41

re-organize imports

e9e2e30

Signed-off-by: Chong Gao <[email protected]>

xfail all the cases when it's non-UTC time zone

64b8471

res-life requested review from revans2, winningsix and NVnavkumar November 17, 2023 13:46

Temporarily testing non-UTC test cases becasue of non-UTC TZ pipeline…

9530b23

… is not ready

revans2 reviewed Nov 17, 2023

View reviewed changes

winningsix reviewed Nov 17, 2023

View reviewed changes

winningsix mentioned this pull request Nov 17, 2023

Support fine grained timezone checker instead of type based [databricks] #9719

Merged

3 tasks

NVnavkumar reviewed Nov 17, 2023

View reviewed changes

Xfail more cases that involve timestamp type

3f8bc40

Xfail Databricks cases because its default rebase mode is legacy

c2b5ffb

Xfail Databricks cases because its default rebase mode is legacy

57a1476

Xfail Databricks cases because its default rebase mode is legacy

34cbc5d

NVnavkumar linked an issue Nov 21, 2023 that may be closed by this pull request

[FEA] Enable running integration tests with a non-UTC timezone, and handle tests that fail when the timezone is not UTC #9737

Closed

winningsix reviewed Nov 21, 2023

View reviewed changes

Chong Gao added 2 commits November 21, 2023 12:03

Xfail failed cases for Spark 341

4a4d249

Merge branch 'branch-23.12' into xfail-for-non-utc-2

ca96d39

Fix import error

1311ffe

winningsix reviewed Nov 24, 2023

View reviewed changes

Test a portion of cases for non-UTC time zone in pre-merge

6a02eb7

winningsix approved these changes Nov 24, 2023

View reviewed changes

res-life marked this pull request as ready for review November 24, 2023 08:59

res-life requested review from jlowe, tgravescs, GaryShen2008 and NvTimLiu as code owners November 24, 2023 08:59

pxLi approved these changes Nov 24, 2023

View reviewed changes

res-life mentioned this pull request Nov 26, 2023

[DO NOT REVIEW] try to increase Java -Xmx memory for non-UTC time zone. #9853

Closed

winningsix changed the title ~~xfail all the impacted cases when using non-UTC time zone.~~ xfail all the impacted cases when using non-UTC time zone [databricks] Nov 26, 2023

winningsix requested changes Nov 27, 2023

View reviewed changes

pxLi added the test Only impacts tests label Nov 27, 2023

pxLi mentioned this pull request Nov 27, 2023

[FEA] Add non-UTC cases in nightly test script #9855

Closed

winningsix approved these changes Nov 27, 2023

View reviewed changes

winningsix merged commit 6aef5c2 into NVIDIA:branch-23.12 Nov 27, 2023
74 checks passed

This was referenced Nov 28, 2023

[FEA] Support time zones that are not UTC #6839

Open

[BUG] Report GPU OOM on recent passed CI premerges. #9914

Closed

		@@ -151,6 +151,7 @@ def test_cast_string_date_non_ansi():
		StringGen('[0-9]{1,4}-[0-3][0-9]-[0-5][0-9][ \|T][0-3][0-9]:[0-6][0-9]:[0-6][0-9]'),

xfail all the impacted cases when using non-UTC time zone [databricks] #9773

xfail all the impacted cases when using non-UTC time zone [databricks] #9773

Conversation

res-life commented Nov 17, 2023 • edited Loading

res-life commented Nov 17, 2023

revans2 left a comment

Choose a reason for hiding this comment

winningsix left a comment • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

NVnavkumar left a comment

Choose a reason for hiding this comment

NVnavkumar commented Nov 17, 2023

res-life commented Nov 20, 2023

res-life commented Nov 20, 2023

winningsix commented Nov 20, 2023

res-life commented Nov 20, 2023

res-life commented Nov 20, 2023

res-life commented Nov 20, 2023

winningsix commented Nov 21, 2023

winningsix commented Nov 21, 2023

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

winningsix commented Nov 21, 2023 • edited Loading

res-life commented Nov 21, 2023

res-life commented Nov 24, 2023

res-life commented Nov 24, 2023

res-life commented Nov 24, 2023

Choose a reason for hiding this comment

pxLi Nov 24, 2023 • edited Loading

Choose a reason for hiding this comment

res-life Nov 24, 2023 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

pxLi Nov 24, 2023 • edited Loading

Choose a reason for hiding this comment

res-life commented Nov 24, 2023 • edited Loading

res-life commented Nov 24, 2023

winningsix left a comment

Choose a reason for hiding this comment

pxLi left a comment

Choose a reason for hiding this comment

winningsix commented Nov 26, 2023

winningsix commented Nov 26, 2023

winningsix left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

pxLi Nov 27, 2023 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

pxLi commented Nov 27, 2023

res-life commented Nov 27, 2023

res-life commented Nov 27, 2023

winningsix commented Nov 27, 2023

winningsix left a comment

Choose a reason for hiding this comment

res-life commented Nov 17, 2023 •

edited

Loading

winningsix left a comment •

edited

Loading

winningsix commented Nov 21, 2023 •

edited

Loading

pxLi Nov 24, 2023 •

edited

Loading

res-life Nov 24, 2023 •

edited

Loading

pxLi Nov 24, 2023 •

edited

Loading

res-life commented Nov 24, 2023 •

edited

Loading

pxLi Nov 27, 2023 •

edited

Loading