Add cache action to speed up mvn workflow [skip ci]

[YanxuanLiu]

part of fix #9559

[YanxuanLiu]

Compared the log line by line, the cache action does not help for most of dependencies in pom.

[gerashegalov]

This is closed prematurely IMO:

First this PR did not explore the recommendation from #9609 (comment), to add a job to the workflow that would populate most of the cache once, and all the jobs in the matrix should depend on it.

Without it , we currently fan out right away into a parallel execution that don't benefit from each other in terms of caching.

Depending which ones you compared, some workflow runs on this PR are days or weeks apart. So nightly SNAPSHOTs, including the ~500M spark-rapids-jni is repulled.

[YanxuanLiu]

This is closed prematurely IMO:

First this PR did not explore the recommendation from #9609 (comment), to add a job to the workflow that would populate most of the cache once, and all the jobs in the matrix should depend on it.

Without it , we currently fan out right away into a parallel execution that don't benefit from each other in terms of caching.

Depending which ones you compared, some workflow runs on this PR are days or weeks apart. So nightly SNAPSHOTs, including the ~500M spark-rapids-jni is repulled.

Got it, let me add a cache job and run some tests

[YanxuanLiu]

build

[pxLi]

@YanxuanLiu please keep in mind that we should add [skip ci] save resources if no need blossom resources

[gerashegalov]

looks pretty good already

[gerashegalov]

We still do not populate the cache with Scala 2.13 artifacts: the second line in #9674 (comment)

If one statement works better for your logic we could use a loop

for pom_xml in pom.xml scala2.13/pom.xml; do 
  mvn -f $pom_xml help:evaluate -pl dist \
    -Dexpression=included_buildvers -DforceStdout -PnoSnapshots -q | tr -d ',' | \
       xargs -n 1 bash -c 'mvn -f $1 initialize -pl sql-plugin-api -am -Dbuildver=$2' _  $pom_xml; 
done

[YanxuanLiu]

I've merged latest branch-24.02 to feature branch, but scala 2.13 still failed. Do you have any idea? @gerashegalov

[gerashegalov]

I've merged latest branch-24.02 to feature branch, but scala 2.13 still failed. Do you have any idea? @gerashegalov

need to fix a typo for buildver=$2 @YanxuanLiu

[YanxuanLiu]

I've merged latest branch-24.02 to feature branch, but scala 2.13 still failed. Do you have any idea? @gerashegalov

need to fix a typo for buildver=$2 @YanxuanLiu

looks good now. Shall we merge the PR?

[gerashegalov]

LGTM

[YanxuanLiu]

build

[pxLi]

LGTM. Please help keep monitoring if the cache storage usage would affect others who may share the same storage like https://github.com/orgs/NVIDIA/projects/4 or https://github.com/NVIDIA/spark-rapids/discussions thanks