Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DOC] Add documentation about retrieving version information from spark-rapids JAR #10086

Open
NVnavkumar opened this issue Dec 20, 2023 · 2 comments
Labels
documentation Improvements or additions to documentation

Comments

@NVnavkumar
Copy link
Collaborator

Report needed documentation

We have a couple of useful ways to retrieve version information from spark-rapids JAR files:

  1. retrieve by unzipping the JAR
unzip -p ~/gits/NVIDIA/spark-rapids/dist/target/rapids-4-spark_2.12-24.02.0-SNAPSHOT-cuda11.jar '*version-info.properties'
  1. From log messages when plugin is initialized
23/12/12 12:47:54.647  INFO RapidsPluginUtils: RAPIDS Accelerator build: {version=24.02.0-SNAPSHOT, user=navink, [email protected]:NVnavkumar/spark-rapids.git, date=2023-12-12T20:47:31Z, revision=aa61be45ed60f4774e534354e514d2020c4e9479, cudf_version=24.02.0-SNAPSHOT, branch=remove-gpu-improved-time-ops}
23/12/12 12:47:54.647  INFO RapidsPluginUtils: RAPIDS Accelerator JNI build: {version=24.02.0-SNAPSHOT, user=, url=https://github.com/ttnghia/spark-rapids-jni.git, date=2023-12-11T06:36:13Z, revision=1b5281eb0a98bfe10bdb3a080c4702f49ac6e9d3, branch=HEAD}
23/12/12 12:47:54.648  INFO RapidsPluginUtils: cudf build: {version=24.02.0-SNAPSHOT, user=, url=https://github.com/rapidsai/cudf.git, date=2023-12-11T06:36:13Z, revision=fb844a82e4f54da27d1fe3e3d18a7ecd77f393b5, branch=HEAD}
23/12/12 12:47:54.648 WARN RapidsPluginUtils: RAPIDS Accelerator 24.02.0-SNAPSHOT using cudf 24.02.0-SNAPSHOT.

This information should be documented to allow for understanding better how to debug and also to indicate what versions of the JAR file are being used.

@NVnavkumar NVnavkumar added documentation Improvements or additions to documentation ? - Needs Triage Need team to review and classify labels Dec 20, 2023
@tgravescs
Copy link
Collaborator

@gerashegalov
Copy link
Collaborator

The other half is documented here https://github.com/NVIDIA/spark-rapids-jni/blob/98dc423dfbacb68e0d5d8d15069455aaffad618f/CONTRIBUTING.md?plain=1#L166-L191

with so many repos we should have a convention for the shared doc location

@sameerz sameerz removed the ? - Needs Triage Need team to review and classify label Dec 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

4 participants