Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add vol mount #3

Closed
wants to merge 2 commits into from
Closed

add vol mount #3

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
d53036c
add vol mount
Tianhao-Gu May 20, 2024
41cc14d
fix conflicts
Tianhao-Gu May 20, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
.DS_Store
.idea
.coverage
cdm_shared_workspace/
*_pycache__
4 changes: 3 additions & 1 deletion docker-compose.yaml
View file
Open in desktop
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

At some point we'll probably have to think about how different users would interact with this but that's much later

Original file line number Diff line number Diff line change
Expand Up @@ -63,4 +63,6 @@ services:
environment:
- NOTEBOOK_PORT=4041
- SPARK_MASTER_URL=spark://spark-master:7077
- SPARK_DRIVER_HOST=spark-notebook
- SPARK_DRIVER_HOST=spark-notebook
volumes:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Where are you mounting from in rancher?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

in Rancher I just do /cdm_shared_workspace:/cdm_shared_workspace.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Where does the data live though? In the VM the notebook is running on?

Copy link
Collaborator Author

@Tianhao-Gu Tianhao-Gu May 20, 2024 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think so. I am double confirming it with devops team in slack.

- ./cdm_shared_workspace:/cdm_shared_workspace
Loading