Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

garbage collection on the h5 folders #6

Open
mikejiang opened this issue Aug 21, 2018 · 0 comments
Open

garbage collection on the h5 folders #6

mikejiang opened this issue Aug 21, 2018 · 0 comments

Comments

@mikejiang
Copy link
Member

The flowJo parser generates temporary h5 folders and h5 files for each run. Right now we set the default h5_dir as /tmp or Rtmp and let os or R session to do the clean up job.

If we ever want to proactively do the garbage collection to avoid flooding the fs by the large number of temporary h5s (given os may not clean /tmp folder as frequent).
We will have to maintain a global counter (at cytolib level) for each GatingSet in order to decide whether to delete the associated h5 folder. It may not always be easy, because GatingSet can be loaded from user-archived folder, which we don't necessarily want to delete them after it is done.
What makes it more complicated is, CytoFrame can potentially live outside of the scope of GatingSet and we then also need to have a counter per frame.

For now, I will leave it as it is. We can revisit this issue as needed later.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant