Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spreadsheet view refactor to use @mui/x-data-grid component and volatile storage #4047

Closed
wants to merge 1 commit into from

Conversation

cmdcolin
Copy link
Collaborator

@cmdcolin cmdcolin commented Nov 6, 2023

Currently, the spreadsheet view stores all data in the mobx-state-tree. This has a small convenience, but it lags very strongly for any reasonably sized data file loaded into it. A 33Mb VCF takes slows down a lot, taking up a lot of memory (which is a known issue mobxjs/mobx-state-tree#1683). This PR changes to loading directly from a volatile. With this PR, it loads the 33Mb VCF almost very fast, and takes up much less memory

There will require work to make this attain feature parity with existing spreadsheet view, but I believe it will be a valuable change

@github-actions github-actions bot added the needs label triage Needs a label to show in changelog (breaking, enhancement, bug, documentation, or internal) label Nov 6, 2023
@cmdcolin cmdcolin added enhancement New feature or request and removed needs label triage Needs a label to show in changelog (breaking, enhancement, bug, documentation, or internal) labels Nov 6, 2023
@cmdcolin cmdcolin marked this pull request as draft November 6, 2023 14:51
@cmdcolin
Copy link
Collaborator Author

cmdcolin commented Nov 6, 2023

possible alternative: leave the existing spreadsheet view as-is to avoid any breaking behavior, and make this a new view type, however, then we have two things for ongoing maintenance

@cmdcolin
Copy link
Collaborator Author

cmdcolin commented Nov 6, 2023

small bonus endeavor: adding #788 splitting out VCF INFO column into multiple filterable/sortable columns

screenshot shows this
image

@cmdcolin cmdcolin force-pushed the spreadsheetview_volatile branch 2 times, most recently from 83c55ee to f7dd8e3 Compare December 3, 2023 15:22
@cmdcolin cmdcolin force-pushed the spreadsheetview_volatile branch 2 times, most recently from 8e1da47 to 7f7c6f8 Compare December 13, 2023 19:19
@cmdcolin cmdcolin force-pushed the spreadsheetview_volatile branch 2 times, most recently from dd4d2f9 to dbe6b86 Compare February 21, 2024 19:50
@cmdcolin cmdcolin force-pushed the spreadsheetview_volatile branch 2 times, most recently from 66f78f6 to cae4f0e Compare March 14, 2024 17:48
@cmdcolin cmdcolin force-pushed the spreadsheetview_volatile branch 2 times, most recently from d56f7f1 to 5a0b3f7 Compare September 19, 2024 18:14
Remove

[skip ci] Volatile

[skip ci] Parse out INFO field

[skip ci] Misc

Misc

Restyling

Refactoring

More misc

Misc

Misc

Misc

Misc

New

Refname renaming fix for breakpoint split view

Breakpoint split view

Misc

[skip ci] Refactors

Use 7.0.0

Updates

Misc

Misc

Misc

SV inspector working

Wow

Misc

More notifyError
@cmdcolin
Copy link
Collaborator Author

replaced by #4682

@cmdcolin cmdcolin deleted the spreadsheetview_volatile branch November 26, 2024 22:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant