Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automate transform #632

Open
fiendish opened this issue Aug 26, 2021 · 1 comment
Open

Automate transform #632

fiendish opened this issue Aug 26, 2021 · 1 comment
Labels
Epic transform Relating to the transform stage

Comments

@fiendish
Copy link
Contributor

fiendish commented Aug 26, 2021

I hypothesize that this should be totally possible because we know how the different standard concepts are related to each other. One way might be to just throw all the dataframes into the graph structure used by the validator and then extract the result into a new set of dataframes. Alternatively, the right sequence of table joins on the right identifier columns should be able to get all of the attributes in the same tables as their IDs (but watch out for the traps described in https://github.com/kids-first/kf-lib-data-ingest/blob/master/docs/archive/design/merge_algorithm/DataFrame_Design_Complications_Motivating_The_Relationship_Graph.ipynb)

@fiendish fiendish added transform Relating to the transform stage Epic labels Aug 26, 2021
@znatty22
Copy link
Member

This would be amazingggg if it gets implemented!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Epic transform Relating to the transform stage
Projects
None yet
Development

No branches or pull requests

2 participants