Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generating single sample CSV from DEERNet example #48

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

MichaelLantz
Copy link

Fixes mindsdb/lightwood#673

Please describe what changes you made, in as much detail as possible

benchmarks

Generating single sample CSV from DEERNet example. To help for use in Benchamarks.
@MichaelLantz
Copy link
Author

MichaelLantz commented Oct 30, 2021

Hi @George3d6,

I think the heavy lifting in getting all the different arrays split into corresponding groups has been done. I want to get the data in your hands since I have less experience with benchmarks. I think the output from the Resampling CSV is what you're looking for.

If you want to get a sense of what's was involved to get from the XML in the physics library to the CSV, the zipped xlsx file has embedded Power Query transformations to split data from the output structure (referenced in doc) the physics library provided into 3 separate chunks with different amounts of rows (Input Axis and Trace, Rsampling, and Distance). Due to the resampling done from the DEERNet library inserting additional rows based on the data training parameters I wasn't able to get all of the output from Matlab in a single CSV. That being said the xlsx can output the remaining 2 chunks (original input and distance) if necessary.

Generating single sample CSV from DEERNet example. To help for use in Benchamarks.
@George3d6
Copy link
Contributor

I will be merging this soon~ish when I get time, thanks a lot :)

@MichaelLantz
Copy link
Author

My pleasure thanks for the challenge. Definitely more tricky than I originally anticipated...In a good way. 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: to review
Development

Successfully merging this pull request may close these issues.

CSV with the dataset from the deernet paper
2 participants