Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] 2017 bakeoff missing resamples #2265

Open
MatthewMiddlehurst opened this issue Oct 28, 2024 · 2 comments
Open

[BUG] 2017 bakeoff missing resamples #2265

MatthewMiddlehurst opened this issue Oct 28, 2024 · 2 comments
Labels
benchmarking Benchmarking package bug Something isn't working

Comments

@MatthewMiddlehurst
Copy link
Member

Describe the bug

The uploaded 2017 bakeoff results are missing resamples, this impacts the loader we have in benchmarking. An example of this is DTW_F on FordB.

This may not be solvable, but posting in case it is.

Steps/Code to reproduce the bug

N/A

Expected results

Results file have all resamples

Actual results

Some dataset/classifier combos are missing resamples

Versions

No response
@MatthewMiddlehurst MatthewMiddlehurst added bug Something isn't working benchmarking Benchmarking package labels Oct 28, 2024
@TonyBagnall
Copy link
Contributor

not sure this belongs as an aeon issue and definitely is not an aeon bug. If you have a list of missing you could post on https://github.com/time-series-machine-learning/tsml-repo

results may be in the paper itself? Or indeed some may have not completed

@MatthewMiddlehurst
Copy link
Member Author

I don't have a list of missing currently, but we have a function directly loading these results so I would say its related.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
benchmarking Benchmarking package bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@TonyBagnall @MatthewMiddlehurst