Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Validation Datasets and Splits #65

Open
timat33 opened this issue Jun 5, 2024 · 1 comment
Open

Validation Datasets and Splits #65

timat33 opened this issue Jun 5, 2024 · 1 comment

Comments

@timat33
Copy link

timat33 commented Jun 5, 2024

Hi there, thanks a lot for all your work!

I would like to perform some benchmarking on the model and would like to reproduce some of the results in the quantitative evaluation section (4.2) of the paper. I'd be very interested to know the composition of the training set (I see that the 9 held-out test sets are explicitly listed), in particular, since I can't find them listed on the SA-Med2D-20M paper, the training/validation splits. Could you help me with this?

Many thanks,
Tim

@Cjl-MedSeg
Copy link
Collaborator

All nine datasets used for zero-shot testing were released after 2023, and we are not authorized to share them. To evaluate these datasets, we first convert them into the same data format as used during training (including preprocessing steps) and then conduct the corresponding tests.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants