Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MKDA Chi Squared tutorial, December blog post, and How to run instructions #10

Merged
merged 19 commits into from
Jan 24, 2024

Conversation

adelavega
Copy link
Member

@adelavega adelavega commented Dec 20, 2023

  • An MKDA Chi Squared large scale association tutorial
  • December blog post mentioning MKDA Chi Squared feature

TODO:

  • Add instructions on how to run NS-Compose workflows
  • Update tutorial to include finger tapping task @jdkent is working on. Compare uniformity and association maps
  • Add interpretation of maps output by default
  • Bump NiMARE version after release

@adelavega
Copy link
Member Author

TODO: Rename NiMARE outputs maps

Copy link
Member

@tsalo tsalo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just some initial thoughts


On Neurosynth.org, we renamed the pre-generated forward and reverse inference maps; they're now referred to as the "uniformity test" and "association test" maps, performed by the MKDA Chi-Squared algorithm.

Although the method we used hasn't change,d the latter names more accurately capture what these maps actually mean. It was a mistake on our part to have used the forward and reverse inference labels; those labels should properly be reserved for probabilistic maps generated via a Bayesian estimation analysis, rather than for z-scores resulting from frequentist inferential tests. These maps are more difficult to interpret and use correctly, which is why we don't currently support this approach.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

NiMARE still creates posterior probability maps, so (carrying on from Slack) we should instead provide guidance on how to interpret them. And maybe include a caveat here that they're distinct from statistical significance?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will disable by default. We may want to add more info on how to interpret them to NiMARE

docs/tutorial/advanced/mkda_association.md Outdated Show resolved Hide resolved
docs/tutorial/advanced/mkda_association.md Outdated Show resolved Hide resolved
blog/2023-12-21-december.md Outdated Show resolved Hide resolved
blog/2023-12-21-december.md Outdated Show resolved Hide resolved
blog/2023-12-21-december.md Outdated Show resolved Hide resolved

Next, select the annotation inclusion column you want to use, as before (by default, the "included" column will be used).

Now, select a reference dataset from the dropdown list below. The Neurosynth dataset represents the latest release of the legacy *Neurosynth* dataset (version 7), released July, 2018. The *Neurostore* dataset represents the latest update of our continuously updating "live" dataset, spanning over 20,000 neuroimaging studies.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's probably worth noting that there are issues with comparing a manually-curated sample against an automated reference dataset, such as sampling biases in either and coordinate extraction. I don't think that merits more than a small admonition box.

Another concern is that you'll want to exclude any relevant studies from the reference dataset, so users should probably make at least some effort to exclude studies investigating the constructs or tasks they are studying with their meta-analysis.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also, as you mentioned on Slack, you could add in a small admonition saying that users could employ this estimator to do a two-sample comparison like the ALE Contrast analysis.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a good point but I'm not what the answer is.

The workflow will exclude studies from the reference sample that you have in your meta-analysis.

I think the main issue is if you don't include all relevant studies are just a subset, right?


We're excited to share our December updates with you! It’s been a great month, having announced the release of Neurosynth Compose on social media. In the last month we’ve seen **over 1,200 new user visits**, with **200 users signing up for an account**! 🚀

Help us keep this growth going by [sharing our announcement](http://localhost:3000/compose-docs/blog/announcing-ns-compose) with your colleagues. 🧑‍🔬
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should this be a relative link (e.g., ./2023-12-21-december.md) instead of a URL?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, good catch

@adelavega adelavega changed the title [WIP] MKDA Chi Squared tutorial, December blog post, and How to run instructions MKDA Chi Squared tutorial, December blog post, and How to run instructions Jan 24, 2024
@adelavega adelavega merged commit 1ac5a76 into master Jan 24, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants