Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improving analysis of varation of experiments in math.variation (expected value + confidence interval) #1

Open
gfursin opened this issue Oct 30, 2015 · 0 comments

Comments

@gfursin
Copy link
Member

gfursin commented Oct 30, 2015

We currently have a simple way of analyzing variation of experimental results in math.variation in ck-analytics repo. We use density via gaussian_kde and can detect multiple expected values, i.e. to warn that there are several states and features to separate them should be found. However, we do not calculate confidence interval, etc (since which such approach we do not need it, but instead we look at the delta and if there is more than 1 expected value).

We should check that it works correctly and possibly improve it (calculate confidence interval, etc)...

Moved from CK: mlcommons/ck#26

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant