Cross Validated Asked by Brad Davis on January 1, 2022
I want to compare success rates across a large number of different levels within a third factor to detect if there are statistically significant differences for at least one of the groups. I’m not specifically interested in the post-hoc question of which groups are different from each other, if any.
For example, I have 3 groups, and total failures and total attempts for each of those groups, lke
group A 15 200
group B 6 100
group C 4 50
group D 45 90
In this particular example, the P value would be (presumably) less than 0.05 because group D 45% compared to between 15 and 20% for the other groups.
The equivalent for continuous variables, like the measured heights of 11 year old children, would be to use a ANOVA.
Does anyone know of a method for doing this?
One possibility would be to create all pairwise combinations, but the number of levels within that variable are too large for it to be practical or useful, let alone having enough data to account for the multiple comparisons for each level.
Another possibility I’ve thought of: take one group, say group A, and compare it against the sum of all other groups and do a standard goodness of fit test, then you only have to do N-1 comparisons for N_group groups AND it tells you if a specific group is an outlier relative to the rest. e.g. group 1 = 15, 200, group 2 = 55, 240? The question then would be how to calculate the correct degrees of freedom for comparison. The normal df = k-c, where k= filled cells and c= estimated parameters, so in this case c = N_group?
Thanks,
Brad
1 Asked on December 6, 2021
2 Asked on December 6, 2021 by omm-kreate
0 Asked on December 6, 2021 by lakshman-mahto
1 Asked on December 6, 2021
gradient descent neural networks q learning reinforcement learning
1 Asked on December 6, 2021 by rambalachandran
binomial distribution combinatorics mathematical statistics probability
0 Asked on December 6, 2021
0 Asked on December 6, 2021 by user6883405
fishers exact test hypothesis testing multiple comparisons small sample
1 Asked on December 6, 2021
1 Asked on December 5, 2021 by laos
1 Asked on December 5, 2021 by user41710
1 Asked on December 5, 2021 by aae
approximation distributions lognormal distribution moment generating function normal distribution
1 Asked on December 5, 2021
1 Asked on December 5, 2021
attention machine translation natural language neural networks
1 Asked on December 5, 2021
1 Asked on December 5, 2021
cross correlation granger causality macroeconomics time series
1 Asked on December 5, 2021 by b-kenobi
generalized linear model logistic multiple regression r reporting
1 Asked on December 5, 2021
assumptions heteroscedasticity linear multiple regression variance
0 Asked on December 5, 2021
1 Asked on December 5, 2021 by emberbillow
2 Asked on December 5, 2021
Get help from others!
Recent Questions
Recent Answers
© 2023 AnswerBun.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP