Cross Validated Asked by Brad Davis on January 1, 2022

I want to compare success rates across a large number of different levels within a third factor to detect if there are statistically significant differences for at least one of the groups. I’m not specifically interested in the post-hoc question of which groups are different from each other, if any.

For example, I have 3 groups, and total failures and total attempts for each of those groups, lke

```
group A 15 200
group B 6 100
group C 4 50
group D 45 90
```

In this particular example, the P value would be (presumably) less than 0.05 because group D 45% compared to between 15 and 20% for the other groups.

The equivalent for continuous variables, like the measured heights of 11 year old children, would be to use a ANOVA.

Does anyone know of a method for doing this?

One possibility would be to create all pairwise combinations, but the number of levels within that variable are too large for it to be practical or useful, let alone having enough data to account for the multiple comparisons for each level.

Another possibility I’ve thought of: take one group, say group A, and compare it against the sum of all other groups and do a standard goodness of fit test, then you only have to do N-1 comparisons for N_group groups AND it tells you if a specific group is an outlier relative to the rest. e.g. group 1 = 15, 200, group 2 = 55, 240? The question then would be how to calculate the correct degrees of freedom for comparison. The normal df = k-c, where k= filled cells and c= estimated parameters, so in this case c = N_group?

Thanks,

Brad

1 Asked on December 6, 2021

2 Asked on December 6, 2021 by omm-kreate

0 Asked on December 6, 2021 by lakshman-mahto

1 Asked on December 6, 2021

gradient descent neural networks q learning reinforcement learning

1 Asked on December 6, 2021 by rambalachandran

binomial distribution combinatorics mathematical statistics probability

0 Asked on December 6, 2021

0 Asked on December 6, 2021 by user6883405

fishers exact test hypothesis testing multiple comparisons small sample

1 Asked on December 6, 2021

1 Asked on December 5, 2021 by laos

1 Asked on December 5, 2021 by user41710

1 Asked on December 5, 2021 by aae

approximation distributions lognormal distribution moment generating function normal distribution

1 Asked on December 5, 2021

1 Asked on December 5, 2021

attention machine translation natural language neural networks

1 Asked on December 5, 2021

1 Asked on December 5, 2021

cross correlation granger causality macroeconomics time series

1 Asked on December 5, 2021 by b-kenobi

generalized linear model logistic multiple regression r reporting

1 Asked on December 5, 2021

assumptions heteroscedasticity linear multiple regression variance

0 Asked on December 5, 2021

1 Asked on December 5, 2021 by emberbillow

2 Asked on December 5, 2021

Get help from others!

Recent Questions

- How Do I Get The Ifruit App Off Of Gta 5 / Grand Theft Auto 5
- Iv’e designed a space elevator using a series of lasers. do you know anybody i could submit the designs too that could manufacture the concept and put it to use
- Need help finding a book. Female OP protagonist, magic
- Why is the WWF pending games (“Your turn”) area replaced w/ a column of “Bonus & Reward”gift boxes?
- Does Google Analytics track 404 page responses as valid page views?

Recent Answers

- Joshua Engel on Why fry rice before boiling?
- Jon Church on Why fry rice before boiling?
- haakon.io on Why fry rice before boiling?
- Peter Machado on Why fry rice before boiling?
- Lex on Does Google Analytics track 404 page responses as valid page views?

© 2023 AnswerBun.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP