# Calculating Significantly Above Chance for 3-AFC Test

I am trying to figure out which participants who took a 18-item multiple choice test scored significantly above chance. Each item has 3 choices, so the probability of getting each question correct is 0.33. To know how many items correct a person would have to get in order to be significantly above chance, does it make sense to use a binomial probability calculator like this: https://stattrek.com/online-calculator/binomial.aspx and try different numbers of successes until the probability is < p=0.05 (assuming this is my significance criteria)?

For 18 items where the probability correct is 0.33, the probability of getting 9 correct is 0.061 and the probability of getting 10 correct is p=0.027, so does it make sense to use “10 items correct” as my criteria for “performed significantly above chance?”

Psychology & Neuroscience Asked by bernice.anders on December 30, 2020

The hypothesis would normally be expressed as a one-sided test as p(X≥10). The online calculator you have selected is fine and the significant result could be expressed in an article as follows: (p=0.33, q=0.66, K=10, n=18, p-value = 0.043).

Another way to think of this is that 9 or fewer correct answers is more likely to be random chance.

At the threshold of 10, it is unlikely that the result could be explained by random chance.

Answered by Tony Mobbs on December 30, 2020

## Related Questions

### What is the scientific term for the erroneous inversion of cause and effect?

3  Asked on February 8, 2021 by user1934212

### Public domain scientific intelligence test available for use in research

4  Asked on February 7, 2021 by jeromy-anglim

### What do we know about actual limits of wire heading in humans?

0  Asked on February 6, 2021 by rexcirus

### Psychological explanation for exorcisms?

1  Asked on February 4, 2021

### Experience organised by concepts – relevant science?

0  Asked on February 4, 2021 by jonb

### Learning vocabulary: Is it better to learn the word through translations?

0  Asked on February 4, 2021 by coffeeislife

### Equivalent Circuit of cell membrane potential

1  Asked on February 2, 2021 by oliver-g

### Term for emotional distancing?

1  Asked on January 31, 2021 by randy-zeitman

### What fraction of the population has secure attachment style?

1  Asked on January 31, 2021 by d-w

### Frissons on demand

1  Asked on January 31, 2021

### Which term is meant in this example of defence mechanism?

2  Asked on January 29, 2021

### Multiple “levels” of association in classical conditioning?

1  Asked on January 28, 2021 by prathamesh-kulkarni

### Graph Dynamical Systems for simulating Spiking Neural Networks

0  Asked on January 27, 2021 by brian-barry

### Will smoking marijuana lightly during teens cause developmental damage to the brain?

1  Asked on January 26, 2021 by yaniv-arazi

### Are we biased against other people’s suggestions?

1  Asked on January 25, 2021

### Curved/angled geometrical forms and association with femininity/ masculinity

1  Asked on January 23, 2021

### What’s the psychological basis for “Look at me when I’m talking to you”?

4  Asked on January 22, 2021

### What are the factors that make the membrane more permeable to Potassium ions than Sodium or Chloride (or any other ions)?

1  Asked on January 21, 2021 by noone01

### How to teach yourself to keep secrets?

0  Asked on January 21, 2021 by user26710

### Why is almost all therapy done as one-hour sessions weekly?

2  Asked on January 20, 2021 by jared-k

### Ask a Question

Get help from others!