For versus , an observed . Among 300 simulated proportions under , 21 are at or below 0.48 and 279 are above it. What is the simulated p-value? Give the exact decimal.
Simulation-based hypothesis tests
The four steps of a test, the null distribution as a what-if picture, simulated p-values, and the course's strength-of-evidence scale.
Key ideas
- Four steps
(1) Ask a question: define the parameter and state , . (2) Collect data from a random sample. (3) Analyze: build the null distribution, place the statistic, find the p-value. (4) Conclude in context with the strength of evidence.
- Hypotheses
always has an equals sign and names a parameter value; uses , or with the same number. No hats: hypotheses are about parameters.
- Null distribution
A what-if picture of values if were true. It is centered at , and each dot is one simulated repetition of the whole study.
- p-value
The probability, assuming is true, of a statistic as extreme as or more extreme than the one observed, in the direction of . Simulated p-value = fraction of simulated statistics in that region.
- Strength of evidence
: not enough evidence; : some; : strong; : very strong evidence against and for . STATS 250 does not use a single 0.05 cutoff.
The course evidence scale (printed on the help card)
| p-value | We say we have |
|---|---|
| not enough evidence | |
| some evidence | |
| strong evidence | |
| very strong evidence |
A spinner app that seems to like red
A game's spinner has four equal colors, so red should come up 25% of the time. A player suspects red comes up more often. In 40 spins, red appears 16 times. The player simulates 200 sets of 40 spins with ; 9 of the 200 simulated proportions are 0.40 or higher. Carry out the test.
Step 1: = the true long-run proportion of spins that land on red. versus .
Step 2: .
Step 3: The null distribution is centered at 0.25. The region of extreme follows : values at or above 0.40. Simulated p-value .
Step 4: , so strong evidence.
The data give strong evidence that the true long-run proportion of spins landing on red is greater than 0.25. That is strong evidence, not proof.
Check yourself
For versus with an observed , where should a correct null distribution be centered?
A test gives p = 0.035. On the STATS 250 scale this is:
Three samples test versus with equal sample sizes. They give , and . Which gives the smallest p-value?
A test of whether a coin is biased gives p = 0.41. Which conclusion is correct?
Select every correctly written pair of hypotheses.