MaizePrepSTATS 250
Exam 2 · Lec 09

Power

The chance a test catches a false null: estimating it by simulation, and how the true effect size, the sample size and the direction of HaH_a change it.

25 min

Key ideas

Power

The long-run proportion of repeated tests that give p≤0.05p \le 0.05 (strong or very strong evidence) when the null is wrong and the alternative points the right way.

Estimating power by simulation

Simulate many samples from the true situation, run the test on each, and count the strong plus very strong results over the total.

True effect size

How wrong the null is. For a fixed nn, a larger true effect gives more power.

Sample size

For a fixed true effect, a larger nn shrinks sampling variability and raises power. A small effect needs a large sample to reach the same power.

Direction

A one-sided test pointed away from the truth has almost no power.

No true effect

Power is only defined when the null is wrong. If the true effect is 0, larger samples do not help: any strong evidence would be a chance result.

Planning

Researchers choose nn before collecting data so the test has reasonable power (often 80%) for the smallest effect they care about.

Worked example

Seed germination

A seed company claims an 80% germination rate. Suppose the true rate is 74% (true effect size −0.15-0.15). A simulation runs a left-tailed z-test (H0:π=0.80H_0: \pi = 0.80, Ha:π<0.80H_a: \pi < 0.80) on 400 random samples of 60 seeds. Results: very strong 58, strong 106, some 70, not enough 166. Estimate and interpret the power.

  1. Count only strong and very strong: 58+106=16458 + 106 = 164.

  2. Power estimate: 164/400=0.41164/400 = 0.41.

  3. Interpret: when the company's claim of 80% is wrong and the true rate is 74%, a test based on 60 seeds detects the mistake in only about 41% of repeated samples.

  4. What would raise it: more seeds per sample, or a larger true shortfall. Including the "some evidence" bin would overstate power.

Answer

Power ≈ 0.41: this design misses a true 6-point shortfall more often than it catches it.

Check yourself

1
Lec 09

A simulation runs 250 tests when the null is wrong: 31 very strong, 64 strong, 40 some, 115 not enough evidence. Estimate the power as a decimal.

Math shortcuts are on for STATS 250. Type ^ then digits for powers, _ then digits for subscripts.
2
Lec 09

A planned two-sided t-test of H0:μ=50H_0: \mu = 50 with n = 40 has modest power when the true mean is 53. Select every change that would raise its power.

3
Lec 09

The true proportion is 0.30. Three analysts test H0:π=0.40H_0: \pi = 0.40 with samples of the same size: Analyst L uses Ha:π<0.40H_a: \pi < 0.40, Analyst T uses Ha:π≠0.40H_a: \pi \ne 0.40, and Analyst R uses Ha:π>0.40H_a: \pi > 0.40. Rank their power from highest to lowest.

4
Lec 09

Quantity A: power to detect a true π=0.62\pi = 0.62 when testing H0:π=0.50H_0: \pi = 0.50 with n=100n = 100. Quantity B: power to detect a true π=0.55\pi = 0.55 with the same null and nn.

5
Lec 09

A study reports power 0.38. Which interpretation is correct?

6
Lec 09

A pilot study with 15 participants finds p = 0.40. Select every statement that is justified.

7
Lec 09

In the seed-germination simulation, the true rate stays 74% but each simulated test now uses 240 seeds instead of 60. The estimated power will most likely:

MaizePrep is an independent study resource. It is not affiliated with, sponsored by, or endorsed by the University of Michigan. Course names and numbers are used only to describe which class the material covers. Every practice question is original, written in the style of the course.