MaizePrepSTATS 250
Exam 2 · Lec 11

Understanding confidence levels

What "95% confident" means, why a computed interval has no 95% probability, how level and sample size move width and reliability, and the interval–test connection.

30 min

Key ideas

Probability versus confidence

Probability describes a future random event. Confidence describes our certainty about something already fixed, like whether this interval captured μ\mu.

Level

The expected long-run capture rate. In 100 intervals at 95% we expect about 95 hits, not exactly 95.

Level and width

Higher level → larger multiplier → wider interval. More reliable, less precise.

Sample size

Larger nn → smaller SE → narrower interval. Reliability (the level) does not change; this surprised many students in lecture.

Interval–test connection

For a two-sided test: null value inside a level-C interval ⇔ p-value greater than 1−C1 - C; outside ⇔ p-value less than 1−C1 - C. An interval is the set of null values the data do not reject at that level.

Reading simulation plots

To rank levels, count misses (fewest misses = highest level). To rank sample sizes, compare widths among plots at the same level (narrowest = largest nn).

Connection rules

Inside the interval
θ0∈CIC  ⟺  ptwo-sided>1−C\theta_0\in CI_C\iff p_{\text{two-sided}}>1-C
Outside the interval
θ0∉CIC  ⟺  ptwo-sided<1−C\theta_0\notin CI_C\iff p_{\text{two-sided}}<1-C
E.g. a 90% interval matches a two-sided p-value benchmark of 0.10.
Worked example

Tutoring and quiz gains

A random sample of 25 students records their quiz score gain after tutoring. Use the output to say what a two-sided test of μ=0\mu = 0 and of μ=5\mu = 5 would show, and what a 99% interval would look like.

t.test(gain, conf.level = 0.95)

	One Sample t-test

data:  gain
t = 4.625, df = 24, p-value = 0.0001078
alternative hypothesis: true mean is not equal to 0
95 percent confidence interval:
 2.048881 5.351119
sample estimates:
mean of x 
      3.7 
  1. $\mu_0 = 0$: 0 is outside (2.05, 5.35), so the two-sided p-value is below 0.05 (the output confirms 0.0001).

  2. $\mu_0 = 5$: 5 is inside the interval, so the two-sided p-value is above 0.05 (it is about 0.117): not enough evidence the mean gain differs from 5.

  3. 99% interval: same center 3.7, larger multiplier, so wider: about (1.46, 5.94). Still excludes 0, so p < 0.01 for μ0=0\mu_0 = 0.

  4. Interpretation: we are 95% confident the true mean quiz gain for all students like these is between 2.05 and 5.35 points.

Answer

0 is implausible at both levels; 5 remains plausible. Raising the level widened the interval around the same center.

Check yourself

1
Lec 11

Which statement correctly interprets the 90% level of an interval for the mean daily water use of a city's households?

2
Lec 11

A 90% interval for the proportion of a college's students who live off campus is (0.31, 0.39). A two-sided test of H0:π=0.40H_0: \pi = 0.40 with the same data would give:

3
Lec 11

A two-sided test of H0:μ=50H_0: \mu = 50 gives p = 0.03. Which is true about intervals from the same data?

4
Lec 11

A simulation draws 100 intervals for the same parameter, all with the same sample size; 11 of them miss the parameter. Which confidence level was most likely used?

5
Lec 11

Quantity A: the reliability (long-run capture rate) of 95% intervals from samples of 50. Quantity B: the reliability of 95% intervals from samples of 500.

6
Lec 11

A 95% interval for a proportion is 0.26±0.0420.26 \pm 0.042. Using z∗=1.96z^* = 1.96 for 95% and 1.6451.645 for 90%, about what is the margin of error of the 90% interval from the same sample?

MaizePrep is an independent study resource. It is not affiliated with, sponsored by, or endorsed by the University of Michigan. Course names and numbers are used only to describe which class the material covers. Every practice question is original, written in the style of the course.