Effect Size, Power, Intervals and Study Design
Estimated effect size and power; confidence intervals and what confidence levels mean; comparing two groups; confounding variables and when an association is causal. Covers Lec 08–14, Exam Prep 04–06, Labs 04–06 (the practice exam also recommends reviewing Lec 06–07).
Where the points go
Share by topicPatterns that repeat every time
- 01
Tables of t, p and
Several studies of one question with t, p and (some cells missing). Decide which had the larger sample, which replicates best (closest ), which mean was furthest from the null, and which effect size is plausible.
- 02
Interpretation or not?
Classify statements as a correct interpretation of the interval, a correct interpretation of the level, or not appropriate. Watch for probability language, individuals instead of a mean, and capturing the sample statistic.
- 03
Intervals and tests agree
Pick the plausible interval from a two-sided p-value and the sign of t, say whether a null value is inside, read an interval off a plot of p-values, or choose the 90% versus 95% interval from the same data.
- 04
Simulation plots of intervals
Rank plots by confidence level (count misses) and by sample size (compare widths at one level). Lecture said this question would come back.
- 05
Power comparisons with a reason
Two researchers, one difference (sample size, direction of , or no true effect): say who has higher power and explain in 1–2 sentences.
- 06
Part II: confounding and causation
Case Study 2 style: define , fix a wrong interpretation of a confidence level, show a confounder's two legs with numbers, and explain why non-significant stratified results are not evidence of equal means.
Exam format and strategy
Thu, Nov 5, 5:45 PMFormat
- Thursday, November 5, 2026 · 5:45–7:45 pm · 120 minutes for both parts
- Part I: Concepts and Skills, mostly multiple choice plus a few boxed answers and short explanations; about 80 minutes suggested
- Part II: Written Statistical Interpretation of new R output; about 40 minutes suggested (the Case Study 2 lab practiced 5 prompts: about 10 minutes reading, 30 writing)
- The parts are scored separately: Part I counts toward Category 1, Part II toward Category 2 (Written Statistical Interpretation 02 is 8% of the course grade)
Allowed
- Official help card provided (now with interval, two-mean and effect-size formulas)
- No calculator: the syllabus, the case-study lab slides, the practice-exam information page and lecture all say so. The printed exam cover says calculators are not required but allowed; confirm with the instructors. Numerical answers may be left as fractions
- Closed notes and closed book
- Photo ID shown when you submit
Strategy
- Budget about 80 minutes for Part I and about 40 for Part II.
- Before reading two-group output, predict from the plots: sign of t, size of p, sign of , and whether the interval contains 0.
- Separate the two questions every time: how strong is the evidence (p-value) and how big is the effect ()?
- For any interval statement, check three things: parameter not statistic, mean not individuals, confidence not probability.
- For a confounder, write both legs with numbers: conditional proportions for the link to , a center and the IQR location for the link to .
- Causal claims need random assignment; generalizing needs random sampling. Say which one the design has.