Section 1.7

Observational Designs

When you can't assign the exposure (you can't randomly make people smoke, be poor, or catch a virus), you're left watching instead of intervening. That's an observational study. You give up the clean causal claim of an experiment, but you gain the ability to study questions that matter most. The craft is knowing which slice of reality each design lets you see, and exactly what it lets you say.

Three ways to watch

All three follow an exposure (a risk factor, a treatment, a habit) and an outcome (a disease, a pass/fail, an event). They differ in when you look and who you start from.

  • Cross-sectional: one snapshot in time. You measure exposure and outcome together in a sample, right now. Fast and cheap, great for estimating prevalence, but because both are measured at once, you usually can't tell which came first.
  • Cohort (prospective): start with exposed and unexposed people who don't yet have the outcome, then follow them forward and count who develops it. This is the strongest observational design: it measures incidence (new cases over time), so it hands you a risk ratio directly and pins down the time order. The cost: slow, expensive, and hopeless for rare outcomes (you'd follow thousands to see a handful of cases). This is the design behind survival analysis.
  • Case-control: flip it around. Start from the outcome: round up people who already have the disease (cases) plus a comparison group who don't (controls), then look backward at who was exposed. Brilliant for rare outcomes and quick to run, but because you chose how many cases and controls to enroll, you can only speak in odds ratios, never risk.

See which slice each design gets

Below, a population of 240 people is followed for 20 years; some develop the outcome, and exposed people are at higher risk. Pick a design and watch which people you actually get to observe — and the estimate each design produces versus the truth.

🔭 Which Slice Does Your Design See?

One fixed population develops an outcome over 20 years. The cohort follows everyone forward; the case-control starts from the cases and samples controls; the cross-sectional sees only a single snapshot. Watch the odds ratio drift away from the risk ratio as the outcome gets more common.

The truth (from the whole population)

True risk ratio
True odds ratio

What each design estimates (selected design highlighted)

Cohort → risk ratio
Case-control → odds ratio
Cross-sectional → odds ratio

Why case-control speaks in odds ratios

In a cohort you know the denominators (how many exposed and unexposed people you started with), so you can compute a risk (cases ÷ people at risk) and divide them into a risk ratio. In a case-control study you chose the number of cases and controls (often 1:1 or 1:4), so "cases ÷ everyone" is a number you invented, not a real risk. What survives that arbitrary choice is the odds ratio. Happily, the odds ratio from a case-control study estimates the same odds ratio you'd get from the whole population. It's the natural currency of case-control work and of logistic regression.

The odds ratio only approximates the risk ratio when the outcome is rare (the rare-disease assumption). Push the baseline-risk slider up and watch the odds ratio pull away from the risk ratio: when a fifth or a third of people have the outcome, an odds ratio of 2 can mean a risk ratio well under 2. Reporting "twice the odds" as "twice the risk" is one of the most common ways headlines mislead. If you need to put an odds ratio alongside effects reported on other scales, the effect-size converter does the translation.

Survivorship bias: observational data only contains whoever survived long enough to be in it. Study successful companies and you'll "discover" the traits of the ones that didn't fold; measure patients still in the clinic and you miss the ones who already died or recovered and left. The dangerous part is that the people who dropped out are invisible — the sample looks complete. Always ask: who is missing from this data, and were they missing for a reason tied to the outcome?

Why it matters: observational designs carry most of what we know about diet, disease, education, and policy, because randomizing those exposures is impossible or unethical. But every one estimates a specific quantity (prevalence, incidence, or odds) under specific assumptions, and confounding always lurks (see causal DAGs & confounding). Name your design, name what it can estimate, and name who might be missing from it.

Common questions

What is the difference between a cohort study and a case-control study?

They run in opposite directions. A cohort study starts from the exposure — it enrolls exposed and unexposed people who don't yet have the outcome and follows them forward to see who develops it, which measures incidence and yields a risk ratio directly. A case-control study starts from the outcome — it rounds up people who already have the disease (cases) plus a comparison group (controls) and looks backward at who was exposed. Cohorts are stronger for establishing time-order but slow and poor for rare outcomes; case-control studies are fast and efficient for rare outcomes but can only estimate an odds ratio.

Isn't a huge observational study better than a small randomized trial?

For precision, yes; for causation, no, and the two are easy to confuse. More data shrinks the confidence interval around whatever you are estimating, but it does nothing to the bias, so a large observational study can deliver a very precise answer to a question you did not mean to ask. Confounding does not average out with sample size the way noise does, which is exactly what the randomization playground shows: the imbalance bars under self-selection stay put as n grows while the randomized ones drift to zero. The honest reading is that the two designs answer different questions. Big observational studies are how we learn what happens in the world as it actually is, including in people a trial would have excluded; trials are how we learn what a change would do. Where they disagree, the trial usually wins on the causal claim and the observational study usually wins on who it applies to.

Why does a case-control study report odds ratios instead of risk ratios?

Because the researcher chose how many cases and controls to enroll (often 1:1 or 1:4), the fraction of cases among everyone enrolled is an artifact of that choice, not a real risk, so risk ratios can't be computed. The odds ratio, however, is unaffected by how you sampled cases versus controls, and it estimates the same odds ratio you'd find in the whole population. The odds ratio only approximates the risk ratio when the outcome is rare (the rare-disease assumption); for common outcomes it overstates it.