Exercises: Evaluate Reports Based on Data
Each report below makes a claim from data. Work through the four lenses: (1) the sample — who was studied and how were they chosen; (2) the design — does it license association only, or causation; (3) the uncertainty — is a sample size, margin of error, or significance disclosed; and (4) the display — is any graph honest. Write explanation answers in complete sentences. A causal verb ("causes," "raises") needs a randomized experiment; an observational study supports association only.
Fluency: One Lens at a Time
Apply a single lens to each short report.
A report states: "In a survey of shoppers leaving Brand X's flagship store, 92% said Brand X is the best clothing brand." Name the one-word source concern this raises about who paid for or stands to benefit from the result. (One word, starting with a letter — think about conflict of ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ .) ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲ ̲