Pathwise

Manuals / Data Literacy / Chapter 6

C · Decisions · advanced · ~30 min · Chapter 6 of 8

Experiments & causality caution

Correlation ≠ causation. Novelty effects, seasonality, confounds. QA can challenge “the A/B won” narratives.

Path progress
75%

Step 1 of 1

Challenge a claim

Challenge a claimDrag stickies · tap for tips
Study mapDrag stickies · tap for tipsKeep it shortdrag · tap →Name the waitdrag · tap →Scope locatorsdrag · tap →Trace when stuckdrag · tap →One browser firstdrag · tap →Isolate statedrag · tap →Assert the UIdrag · tap →Retry wiselydrag · tap →Seed datadrag · tap →Close the loopdrag · tap →Keep it shortdrag · tap →Name the waitdrag · tap →Scope locatorsdrag · tap →Trace when stuckdrag · tap →One browser firstdrag · tap →Isolate statedrag · tap →Pathwise hackdrag · tap →Challenge a claimdrag · tap →Try thisdrag · tap →Follow the dashed drag · tap →

Do this now

Take one causal claim at work. List 3 alternative explanations.

Was this step clear?
Chapter learning outcomes
  • Confounds
  • Peeking
  • Practical significance

Clear these before you leave