Statistics and Studies: When Numbers Lie

About half of the psychology experiments tested in a major project couldn’t be repeated successfully. Now, listen in: a headline claims “coffee doubles your productivity,” a drug ad boasts “clinically proven results,” a startup flaunts “breakthrough data.” Which one, if any, should you trust?

That messy track record isn’t just a “science problem”; it’s a **numbers problem**—and those same tricks show up in political polls, health headlines, startup pitch decks, and even school performance reports. A study might rely on a tiny, unrepresentative group, quietly toss out “inconvenient” data, or slice the results in so many ways that *something* statistically “significant” pops out by chance. Visuals can mislead, too: a chart can make a tiny shift look like a crisis, or flatten a real risk until it seems harmless. And when correlation is sold as causation, yesterday’s coincidence becomes today’s “proven” trend. In this episode, we’ll slow down the hype cycle: how to spot shady statistics, what honest research looks like, and simple checks you can do before you let a number change your mind.

When a new study hits the news, you usually see only the polished headline, not the messy kitchen where the data were “cooked.” Was the sample big enough and diverse enough to matter to you? Were dozens of questions tested until something—anything—crossed the magic 0.05 line? Were “outliers” removed because they were errors, or because they spoiled the story? And even if the math checks out, who funded the work, and what do they stand to gain from a dramatic result? We’ll unpack how incentives, methods, and presentation quietly shape what those tidy percentages and bold claims really mean.