Mini Lectures In Probability

MINI LESSON 7: P-Values and P-Value Hacking: a simplified lecture. (2021x7)

Date de diffusion: Mai 23, 2021

We saw that 1) many metrics are stochastic, 2) what is stochastic can be hacked. This is the simplification of my work showing that "p-values are not p-values", i.e. highly sample dependent, with a skewed distribution. For instance for a "true" P value of .11, 53% of observations will show less than .05. This allows for hacking: in a few trials a researcher can get a fake p-value of .01.