The Living Thing / Notebooks : Publication bias, P-values etc

Multiple testing across a whole scientific field, with a side helping of uneven data release.

This is a complicated issue which I won’t actually engage with right now.

Keywords: “pigeon-hole process” and the “publication sieve”, which are the large-scale models of how this works in a scientific community and “researcher degrees of freedom” which is the model for how this works at the individual scale.

This is particularly pertinent in social psychology, where it turns out the pigeons don’t fly with P=0.05.

See an interesting timeline and recap in Andrew Gelman, The winds have changed