Science with or without statistics: Discover-generalize-replicate? Discover-replicate-generalize?

Authors: John P.A. Ioannidis

Published: 2022-02-10

DOI: 10.1017/s0140525x21000054

Source: Full article


Abstract

AbstractOverstated generalizability (external validity) is common in research. It may coexist with inflation of the magnitude and statistical support for effects and dismissal of internal validity problems. Generalizability may be secured before attempting replication of proposed discoveries or replication may precede efforts to generalize. These opposite approaches may decrease or increase, respectively, the use of inferential statistics with advantages and disadvantages.