Non-standard errors / Albert J. Menkveld, Anna Dreber, Felix Holzmeister, Juergen Huber, Magnus Johannesson, Michael Kirchler, Sebastian Neusüss, Michael Razen, Utz Weitzel et al.
Anzeigen / Download3.28 MB
Discovery
1779882106
URN
urn:nbn:de:gbv:3:2-144204
DOI
ISBN
ISSN
Beiträger
Körperschaft
Erschienen
Halle (Saale), Germany : Halle Institute for Economic Research (IWH) - Member of the Leibniz Association, [November 23, 2021]
Umfang
1 Online-Ressource (III, 50 Seiten, 3,27 MB) : Illustrationen, Diagramme
Ausgabevermerk
Sprache
eng
Anmerkungen
Inhaltliche Zusammenfassung
In statistics, samples are drawn from a population in a datagenerating process (DGP). Standard errors measure the uncertainty in sample estimates of population parameters. In science, evidence is generated to test hypotheses in an evidencegenerating process (EGP). We claim that EGP variation across researchers adds uncertainty: non-standard errors. To study them, we let 164 teams test six hypotheses on the same sample. We find that non-standard errors are sizeable, on par with standard errors. Their size (i) co-varies only weakly with team merits, reproducibility, or peer rating, (ii) declines significantly after peer-feedback, and (iii) is underestimated by participants.
Schriftenreihe
IWH-Diskussionspapiere ; 2021, no. 11 (November 2021) ppn:837399270