Discussion about this post

User's avatar
Liam Baldwin's avatar

> "Nick Huntington-Klein’s work, on the many analyst design, he has also found that the researcher degrees of freedom happen far further up the pipeline than estimation."

Are arbitrary cleaning/preparation decisions really being used to p-hack? Ostensibly these decisions are made far before any analyses are run; is it the case that (some) researchers are returning to the preparation and arbitrarily varying details, while holding the estimation fixed, to obtain significance? (Or is it just that researcher degrees of freedom in cleaning really hurts replication?)

Dr Sam Illingworth's avatar

Thanks Scott! How are you finding Claude's auto mode? Despite me hard-coding a hook into my soul file it still wants to keep asking me for permissions. Better to be safe than sorry, but sometimes a little irksome...

2 more comments...

No posts

Ready for more?