January 2018 PMID 30980045

Redefine statistical significance.

Daniel J Benjamin, James O Berger, Magnus Johannesson, Brian A Nosek, E-J Wagenmakers, Richard Berk, Kenneth A Bollen, Björn Brembs, Lawrence Brown, Colin Camerer, David Cesarini, Christopher D Chambers, Merlise Clyde, Thomas D Cook, Paul De Boeck

Mentions

211
Peak: 19 in Jan 2023
across 7 sources since Jul 2017

Extended reach

855,043
potential audience

Total likes

375

Video views

13,233

Mentions per month

Jul 2017 – Sep 2025

Where it's discussed

  • X / Twitter99 posts
  • Facebook45 posts
  • Blogs29 articles
  • News21 articles
  • Bluesky11 posts
  • Reddit4 posts
  • YouTube2 videos

AI synopsis

What people are saying

This collection of social discussions reflects a strong consensus among many researchers calling for a redefinition of statistical significance, especially lowering the p-value cutoff to 0.005, with examples like the mention of 72 authors supporting the move, and debates around its practical implications and scientific validity. The tone varies from supportive to cautious, highlighting both enthusiasm for reform and recognition of ongoing controversy.

AgreementModerate agreement

Many discussants support the idea of lowering the significance threshold to improve scientific rigor, with phrases like 'most experiments in social sciences should meet this standard' and citing the large group of 72 authors advocating for it.

InterestHigh interest

The topic clearly sparks high curiosity, as evidenced by frequent mentions of debates, lists of proponents, and questions about current practices, indicating strong engagement with the subject.

EngagementHigh engagement

Several posts reference specific arguments, including methodological critiques and broader implications, showing deep involvement in the discussion rather than superficial opinions.

ImpactHigh impact

The widespread sharing of the paper, references to authoritative responses, and notes on the controversy suggest this discussion could influence research standards and practices across fields.

Abstract in brief

  • The text suggests that the traditional way of interpreting statistical significance may need to be reconsidered or changed to better reflect true scientific insights.
  • It likely discusses issues with the current cutoff for significance (like p < 0.05) and how this might lead to misleading conclusions.
  • It promotes the idea of redefining what counts as statistically significant to improve research reliability and understanding.]

Top posts

Most liked on X and Bluesky
Nature Human Behaviour
@NatureHumBehav · X

Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change this, Bialek et al. propose the introduction of mandated alpha-level statements by journals and preregistration platforms. https://t.co/usOPxcnjyi

Jan 23, 2023 · 38 likes · 18 shares · 28,651 followers View post →
Richard H. Ebright
@R_H_Ebright · X

@WendyOrent @K_G_Andersen @ShooguhLipz I have heard advocacy before for re-defining the P-value threshold for a statistically significant result from 0.05 to 0.005 (https://t.co/qkTq3vszf1)...but I never have heard advocacy before for changing it to something well below 0.0009.

May 9, 2021 · 27 likes · 2 shares · 80,992 followers View post →
Daniël Lakens
@lakens · X

Edouard Machery, one of the Redefine Statistical Significance authors: I think in principle Lakens and colleagues might be right that in an idealized scientific context we would want to set up the significance level by looking at the costs of false positive and false negatives." https://t.co/RUAc2xSobk

Apr 5, 2020 · 13 likes · 2 shares · 30,617 followers View post →
Everything Hertz
@hertzpodcast · X

Settle an argument. Dan thinks no one has published a paper or preprint systematically assessing whether co-authors on the “Redefine Statistical Significance” paper all now use a .005 threshold in their hypothesis-driven research. James thinks someone has. Who’s right?

Sep 5, 2020 · 12 likes · 4 shares · 7,013 followers View post →
Alex Bilzerian
@alexbilz · X

'Remove, rather than redefine, statistical significance', Amrhein & Greenland https://t.co/OAwZZYJWgM https://t.co/MRoa5r7NDo

Jul 22, 2024 · 11 likes · 18,088 followers View post →
Análise Real
@analisereal · X

I guess Kolmogorov would be on the team “redefine statistical significance?” https://t.co/FQRCcGHnz6

Nov 25, 2021 · 8 likes · 7,746 followers View post →

All mentions

Challenges with Statistical Significance in Research

In this talk from Jan 13th, 2020, Ben Prytherch discusses the complexities surrounding statistical significance, referencing key works in the field. He examines critical perspectives on the use of p-values and calls for…

Stat Lab · Jan 17, 2020 1,584 views
黒木玄 Gen Kuroki
@genkuroki · X

RT @genkuroki: #統計 null P値の閾値による「統計的有意性」自体を廃棄せずに「閾値を0.05から0.005に下げる」という呆れた提案はある種のベイズ学者達によって行われました。 有名な0.005論文はこれ ↓ https://t.co/dC3i6EMZge…

Sep 20, 2025 · 1 share · 15,566 followers View post →
黒木玄 Gen Kuroki
@genkuroki · X

#統計 null P値の閾値による「統計的有意性」自体を廃棄せずに「閾値を0.05から0.005に下げる」という呆れた提案はある種のベイズ学者達によって行われました。 有名な0.005論文はこれ ↓ https://t.co/dC3i6EMZge Benjamin et al. Redefine statistical significance Nature Human Behaviour 2017 https://t.co/GV558ChO2T

Sep 20, 2025 · 5 likes · 1 share · 15,566 followers View post →
Mr DO
@daniel_olofin · X

I just found out there's a proposal to redefine statistical significance from p < 0.05 to p < 0.005 for claiming new discoveries

May 20, 2025 · 6 likes · 660 followers View post →
Nick Byrd, Ph.D.
@byrd_nick · X

@RogertheGS The framing hypothesis is interesting.

Apr 8, 2025 · 3,497 followers View post →
moin syed
@syeducation.bsky.social · Bluesky

Redefine statistical significance: www.nature.com/articles/s41...

Oct 28, 2024 · 1 like View post →
moin syed
@syeducation.bsky.social · Bluesky

Read the three core papers on the "alpha wars" of ~2018 for my grad methods course today (links below), and I asked them to choose the one they most agree with: 5 for abandon statistical significance, 4 for justify your alpha, and 2 for redefine statistical significance. p < .005 not too popular!

Oct 28, 2024 · 6 likes · 6 shares View post →
AustrianHistorian
@GamerReserva · X

@accelereta42 échale un ojo a esto: Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E. J., Berk, R., ... & Johnson, V. E. (2018). Redefine statistical significance. Nature human behaviour, 2(1), 6-10.

Sep 7, 2024 · 1 like · 390 followers View post →
Alex Bilzerian
@alexbilz · X

'Remove, rather than redefine, statistical significance', Amrhein & Greenland https://t.co/OAwZZYJWgM https://t.co/MRoa5r7NDo

Jul 22, 2024 · 11 likes · 18,088 followers View post →
Dorothy Bishop
@deevybee · X

@lakens There were a lot of people who were asked to be coauthors of Redefine Statistical Significance and didn't, so be careful in what you assume!

Dec 2, 2023 · 2 likes · 36,871 followers View post →
Dorothy Bishop
@deevybee · X

@lakens "Several on this team". I just checked. The only overlap I could see between the Redefine Statistical Significance authors and the editorial list was one person - Simine Vizire. May have missed some but I think you should double check yourself

Dec 2, 2023 · 36,871 followers View post →
Communications Psychology
@CommsPsychol · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 24, 2023 · 18 shares · 1,383 followers View post →
Isabella R. Ghement
@IsabellaGhement · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 24, 2023 · 18 shares · 5,792 followers View post →
Valentin Amrhein
@vamrhein · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 24, 2023 · 18 shares · 1,252 followers View post →
Constantin Späth @cspaeth.bsky.social
@ConstantinSpath · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 24, 2023 · 18 shares · 34 followers View post →
Kristy Lee
@kristy_lee_jj · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 24, 2023 · 18 shares · 6 followers View post →
JeanDelmotte
@DrStagiaire · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 24, 2023 · 18 shares · 357 followers View post →
S. Prasad Chandrashekar
@PRASAC · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 24, 2023 · 18 shares · 467 followers View post →
Winson Peng
@winsonpeng2011 · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 23, 2023 · 18 shares · 690 followers View post →
kokako
@kokako65541706 · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 23, 2023 · 18 shares · 7 followers View post →
SIAM Activity Group on Dynamical Systems
@DynamicsSIAM · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 23, 2023 · 18 shares · 11,000 followers View post →
Christian Oswald
@teamoswald · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 23, 2023 · 18 shares · 411 followers View post →
Pedro Alfaro
@PedroAl72438352 · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 23, 2023 · 18 shares · 24 followers View post →
Michał Białek
@mbialek82 · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 23, 2023 · 18 shares · 833 followers View post →
Daniel Celis-Giraldo
@dacelgi · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 23, 2023 · 18 shares · 143 followers View post →
Shahan
@shahanmemon · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 23, 2023 · 18 shares · 1,000 followers View post →
Myeong Lee
@deeperlee · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 23, 2023 · 18 shares · 502 followers View post →
Morteza Mahmoudi, PhD
@MoriMahmoudi · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 23, 2023 · 18 shares · 1,743 followers View post →
Adrián Muñoz García
@AdrianMunozG · X

RT @NatureHumBehav: Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change…

Jan 23, 2023 · 18 shares · 215 followers View post →
Nature Human Behaviour
@NatureHumBehav · X

Scientists have called to redefine statistical significance, but the recommendations are not widely adopted. To change this, Bialek et al. propose the introduction of mandated alpha-level statements by journals and preregistration platforms. https://t.co/usOPxcnjyi

Jan 23, 2023 · 38 likes · 18 shares · 28,651 followers View post →
Zachary L Howard
@ZHowardPsych · X

@aidybarnett @PLOSONE Ironically it seems like the least expected p-values are now those >0.05, maybe we should redefine statistical significance

Sep 20, 2022 · 73 followers View post →
Sascha B. Duken
@SBDuken · X

The three most cited articles in NHB are actually two perspectives and one comment. I think all of them are non-citable and therefore inflate the impact factor (but I'm not 100% sure about these). https://t.co/4MKnq9u4K6 https://t.co/ktohdt8BI8 https://t.co/U45Vp6Ms0E

Jun 27, 2022 · 208 followers View post →
Riccardo
@_rgoldoni · X

RT @ResearchHub: Join us in this discussion at @ResearchHub about one of the most fundamental aspects of scientific publishing: The P Value…

Jun 9, 2022 · 2 shares · 374 followers View post →
ResearchHub
@ResearchHub · X

Join us in this discussion at @ResearchHub about one of the most fundamental aspects of scientific publishing: The P Value. Benjamin et al suggests a more stringent p-value cutoff of 0.005 vs 0.05 for the discovery of new effects. https://t.co/SLzJOo3xOr #DeSci

Jun 9, 2022 · 7 likes · 2 shares · 43,086 followers View post →
Iván Pérez-Neri
@IvanPerezNeri · X

Redefine statistical significance | Nature Human Behaviour https://t.co/IVGHWWFEv4

Mar 17, 2022 · 320 followers View post →
Otavio Berwanger
@OtavioBerwanger · X

RT @GuyattGH: Very high proportion of articles reporting p < 0.05 and associated replication crisis have prompted calls for #threshold p of…

Mar 16, 2022 · 44 shares · 1,185 followers View post →
Peter Stubbs
@PeterStubbsPT · X

RT @GuyattGH: Very high proportion of articles reporting p < 0.05 and associated replication crisis have prompted calls for #threshold p of…

Mar 16, 2022 · 44 shares · 352 followers View post →
みや
@1ch1go1ch1e · X

RT @GuyattGH: Very high proportion of articles reporting p < 0.05 and associated replication crisis have prompted calls for #threshold p of…

Mar 16, 2022 · 44 shares · 3,569 followers View post →
Camilo Andrés Rojas Porras
@kmilorojasp · X

RT @GuyattGH: Very high proportion of articles reporting p < 0.05 and associated replication crisis have prompted calls for #threshold p of…

Mar 16, 2022 · 44 shares · 491 followers View post →
Abraham E. Gracia R.
@Abraham_RMI · X

RT @GuyattGH: Very high proportion of articles reporting p < 0.05 and associated replication crisis have prompted calls for #threshold p of…

Mar 16, 2022 · 44 shares · 4,676 followers View post →
silly goose qua silly goose
@anendinitself · X

Daniel Benjamin, sending a mass email to 50 of his friends: Do you think we should redefine statistical significance? Reply “Yes” if you agree! https://t.co/d0ou9U2QT1

Mar 16, 2022 · 8 likes · 3,636 followers View post →
♕Deborah Mayo♕
@learnfromerror · X

Memory Lane (4 years ago): Why significance testers should reject the argument to “redefine statistical significance”, even if they want to lower the p-value* https://t.co/llSlYvmvdQ

Dec 3, 2021 · 2 likes · 1 share · 6,856 followers View post →
Análise Real
@analisereal · X

I guess Kolmogorov would be on the team “redefine statistical significance?” https://t.co/FQRCcGHnz6

Nov 25, 2021 · 8 likes · 7,746 followers View post →
Carlos L
@caeoutlook · X

RT @RubinPsyc: (1) Low statistical standards of evidence “Statistical standards of evidence for claiming new discoveries in many fields of…

Oct 13, 2021 · 2 shares · 71 followers View post →
Carlos E Lourenco
@caerib · X

RT @RubinPsyc: (1) Low statistical standards of evidence “Statistical standards of evidence for claiming new discoveries in many fields of…

Oct 12, 2021 · 2 shares · 448 followers View post →
Mark Rubin
@RubinPsyc · X

(1) Low statistical standards of evidence “Statistical standards of evidence for claiming new discoveries in many fields of science are simply too low” (Benjamin et al., 2018). https://t.co/nUe08gfZtB

Oct 12, 2021 · 7 likes · 2 shares · 3,127 followers View post →
Rodrigo Nunes Cal
@CalZole · X

Comment Published: 01 September 2017 Redefine statistical significance Daniel J. Benjamin, James O. Berger, […]Valen E. Johnson Nature Human Behaviour volume 2, pages6–10 (2018)Cite this article https://t.co/i04R2Gt7nM

Aug 25, 2021 · 3,377 followers View post →
Rodrigo Nunes Cal
@CalZole · X

https://t.co/i04R2Gt7nM Redefine statistical significance Daniel J. Benjamin, James O. Berger, […]Valen E. Johnson Nature Human Behaviour volume 2, pages6–10 (2018)

Aug 24, 2021 · 3,377 followers View post →
Rodrigo Nunes Cal
@CalZole · X

https://t.co/i04R2Gt7nM Redefine statistical significance Daniel J. Benjamin, James O. Berger, […]Valen E. Johnson Nature Human Behaviour volume 2, pages6–10 (2018)Cite this article 135k Accesses

Aug 24, 2021 · 3,377 followers View post →
Ben Lyons
@ba_lyons · X

@n_stenhou @aedwardslevy Who called it Star Wars and not Redefine Statistical Significance

Jul 22, 2021 · 2 likes · 1,381 followers View post →
ScienceStop
@B0tSci · X

RT @deepgreendesign: Dear @VoiceOfFranky, Does your statistical analysis conform to a p-value of 0.005?

Jun 12, 2021 · 1 share · 4,067 followers View post →
❤️Harold Coxeter is my math hero, prove me wrong.
@deepgreendesign · X

Dear @VoiceOfFranky, Does your statistical analysis conform to a p-value of 0.005?

Jun 12, 2021 · 1 share · 10,974 followers View post →
rra
@rra · X

RT @R_H_Ebright: @WendyOrent @K_G_Andersen @ShooguhLipz I have heard advocacy before for re-defining the P-value threshold for a statistica…

May 9, 2021 · 2 shares · 226 followers View post →
Richard H. Ebright
@R_H_Ebright · X

@WendyOrent @K_G_Andersen @ShooguhLipz I have heard advocacy before for re-defining the P-value threshold for a statistically significant result from 0.05 to 0.005 (https://t.co/qkTq3vszf1)...but I never have heard advocacy before for changing it to something well below 0.0009.

May 9, 2021 · 27 likes · 2 shares · 80,992 followers View post →
Richard H. Ebright
@R_H_Ebright · X

@Ayjchan @HL3133 @ClaireBerlinski I have heard advocacy before for re-defining the P-value threshold for a statistically significant result from 0.05 to 0.005 (https://t.co/qkTq3vszf1…)...but I never have heard advocacy before for changing it to something well below 0.0009.

May 9, 2021 · 6 likes · 80,992 followers View post →
Richard H. Ebright
@R_H_Ebright · X

@cshperspectives I have heard advocacy before for re-defining the P-value threshold for a statistically significant result from 0.05 to 0.005 (https://t.co/qkTq3vszf1)...but I never have heard advocacy before for changing it to something well below 0.0009.

May 9, 2021 · 3 likes · 80,992 followers View post →
Richard H. Ebright
@R_H_Ebright · X

@MackayIM I have heard advocacy before for re-defining the P-value threshold for a statistically significant result from 0.05 to 0.005 (https://t.co/KPsmFAsf9z)...but I never have heard advocacy before for changing it to something well below 0.0009.

May 9, 2021 · 2 likes · 80,992 followers View post →
Andrew Munro
@AndrewPMunro · X

Redefine Statistical Significance XIX: Monkey Business https://t.co/oOSp8r3QFc In the “hypothesis-free” group, students were simply asked What do you conclude from the #data set?” https://t.co/iauzJRKHQy

Mar 27, 2021 · 1 like · 6,608 followers View post →
Gustav H
@GustavH248 · X

I've now also contactd sm of the authors of the paper listed. Interested, @NatureHumBehav ? Short thread reg the paper "Redefine statistical significance", starting above.

Mar 9, 2021 · 200 followers View post →
Gustav H
@GustavH248 · X

Hi @StatModeling , @lakens and others interested. Saw the article "Redefine statistical significance", and some of the following discussion. Would like to add to it, which I don't think had been said, that I think the view on "false positive rate" in eg fig 2 is a bit faulty.

Mar 9, 2021 · 200 followers View post →
Carlos Sevcik
@kayoskuvenez · X

@marlhonherrera @estadoisrael Los niveles de significación estadística son muy bajos "After multivariate adjustment for confounders and mortality risks, the mortality difference remained significant (OR, 0.27; 95% CI, 0.09-0.80; P = .03)" Hoy 0.03 es cuestionable vid doi:10.1038/s41562-017-0189-z

Feb 18, 2021 · 310 followers View post →
Xetanix
@Xetanix · X

RT @FrogHarmless: @kdpsinghlab @maximumcharacte Maybe I should just start interpreting studies where p>0.005 as nulls. https://t.co/mzzI2…

Jan 4, 2021 · 1 share · 969 followers View post →
Harmless Frog
@FrogHarmless · X

@kdpsinghlab @maximumcharacte Maybe I should just start interpreting studies where p>0.005 as nulls. https://t.co/mzzI21HgVd

Jan 4, 2021 · 3 likes · 1 share · 503 followers View post →
paul blart magician girl
@Psycholosopher · X

Redefine Statistical Significance XIX: Monkey Business | Bayesian Spectacles https://t.co/pBzw27eQt4

Dec 10, 2020 · 177 followers View post →
Ken McAlinn
@kenmcalinn · X

Redefine statistical significance https://t.co/LIu5FpysKr まぁp値はそれ以外にも色々問題はあるんですけどね。 https://t.co/yOq9cMVOdj

Dec 10, 2020 · 3 likes · 12,649 followers View post →
paul blart magician girl
@Psycholosopher · X

Redefine Statistical Significance by Edouard Machery | Journal Entries https://t.co/iZvUI0CBo1

Nov 30, 2020 · 177 followers View post →
paul blart magician girl
@Psycholosopher · X

Redefine Statistical Significance by Edouard Machery | Journal Entries https://t.co/iZvUI0CBo1

Nov 17, 2020 · 177 followers View post →
ALBIV⚡
@valdra76 · X

https://t.co/Tl7GfvDifa

Oct 18, 2020 · 1,859 followers View post →
♕Deborah Mayo♕
@learnfromerror · X

A blogpost of direct relevance to a point in the exchange between J. Berger and I at the stat debate. I'll be blogging on this shortly, so see this as background (if interested). https://t.co/daKgTcxvuN

Oct 18, 2020 · 7 likes · 1 share · 6,856 followers View post →
Pedro Fonseca
@ptelesfonseca · X

@Consistent_W @daniela_witten - Delampady and Berger: "Lower bounds on bayes factors for multinomial distributions, with application to chi-squared tests of fit" - Sellke et al: "Calibration of p values for testing precise null hypotheses" - Benjamin et al "Redefine statistical significance"

Oct 3, 2020 · 57 followers View post →
Francisco Coronado
@fcoronado20 · X

RT @dj3mb: ¿Cansados de resultados no replicables? ¿Hartos del p fishing? ¿Tentados de usar pruebas bayesianas de significación? Mejor ba…

Sep 17, 2020 · 1 share · 654 followers View post →
Emilio Blanco (@eblanco.bsky.social)
@dj3mb · X

¿Cansados de resultados no replicables? ¿Hartos del p fishing? ¿Tentados de usar pruebas bayesianas de significación? Mejor bajar el valor crítico de p a .005 y listo! "Redefine statistical significance"; 72 autores. https://t.co/BWfX4e3grs

Sep 17, 2020 · 8 likes · 1 share · 5,648 followers View post →
John Billings
@JohnHBillings · X

There was another paper I read (Benjamin et al, 2017, “Redefine statistical significance”) that also made a strong argument for lowering alpha down to 0.005. For most experiments in social sciences, you should be able to design a study that can meet that standard. https://t.co/YzfobXomMA

Sep 12, 2020 · 159 followers View post →
Isabella R. Ghement
@IsabellaGhement · X

RT @hertzpodcast: Settle an argument. Dan thinks no one has published a paper or preprint systematically assessing whether co-authors on…

Sep 5, 2020 · 4 shares · 5,792 followers View post →
Daniël Lakens
@lakens · X

RT @hertzpodcast: Settle an argument. Dan thinks no one has published a paper or preprint systematically assessing whether co-authors on…

Sep 5, 2020 · 4 shares · 30,617 followers View post →
levolz@qoto.org
@volz_le · X

RT @hertzpodcast: Settle an argument. Dan thinks no one has published a paper or preprint systematically assessing whether co-authors on…

Sep 5, 2020 · 4 shares · 286 followers View post →
Martin Johnsson
@mrtnj · X

RT @hertzpodcast: Settle an argument. Dan thinks no one has published a paper or preprint systematically assessing whether co-authors on…

Sep 5, 2020 · 4 shares · 2,112 followers View post →
Everything Hertz
@hertzpodcast · X

Settle an argument. Dan thinks no one has published a paper or preprint systematically assessing whether co-authors on the “Redefine Statistical Significance” paper all now use a .005 threshold in their hypothesis-driven research. James thinks someone has. Who’s right?

Sep 5, 2020 · 12 likes · 4 shares · 7,013 followers View post →
Jamie Cummins
@jamiecummins.bsky.social · Bluesky

How many of the redefine statistical significance authors have been using .005 as their alpha level lately?

Aug 11, 2020 View post →
Paul Connor
@paulrconnor · X

@chrisaberson @moreofcomment @lakens I guess I also think if we are going to teach the field to reject p = 0.04 when power is assumed to be low, and that doing so will be the correct decision in 95% of cases, we may as well just redefine statistical significance to be 0.005 and take the subjectivity out of it.

Aug 10, 2020 · 1,381 followers View post →
Nianbo Dong
@NianboDong · X

(11/14) a group of outstanding statisticians called for “Redefine statistical significance” (Benjamin et al., 2017; https://t.co/qyH4Ijxhro ) by changing the default P-value threshold for statistical significance from 0.05 to 0.005.

Jul 29, 2020 · 239 followers View post →
MRG/MikAnton
@Geofex · X

RT @BrianNosek: New Nature Human Behavior paper: 72 of us make the case to redefine statistical significance from .05 to .005. https://t.co…

Apr 12, 2020 · 328 shares · 890 followers View post →
Fred Hasselman
@FredHasselman · X

RT @lakens: Edouard Machery, one of the Redefine Statistical Significance authors: I think in principle Lakens and colleagues might be righ…

Apr 5, 2020 · 2 shares · 792 followers View post →
#EnContra Pablo
@pablotapian · X

RT @lakens: Edouard Machery, one of the Redefine Statistical Significance authors: I think in principle Lakens and colleagues might be righ…

Apr 5, 2020 · 2 shares · 1,033 followers View post →
David Jeong
@davidjeong · X

RT @BrianNosek: New Nature Human Behavior paper: 72 of us make the case to redefine statistical significance from .05 to .005. https://t.co…

Apr 5, 2020 · 328 shares · 692 followers View post →
Indrajeet Patil (इंद्रजीत पाटील)
@patilindrajeets · X

RT @BrianNosek: New Nature Human Behavior paper: 72 of us make the case to redefine statistical significance from .05 to .005. https://t.co…

Apr 5, 2020 · 328 shares · 6,779 followers View post →
Daniël Lakens
@lakens · X

Edouard Machery, one of the Redefine Statistical Significance authors: I think in principle Lakens and colleagues might be right that in an idealized scientific context we would want to set up the significance level by looking at the costs of false positive and false negatives." https://t.co/RUAc2xSobk

Apr 5, 2020 · 13 likes · 2 shares · 30,617 followers View post →
Gustav H
@GustavH248 · X

@NeumanN_PJ From a superficial statistical point of view I would guess that a priori there was around 20 % chance of a false positive result in this study (- compare to Fig 2, Redefine statistical significance, Nature, 2017).

Oct 10, 2019 · 200 followers View post →
Gustav H
@GustavH248 · X

@RobinFondberg @matejka_goran (Det delvis illustrerat ang risk för falskt positiva vid positiva resultat, före undersökning, i Redefine statistical significance, Nature, 2017, Fig 2.) - Vet ej vad du säger om de sakerna?

Oct 9, 2019 · 200 followers View post →
Marko Paşa
@markopaassa · X

RT @DrBradleyBoivin: 1/4 “Science is a systematized body of (probable) knowledge, not an accumulation of decisions. The end product of a sc…

Aug 14, 2019 · 1 share · 154 followers View post →
Aaron Liew MB BCh, MPH, PhD
@AARONLYL · X

PsyArXiv Preprints | Redefine statistical significance https://t.co/mRC08RPTJR

Aug 14, 2019 · 100 followers View post →
Bradley Boivin
@DrBradleyBoivin · X

1/4 “Science is a systematized body of (probable) knowledge, not an accumulation of decisions. The end product of a scientific investigation is a degree of confidence in some set of propositions, which then constitutes a basis for decisions.”https://t.co/VIU8wbkCct

Aug 13, 2019 · 1 share · 1,642 followers View post →
UVA Science Pubs
@UvaScience_Pubs · X

Redefine statistical significance. https://t.co/qbxsjXWpIp

Jul 31, 2019 · 1 like · 259 followers View post →
Wilte Zijlstra
@wilte · X

On p<0.005; Benjamin et al 2018 Redefine statistical significance https://t.co/e2NP95Kuht https://t.co/b5dfYyVl7N

Jun 13, 2019 · 1,970 followers View post →
Michael Aye (I'm on BlueSky)
@michaelaye · X

RT @paperpile: Many psychological studies don't hold up to scrutiny. Is it time to redefine statistical significance? https://t.co/noOFeS6Z…

Apr 26, 2019 · 2 shares · 859 followers View post →
Dr Khalid
@rauf_khalid · X

RT @paperpile: Many psychological studies don't hold up to scrutiny. Is it time to redefine statistical significance? https://t.co/noOFeS6Z…

Apr 26, 2019 · 2 shares · 2,490 followers View post →
Paperpile
@paperpile · X

Many psychological studies don't hold up to scrutiny. Is it time to redefine statistical significance? https://t.co/noOFeS6ZH0

Apr 26, 2019 · 1 like · 2 shares · 17,210 followers View post →
Sam Parsons
@Sam_D_Parsons · X

@westwoodsam1 Redefine statistical significance (Runs and hides)

Feb 9, 2019 · 2 likes · 2,154 followers View post →
Mike
@michaelscally · X

RT @phylogenomics: @ucdavis @ralphhexter At @ucdavis Ioannidis discussing this "Redefine statistical significance" https://t.co/3yBVnBPDoQ…

Jan 29, 2019 · 2 shares · 894 followers View post →
Simon Roux
@simroux_virus · X

RT @phylogenomics: @ucdavis @ralphhexter At @ucdavis Ioannidis discussing this "Redefine statistical significance" https://t.co/3yBVnBPDoQ…

Jan 29, 2019 · 2 shares · 3,772 followers View post →
Jonathan Eisen
@phylogenomics · X

@ucdavis @ralphhexter At @ucdavis Ioannidis discussing this "Redefine statistical significance" https://t.co/3yBVnBPDoQ as a temporary but not ideal solution

Jan 29, 2019 · 1 like · 2 shares · 62,768 followers View post →
Bhavneesh Sharma MBBS, MD, MBA (Finance)
@bs2537 · X

$AMRN: Amarin (short the stock): Why borderline 0.03 p value for cardiovascular death in REDUCE-IT trial may not be practical in the real world. https://t.co/qVV84KKOLx

Jan 25, 2019 · 7,881 followers View post →
Aaron Caldwell
@ExPhysStudent · X

@TenanATC @Dr_DeFreitas @XphysNerd @richarddmorey also points out some issues with the redefine statistical significance (.05 --> .005) argument in a few blogposts https://t.co/rGIwJjlv2u

Jan 3, 2019 · 3 likes · 1,595 followers View post →
Brian Nosek
@briannosek.bsky.social · Bluesky

"Should We Redefine Statistical Significance? A Brains Blog Roundtable" http://philosophyofbrains.com/2017/10/02/should-we-redefine-statistical-significance-a-brains-blog-roundtable.aspx

Oct 2, 2017 View post →
Brian Nosek
@briannosek.bsky.social · Bluesky

"Remove, rather than redefine, statistical significance" a commentary in Nature Human Behavior on our .005 proposal http://rdcu.be/wbtc

Sep 27, 2017 View post →
Chuma Owuamalam
@chuma73.bsky.social · Bluesky

Justify your alpha: a response to "Redefine statistical significance"via @academia academia.edu/34599942/Justi…

Sep 20, 2017 View post →
Chuma Owuamalam
@chuma73.bsky.social · Bluesky

Justify your alpha: a response to "Redefine statistical significance"via @academia academia.edu/34599942/Justi…

Sep 20, 2017 View post →
Brian Nosek
@briannosek.bsky.social · Bluesky

In his inaugural blog post, @EJWagenmakers counters objections to redefining significance from .05 to .005: https://www.bayesianspectacles.org/redefine-statistical-significance-part-i-sleep-trolls-red-herrings/#more-572

Aug 6, 2017 View post →
James Steele
@jamessteeleii.bsky.social · Bluesky

Redefine statistical significance?

Jul 30, 2017 View post →
Brian Nosek
@briannosek.bsky.social · Bluesky

Redefine Statistical Significance: An Interview with Jim Berger https://jasp-stats.org/2017/07/27/jimberger/

Jul 27, 2017 View post →
Brian Nosek
@briannosek.bsky.social · Bluesky

New Nature Human Behavior paper: 72 of us make the case to redefine statistical significance from .05 to .005. http://osf.io/mky9j

Jul 22, 2017 View post →