PubHawk
Semin Hematol July 2008 PMID 18582619

A dirty dozen: twelve p-value misconceptions.

Steven Goodman

Full text PDF Download social card

Mentions

58
Peak: 8 in May 2019
across 5 sources since Jun 2015

Extended reach

128,723
potential audience

Total likes

89

Video views

381

Mentions per month

Jun 2015 – Dec 2024

Where it's discussed

  • X / Twitter43 posts
  • Blogs8 articles
  • News3 articles
  • YouTube2 videos
  • Facebook2 posts

AI synopsis

What people are saying

Discussions highlight the importance of clarifying what p-values are not, with posts emphasizing the confusion between significance and evidence. Words like 'useful,' 'clarify,' and references to the paper's explanations underscore a shared recognition of its value. Some examples include comments on how the article helps understand that p-values do not directly indicate the probability of correctness, and how the paper serves as a primer for interpreting statistical results properly, reflecting both curiosity and recognition of its practical implications.

AgreementModerate agreement

Most discussions support the idea that the publication effectively clarifies common misunderstandings about p-values, with many affirming its usefulness for proper interpretation.

InterestHigh interest

The group shows high interest in the topic, with multiple mentions of reading, sharing, and appreciating the paper, indicating engagement with statistical misconceptions.

EngagementModerate engagement

Posts reference specific sections, summaries, and implications of the article, demonstrating at least some deep engagement with the material.

ImpactModerate impact

Participants acknowledge that understanding these misconceptions can significantly influence statistical reasoning and research practices, suggesting a moderate to high perceived impact.

Abstract in brief

  • The text discusses common misunderstandings about P values in medical research, emphasizing that they are often misinterpreted as a direct measure of evidence or probability of error, which is incorrect.
  • It highlights that P values are not part of a formal system of statistical inference and that misinterpreting them can lead to faulty conclusions and overconfidence in experimental results.
  • The article also contrasts P values with Bayes factors, which are considered more reliable for judging evidence because they incorporate prior information and are easier to interpret.
Read the full abstract

Top posts

Most liked on X and Bluesky
Magnus Johnson
@Nephropseu · X

Just finished my last teaching session of the year, "The twelve days of p-value-mas" (thanks to Goodman 2008; https://t.co/V0AKoKeLdv) https://t.co/CBW2Z8dCKn

Dec 17, 2020 · 18 likes · 2,465 followers View post →
Revisión Por Pares
@revisionxpares · X

Un valor de p menor de 0.05 no refleja que algo sea clínicamente significativo, siempre tiene que verse en su contexto y su pregunta de investigación Recomendamos el artículo A Dirty Dozen: Twelve P-Value Misconceptions una breve revisión de estos problemas https://t.co/LkCryy3q3T

Sep 11, 2020 · 12 likes · 3 shares · 95 followers View post →
Estadística básica
@EstadisticaBase · X

No, el p-valor no es eso. A dirty dozen: twelve p-value misconceptions: https://t.co/a7hlmrmeHl

May 16, 2019 · 11 likes · 7 shares · 1,866 followers View post →
Abraham E. Gracia R.
@Abraham_RMI · X

@trumanfrancis @vamrhein @Lester_Domes @lakens @learnfromerror @f2harrell @stephensenn @goodmanmetrics @statsepi Thank you for sharing it. I didn't know about this paper. I will read it. IMO, the best explanation about “what is” and “what isn't” the P-value are on these articles: 1. https://t.co/DbMoDJlieN 2. https://t.co/vpt61tDaZT 3. https://t.co/cTCmtGOebz

Aug 19, 2021 · 10 likes · 2 shares · 4,678 followers View post →
Tucker Goodrich
@TuckerGoodrich · X

Great paper on the nonsense that is the p-value. "The effect best supported by the data from a given experiment is always the observed effect, regardless of its significance." https://t.co/uBn76tXHqS

Jun 18, 2021 · 9 likes · 28,299 followers View post →
みのゆ
@minoyu · X

@sammy_suyama "The most important foundational issue to appreciate is that there is no number generated by standard methods that tells us the probability that a given conclusion is right or wrong." (Goodman, 2008, https://t.co/dltzqfhTq0) とちゃんと明記されている文献もありました。

Jan 24, 2020 · 5 likes · 1 share · 500 followers View post →

All mentions

JM Moran
@jmmorang · X

Fuentes:

Dec 20, 2024 · 5,155 followers View post →
Raphael Merz
@RaphaelMerz · X

@peder_isager This is probably for after they have some understanding of the topic, but I found it really useful to read about all these misinterpretations! Shows you what p-values are NOT! https://t.co/DxAzZr4BS0.

Apr 5, 2024 · 4 likes · 165 followers View post →
The Biostatistician
@bio_info_stat · X

@goodmanmetrics has explain in details in his paper a A Dirty Dozen: Twelve P-Value Misconceptions published in 2011. Link: https://t.co/BeiESai5YV.

Feb 7, 2024 · 2 likes · 13 followers View post →
Elmir Omerovic
@elmir1omerovic · X

@drjohnm I bet that most MDs (and others) might struggle with understanding and accurately defining p-values and confidence intervals — myself included.

Jan 27, 2024 · 425 followers View post →
Elmir Omerovic
@elmir1omerovic · X

2/2 I am not sure how many of us would properly define "simple" things such as p-value and 95% confidence intervals. Probably not many. 10.1053/j.seminhematol.2008.04.003 What do you mean by "made-up data"?

May 25, 2023 · 425 followers View post →
Sami B.
@Kangerine · X

@TomBoylesID @MythoFobe @ChronicUTIAus @xxChronicutixx @KeatingRachelle @StephenTristram I agree – I have read it and a few others: https://t.co/eKEnykzTap https://t.co/J6K0on3T4i https://t.co/nJSJCyIcLH https://t.co/sYp700KkX0 https://t.co/KgH5rM7Yb8

Apr 27, 2023 · 128 followers View post →
Mahesh Shakya
@mahesh_shakya_ · X

@Mukum3 @mrophiophagus https://t.co/dW1lGmvZ83 https://t.co/NDSKxwoLE2

Apr 14, 2023 · 117 followers View post →
Randy Ellis
@randalljellis · X

@MariannaRosso1 Here’s 12 wrong answers :) https://t.co/7Jwu1TSQEk

Feb 22, 2023 · 2 likes · 1,087 followers View post →
Michael Makovi
@mikewinddale · X

@ATabarrok @ariarmstrong Goodman, Steven. "A dirty dozen: twelve p-value misconceptions." Seminars in hematology. Vol. 45. No. 3. WB Saunders, 2008.

Feb 2, 2023 · 3 likes · 985 followers View post →
Meisendoc
@Meisendoc · X

Weil Twitter den Link in der Ansicht abschneidet, hier der Titel des Papers: "A Dirty Dozen: Twelve P-Value Misconceptions" von Steven Goodman, Seminars in Hematology

Dec 9, 2022 · 263 followers View post →
I S O M A Q U I E T
@Benoit_Beyeler · X

RT @unbiasedscipod: Sources: https://t.co/HOYZKNrDTc Daniel WW, Cross CL. Biostatistics: A Foundation for Analysis in the Health Sciences,…

Sep 20, 2022 · 2 shares · 115 followers View post →
Hocine Remini, Ph.D "ⵃoⵛⵉⵏⴻ ⵕⴻⵎⵉⵏⵉ"
@HocineRemini · X

RT @unbiasedscipod: Sources: https://t.co/HOYZKNrDTc Daniel WW, Cross CL. Biostatistics: A Foundation for Analysis in the Health Sciences,…

Sep 19, 2022 · 2 shares · 650 followers View post →
The Unbiased Science Podcast
@unbiasedscipod · X

Sources: https://t.co/HOYZKNrDTc Daniel WW, Cross CL. Biostatistics: A Foundation for Analysis in the Health Sciences, Tenth Edition. https://t.co/Ktr0yrM1c1 https://t.co/lfKaE7dkMz https://t.co/MBpovRakpr https://t.co/7SmZoatger https://t.co/2FKgE4Wqdb 11/11

Sep 19, 2022 · 1 like · 2 shares · 10,206 followers View post →
knut
@kmelve · X

The paper “A Dirty Dozen: Twelve P-Value Misconceptions” is a good primer for interpreting the p-value. https://t.co/t1CuYhIB7o https://t.co/jQrr5g4NSh

Sep 8, 2022 · 3,601 followers View post →
黒木玄 Gen Kuroki
@genkuroki · X

RT @genkuroki: #統計 Steven Goodman A Dirty Dozen: Twelve P-Value Misconceptions 2008 https://t.co/0Omrjo1k3P これは読む価値のある論文です。しかし、帰無仮説が仮定される…

Jun 26, 2022 · 2 shares · 15,559 followers View post →
黒木玄 Gen Kuroki
@genkuroki · X

#統計 Steven Goodman A Dirty Dozen: Twelve P-Value Misconceptions 2008 https://t.co/0Omrjo1k3P これは読む価値のある論文です。しかし、帰無仮説が仮定されるのは現実についてではなく、統計モデルであるという点を避ける基本概念の定義を前提にしており、ASA声明的にはまずいと思います。

Jun 23, 2022 · 3 likes · 2 shares · 15,559 followers View post →
Johan de Aguas
@JohanDH2O · X

RT @Abraham_RMI: @trumanfrancis @vamrhein @Lester_Domes @lakens @learnfromerror @f2harrell @stephensenn @goodmanmetrics @statsepi Thank you…

Aug 30, 2021 · 2 shares · 706 followers View post →
Abraham E. Gracia R.
@Abraham_RMI · X

@trumanfrancis @vamrhein @Lester_Domes @lakens @learnfromerror @f2harrell @stephensenn @goodmanmetrics @statsepi Thank you for sharing it. I didn't know about this paper. I will read it. IMO, the best explanation about “what is” and “what isn't” the P-value are on these articles: 1. https://t.co/DbMoDJlieN 2. https://t.co/vpt61tDaZT 3. https://t.co/cTCmtGOebz

Aug 19, 2021 · 10 likes · 2 shares · 4,678 followers View post →
Tucker Goodrich
@TuckerGoodrich · X

Great paper on the nonsense that is the p-value. "The effect best supported by the data from a given experiment is always the observed effect, regardless of its significance." https://t.co/uBn76tXHqS

Jun 18, 2021 · 9 likes · 28,299 followers View post →
Magnus Johnson
@Nephropseu · X

Just finished my last teaching session of the year, "The twelve days of p-value-mas" (thanks to Goodman 2008; https://t.co/V0AKoKeLdv) https://t.co/CBW2Z8dCKn

Dec 17, 2020 · 18 likes · 2,465 followers View post →
Doc Terán
@rteran_md · X

RT @revisionxpares: Un valor de p menor de 0.05 no refleja que algo sea clínicamente significativo, siempre tiene que verse en su contexto…

Sep 11, 2020 · 3 shares · 235 followers View post →
Better Call Verdines
@adrian_verdix · X

RT @revisionxpares: Un valor de p menor de 0.05 no refleja que algo sea clínicamente significativo, siempre tiene que verse en su contexto…

Sep 11, 2020 · 3 shares · 780 followers View post →
Revisión Por Pares
@revisionxpares · X

Un valor de p menor de 0.05 no refleja que algo sea clínicamente significativo, siempre tiene que verse en su contexto y su pregunta de investigación Recomendamos el artículo A Dirty Dozen: Twelve P-Value Misconceptions una breve revisión de estos problemas https://t.co/LkCryy3q3T

Sep 11, 2020 · 12 likes · 3 shares · 95 followers View post →
Kelly A. Hogan Ph.D.
@Loose_Lab_Rat · X

A Dirty Dozen: Twelve P-Value Misconceptions https://t.co/pRTMMuNK90

Sep 9, 2020 · 2,238 followers View post →
Yuri Vieira Sugano
@yvsugano1 · X

There is simultaneously too much love and too much hate for p-values. I attempt neutrality, as they are unlikely to be replaced any time soon. I can pledge not to use "statistically significant" though (good reads: https://t.co/piguKK2FlZ; @lakens's https://t.co/wTfeDI8wFm) https://t.co/60cqnXlG6o

Sep 9, 2020 · 2 likes · 216 followers View post →
すずどら
@sz_dr · X

"A dirty dozen: twelve p-value misconceptions."読んでる P値にまつわる12個の誤解が紹介されているが、自分も正しくP値を理解できていない現実を突きつけられる、、、 https://t.co/b1GulEDfn5

May 17, 2020 · 2 likes · 1,787 followers View post →
Héctor Carmona Salido
@hectorcarmsal · X

RT @EstadisticaBase: No, el p-valor no es eso. A dirty dozen: twelve p-value misconceptions: https://t.co/a7hlmrmeHl

Feb 6, 2020 · 7 shares · 83 followers View post →
黒木玄 Gen Kuroki
@genkuroki · X

RT @minoyu: @sammy_suyama "The most important foundational issue to appreciate is that there is no number generated by standard methods tha…

Jan 25, 2020 · 1 share · 15,559 followers View post →
みのゆ
@minoyu · X

@sammy_suyama "The most important foundational issue to appreciate is that there is no number generated by standard methods that tells us the probability that a given conclusion is right or wrong." (Goodman, 2008, https://t.co/dltzqfhTq0) とちゃんと明記されている文献もありました。

Jan 24, 2020 · 5 likes · 1 share · 500 followers View post →
fredP.
@sociographie · X

RT @gaalcaras: @scoavoux Il est parfois plus simple de mieux comprendre la p-value en étudiant ce qu'elle n'est pas, voir A Dirty Dozen: tw…

Oct 31, 2019 · 1 share · 2,274 followers View post →
Satrajit Ghosh
@satra_ · X

@naked_statist @talyarkoni and as for the summary of fisher, it comes from doi:10.1053/j.seminhematol.2008.04.003

Sep 6, 2019 · 1 like · 986 followers View post →
内田
@uchida_kawasaki · X

RT @AsadoriQ: A dirty dozen: Twelve p-value misconceptions https://t.co/k57Lulcbpo

Aug 12, 2019 · 1,921 followers View post →
asadori_Qly
@AsadoriQ · X

A dirty dozen: Twelve p-value misconceptions https://t.co/k57Lulcbpo

Aug 12, 2019 · 2 likes · 3,289 followers View post →
Da Costa Julien
@dacostju · X

A Dirty Dozen: Twelve P-Value Misconceptions.

Jul 10, 2019 · 102 followers View post →
Pamela Villalba
@AsetPame · X

RT @EstadisticaBase: No, el p-valor no es eso. A dirty dozen: twelve p-value misconceptions: https://t.co/a7hlmrmeHl

May 30, 2019 · 7 shares · 115 followers View post →
Facundo Muñoz famuvie@oc.todon.fr
@famuvie · X

RT @EstadisticaBase: No, el p-valor no es eso. A dirty dozen: twelve p-value misconceptions: https://t.co/a7hlmrmeHl

May 17, 2019 · 7 shares · 193 followers View post →
José, Vicente
@jvicentem93 · X

RT @EstadisticaBase: No, el p-valor no es eso. A dirty dozen: twelve p-value misconceptions: https://t.co/a7hlmrmeHl

May 16, 2019 · 7 shares · 210 followers View post →
Nuria Rico
@NuriaStatgirl · X

RT @EstadisticaBase: No, el p-valor no es eso. A dirty dozen: twelve p-value misconceptions: https://t.co/a7hlmrmeHl

May 16, 2019 · 7 shares · 1,222 followers View post →
ETSI Informática UNED
@ETSIIUNED · X

RT @EstadisticaBase: No, el p-valor no es eso. A dirty dozen: twelve p-value misconceptions: https://t.co/a7hlmrmeHl

May 16, 2019 · 7 shares · 1,855 followers View post →
emilio.leton
@emilioleton · X

RT @EstadisticaBase: No, el p-valor no es eso. A dirty dozen: twelve p-value misconceptions: https://t.co/a7hlmrmeHl

May 16, 2019 · 7 shares · 1,375 followers View post →
Óscar Fdez Ballbé
@Oscar_Cnst · X

RT @EstadisticaBase: No, el p-valor no es eso. A dirty dozen: twelve p-value misconceptions: https://t.co/a7hlmrmeHl

May 16, 2019 · 7 shares · 361 followers View post →
Estadística básica
@EstadisticaBase · X

No, el p-valor no es eso. A dirty dozen: twelve p-value misconceptions: https://t.co/a7hlmrmeHl

May 16, 2019 · 11 likes · 7 shares · 1,866 followers View post →
Gabriel Alcaras
@gaalcaras · X

@scoavoux Il est parfois plus simple de mieux comprendre la p-value en étudiant ce qu'elle n'est pas, voir A Dirty Dozen: twelve p-value misconceptions (2008) : https://t.co/5Lc7sMjgjR

Apr 1, 2019 · 1 share · 300 followers View post →