Cogn Sci July 2023 PMID 37401923

Do Large Language Models Know What Humans Know?

Sean Trott, Cameron Jones, Tyler Chang, James Michaelov, Benjamin Bergen

Mentions

71
Peak: 31 in Jul 2023
across 5 sources since Jul 2023

Extended reach

265,456
potential audience

Total likes

2,567

Video views

137,291

Mentions per month

Jul 2023 – May 2025

Where it's discussed

  • X / Twitter49 posts
  • News18 articles
  • YouTube2 videos
  • Bluesky1 posts
  • Facebook1 posts

AI synopsis

What people are saying

The posts collectively reflect interest and support for the research, with examples like references to the False Belief Task and phrases such as 'comparing human and GPT-3 performance' suggest deep engagement. Overall, the tone and content emphasize curiosity and acknowledgment of the study's importance in advancing understanding of AI and human cognition.

AgreementModerate agreement

Most discussions show support for the idea that large language models like GPT-3 can differentiate mental states, although some acknowledge limitations.

InterestModerate interest

Posts express curiosity and enthusiasm about the research, especially highlighted by comments on the significance of the findings.

EngagementModerate engagement

Participants reference specific experiments like the False Belief Task and discuss the implications, demonstrating active engagement.

ImpactModerate impact

The discussions emphasize the potential influence of this research on AI understanding and cognitive science, indicating moderate impact.

Abstract in brief

  • The study explores whether large language models like GPT-3 understand human beliefs by testing them with a linguistic version of the False Belief Task, comparing their responses to those of humans.
  • Results show that GPT-3 can differentiate between different mental states and perform above chance, but humans still outperform the model, indicating that language exposure alone isn't enough to fully explain humans' ability to understand others' beliefs.
  • This suggests that humans likely develop their understanding of mental states through multiple mechanisms, not just exposure to language, highlighting the role of innate or other experiential factors beyond statistical learning from language data.]

Top posts

Most liked on X and Bluesky
Cameron Jones
@camrobjones · X

Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cognitive Science https://t.co/L0PowtiMBS @cogsci_soc @Sean_Trott @jamichaelov @tylerachang

Jul 4, 2023 · 101 likes · 21 shares · 1,419 followers View post →
Tilbe Göksun
@GoksunTilbe · X

Does GPT-3 have a theory of mind? Check out the blog published in CogSci Blogs based on this paper: https://t.co/79HXlCKVSl https://t.co/kWeXlzLEpY

Oct 3, 2023 · 33 likes · 8 shares · 2,718 followers View post →
Akira Murakami
@mrkm_a · X

"while statistical learning from language exposure may in part explain how humans develop the ability to reason about the mental states of others, other mechanisms are also responsible." Trott et al. (2023). Do Large Language Models Know What Humans Know? https://t.co/5h8FNTRImk

Jul 5, 2023 · 8 likes · 3 shares · 2,707 followers View post →
Philosophy of Futures Studies
@philofutures · X

"Do Large Language Models Know What Humans Know?" | @Sean_Trott, @camrobjones, Tyler Chang, @jamichaelov, Benjamin Bergen | #AI #Philosophy #FuturesStudies #ArtificialIntelligence #Cognition (1/n) https://t.co/tT2PgqzY4s https://t.co/CpPFYgm7bJ

Jul 10, 2023 · 2 likes · 11,250 followers View post →
Uğurcan Vurgun, PhD, MA
@ugurcan_vurgun · X

Do Large Language Models Know What Humans Know? by Sean Trott, Cameron Jones, Tyler Chang, James Michaelov, Benjamin Bergen https://t.co/NAOBmDIYWe

Jul 24, 2023 · 2 likes · 475 followers View post →
Sean Trott
@Sean_Trott · X

@ericzelikman @noahdgoodman @mcxfrank One more ToM paper in case you're interested: https://t.co/vRrFblYtNg

Dec 27, 2023 · 2 likes · 348 followers View post →

All mentions

Gulenber
@Gulenber5 · X

RT @mustafaergen_: Reading List for the Interested: https://t.co/o572chfhuD https://t.co/D58GFGCJOm https://t.co/f57yvMAHTG https://t.co/o…

Feb 9, 2025 · 1 share · 60 followers View post →
Mustafa Ergen
@mustafaergen_ · X

Reading List for the Interested: https://t.co/o572chfhuD https://t.co/D58GFGCJOm https://t.co/f57yvMAHTG https://t.co/oytipstWr3 https://t.co/maH2nNdkRT https://t.co/iUkRMpOYdb https://t.co/xOPpGQ5yhl https://t.co/0EZBtfBCLk https://t.co/SUHWDy3K9m https://t.co/aPbcxjgiBw

Feb 6, 2025 · 1 like · 1 share · 11,698 followers View post →
liwei
@sakura_liwei · X

【人工智能】万字通俗讲解大语言模型内部运行原理 | LLM | 词向量 | Transformer | 注意力机制 | 前馈网络 | 反向传播 ... https://t.co/wHCuI8rTOl via @YouTube

Jun 5, 2024 · 81 followers View post →
H|ψ⟩ Quantum Finance
@haiyunsky · X

【人工智能】万字通俗讲解大语言模型内部运行原理 | LLM | 词向量 | Transformer | 注意力机制 | 前馈网络 | 反向传播 ... https://t.co/RbI0hHJaW8 via @YouTube

Mar 7, 2024 · 940 followers View post →
Yunus Şahin
@herrbokologist · X

RT @GoksunTilbe: Does GPT-3 have a theory of mind? Check out the blog published in CogSci Blogs based on this paper: https://t.co/79HXlCK…

Feb 27, 2024 · 8 shares · 4,639 followers View post →
Nazli Altin, PhD
@NzlAltin · X

RT @GoksunTilbe: Does GPT-3 have a theory of mind? Check out the blog published in CogSci Blogs based on this paper: https://t.co/79HXlCK…

Feb 27, 2024 · 8 shares · 426 followers View post →
Ferah Şenaydın
@Ferahsenaydin · X

RT @GoksunTilbe: Does GPT-3 have a theory of mind? Check out the blog published in CogSci Blogs based on this paper: https://t.co/79HXlCK…

Feb 27, 2024 · 8 shares · 94 followers View post →
Eren Günseli
@eren_gunseli · X

RT @GoksunTilbe: Does GPT-3 have a theory of mind? Check out the blog published in CogSci Blogs based on this paper: https://t.co/79HXlCK…

Feb 27, 2024 · 8 shares · 2,590 followers View post →
Jian Wang
@jwang3417 · X

【人工智能】万字通俗讲解大语言模型内部运行原理 | LLM | 词向量 | Transformer | 注意力机制 | 前馈网络 | 反向传播 ... https://t.co/P4oX8T1HsI via @YouTube

Jan 11, 2024 · 41 followers View post →
Sean Trott
@Sean_Trott · X

@ericzelikman @noahdgoodman @mcxfrank One more ToM paper in case you're interested: https://t.co/vRrFblYtNg

Dec 27, 2023 · 2 likes · 348 followers View post →
Tech Robot
@_tech_robot_ · X

-Do Large Language Models Know What Humans Know? | #AIMadeSimple #AI https://t.co/8HJBY1liNh

Nov 26, 2023 · 3,600 followers View post →
Alp Aytuglu
@alp_aytuglu · X

RT @GoksunTilbe: Does GPT-3 have a theory of mind? Check out the blog published in CogSci Blogs based on this paper: https://t.co/79HXlCK…

Oct 5, 2023 · 8 shares · 6 followers View post →
Abdullah Topraksoy
@abd_topraksoy · X

RT @GoksunTilbe: Does GPT-3 have a theory of mind? Check out the blog published in CogSci Blogs based on this paper: https://t.co/79HXlCK…

Oct 4, 2023 · 8 shares · 103 followers View post →
Dr Astrid Zeman
@astrid_zeman · X

RT @GoksunTilbe: Does GPT-3 have a theory of mind? Check out the blog published in CogSci Blogs based on this paper: https://t.co/79HXlCK…

Oct 3, 2023 · 8 shares · 563 followers View post →
CogSci Society
@cogsci_soc · X

RT @GoksunTilbe: Does GPT-3 have a theory of mind? Check out the blog published in CogSci Blogs based on this paper: https://t.co/79HXlCK…

Oct 3, 2023 · 8 shares · 14,560 followers View post →
Tilbe Göksun
@GoksunTilbe · X

Does GPT-3 have a theory of mind? Check out the blog published in CogSci Blogs based on this paper: https://t.co/79HXlCKVSl https://t.co/kWeXlzLEpY

Oct 3, 2023 · 33 likes · 8 shares · 2,718 followers View post →
Kindergarten Head
@Amormaid · X

LLM https://t.co/L7xJs6VMAq

Sep 14, 2023 · 132 followers View post →
Daryl Costello
@DarylC71 · X

Do Large Language Models Know What Humans Know? - Trott - 2023 - Cognitive Science - Wiley Online Library https://t.co/LwTqQJIv0y

Aug 18, 2023 · 166 followers View post →
alexandroslee創造價值夥伴VCP李東昇
@alexandroslee · X

【人工智能】萬字通俗講解大語言模型內部運行原理 | LLM | 詞向量 | Transformer | 注意力機制 | 前饋網絡 | 反向傳播 | 心智理論 語言大模型內部究竟是如何工作的?本文用最少的數學知識和術語進行解釋。 https://t.co/7G3xa8Twfp

Aug 13, 2023 · 1,169 followers View post →
Cameron Jones
@camrobjones · X

@Starcourse @binarybits @JohnRentoul @tylercowen Agree, and we make a similar point here (https://t.co/L0PowtiMBS) and here (https://t.co/Euc3FaFLPP). Other great work testing the robustness of LLM ToM!https://t.co/ojzH0Wpi6j @NatalieShapira @MaartenSap ; https://t.co/UmlHiRapT7 @gandhikanishk @jphilippfranken @tobigerstenberg

Jul 30, 2023 · 1,419 followers View post →
Uğurcan Vurgun, PhD, MA
@ugurcan_vurgun · X

Do Large Language Models Know What Humans Know? by Sean Trott, Cameron Jones, Tyler Chang, James Michaelov, Benjamin Bergen https://t.co/NAOBmDIYWe

Jul 24, 2023 · 2 likes · 475 followers View post →
Sean Trott
@Sean_Trott · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 15, 2023 · 21 shares · 348 followers View post →
Philosophy of Futures Studies
@philofutures · X

"Do Large Language Models Know What Humans Know?" | @Sean_Trott, @camrobjones, Tyler Chang, @jamichaelov, Benjamin Bergen | #AI #Philosophy #FuturesStudies #ArtificialIntelligence #Cognition (1/n) https://t.co/tT2PgqzY4s https://t.co/CpPFYgm7bJ

Jul 10, 2023 · 2 likes · 11,250 followers View post →
Chris ☕
@mixingchris.bsky.social · Bluesky

Do large language models know that humans know? https://onlinelibrary.wiley.com/doi/epdf/10.1111/cogs.13309

Jul 10, 2023 View post →
Chris
@MixingChris · X

Do large language models know that humans know? https://t.co/Xn6uShnnFI

Jul 10, 2023 · 572 followers View post →
SHIRÅSUNA, Ⅿ.
@mitoop_quiz · X

【ちょっと関連?】 偶然にもつい先日、こんな論文も出ていました https://t.co/dsk4vKbB72 (こちらについても、活動報告で少し触れています)

Jul 7, 2023 · 384 followers View post →
Petra B. Schumacher
@pb_schumacher · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 6, 2023 · 21 shares · 548 followers View post →
Ryo Maie
@MaieRyo · X

RT @mrkm_a: "while statistical learning from language exposure may in part explain how humans develop the ability to reason about the menta…

Jul 6, 2023 · 3 shares · 800 followers View post →
Adam Safron
@adamsafron · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 5, 2023 · 21 shares · 2,349 followers View post →
nasakti
@Homodigitalist · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 5, 2023 · 21 shares · 149 followers View post →
Jesus Ramirez-Bermudez
@JRBneuropsiq · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 5, 2023 · 21 shares · 31,434 followers View post →
sisyfos
@zKsisyfos · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 5, 2023 · 21 shares · 2,066 followers View post →
Shun
@Spectrum_cj · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 5, 2023 · 21 shares · 379 followers View post →
Mr. Flood
@hongyifan20 · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 5, 2023 · 21 shares · 12 followers View post →
cecilia böcking
@cecilia_bocking · X

RT @mrkm_a: "while statistical learning from language exposure may in part explain how humans develop the ability to reason about the menta…

Jul 5, 2023 · 3 shares · 941 followers View post →
Dr Shiyu He
@ShiyuHe1 · X

RT @mrkm_a: "while statistical learning from language exposure may in part explain how humans develop the ability to reason about the menta…

Jul 5, 2023 · 3 shares · 559 followers View post →
Akira Murakami
@mrkm_a · X

"while statistical learning from language exposure may in part explain how humans develop the ability to reason about the mental states of others, other mechanisms are also responsible." Trott et al. (2023). Do Large Language Models Know What Humans Know? https://t.co/5h8FNTRImk

Jul 5, 2023 · 8 likes · 3 shares · 2,707 followers View post →
Diverse Intelligences Summer Institute #DISI
@DivIntelligence · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 5, 2023 · 21 shares · 1,842 followers View post →
Pelin Soydan
@pelinatte · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 5, 2023 · 21 shares · 486 followers View post →
Ana Chkhaidze
@chkhaidze_ · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 5, 2023 · 21 shares · 161 followers View post →
Eric Leonardis @ NeurIPS 2025
@EricLeonardis · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 5, 2023 · 21 shares · 4,114 followers View post →
ɐɯıɾɐW ıɥso⅄
@yoshi_mjm · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 4, 2023 · 21 shares · 209 followers View post →
Daniel Horschler
@DanielHorschler · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 4, 2023 · 21 shares · 1,013 followers View post →
James Michaelov @ NeurIPS2025
@jamichaelov · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 4, 2023 · 21 shares · 369 followers View post →
Nithin George
@george_nit · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 4, 2023 · 21 shares · 136 followers View post →
Felix Binder
@flxbinder · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 4, 2023 · 21 shares · 555 followers View post →
The Great Indian Drishti
@GrtIndicDrishti · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 4, 2023 · 21 shares · 37 followers View post →
Martin Zettersten
@m_zettersten · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 4, 2023 · 21 shares · 1,695 followers View post →
CogSci Society
@cogsci_soc · X

RT @camrobjones: Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cogniti…

Jul 4, 2023 · 21 shares · 14,560 followers View post →
Cameron Jones
@camrobjones · X

Really excited that our paper comparing human and GPT-3 performance at the False Belief Task has been published in Cognitive Science https://t.co/L0PowtiMBS @cogsci_soc @Sean_Trott @jamichaelov @tylerachang

Jul 4, 2023 · 101 likes · 21 shares · 1,419 followers View post →
Design, User Experience, and Usability: Marcelo M. Soares ...
News

LNCS 13309, Universal Access in Human-Computer Interaction: User and Context ... doi.org/10.1111/1468-2427.00075 39. Statista.: Leading European city ...

Dec 15, 2025 View →
HCI International 2022 - Late Breaking Papers: Design, User ...
News

LNCS 13309, Universal Access in Human-Computer Interaction: User and Context ... 10.1111/j.1479-8425.2004.00137.x 17. Gil, S., Teissèdre, F., Chambres, P ...

Dec 15, 2025 View →
Antimicrobial Resistance: Factors To Findings: Vijay Soni Ajay ...
News

https://doi.org/10.1111/j.1365-2958.1993.tb01111.x. 37. Eldholm V ... 2022;12(1):13309. 10. Murray CJ, et al. Global burden of bacterial antimicrobial ...

Dec 15, 2025 View →
Design, User Experience, and Usability: Design For Emotion, Well ...
News

LNCS 13309, Universal Access in Human-Computer Interaction: User and Context ... 10.1111/j.1471-1842.2010.00880.x. Prensky, M.: Digital natives, digital ...

Dec 15, 2025 View →
Lies, Damned Lies, and Distributional Language Statistics ...
News

Cog- Patrik Bartak, and Samuel F. Brown. 2023b. nitive Science, 47(7):e13309. Tall Tales at Different Scales: Evaluating Scaling Trends For Deception in ...

Dec 15, 2025 View →
Beyond The Conservatory Model | PDF | Curriculum | Brand
News

com/atar-arad-orchestra/, accessed September 3, 2018. Beyond Beauty, Brilliance, and Expression 17 3. Like cogs ... doi: 10.1111/j.1465-3435.2006.00255.x ...

Dec 15, 2025 View →
Data Scopus2020 | PDF | Toxicology | Pharmacology
News

... cog/ta/2020/00000025/00000001/art00005;jsessionid=nae demand in Indonesia: A and ... 10.1111/aji.13296 checkpoints CTLA-4, Sri Ratna Dwiningsih, Arif ...

Dec 15, 2025 View →
Indigenous Peoples, Marine Space and Resources, and ...
News

Constellations Volume 15 issue 4 2008 [doi 10.1111%2Fj.1467-8675.2008.00510.x] Jürgen Habermas -- The Constitutionalization of International Law and the ...

Dec 15, 2025 View →
Oksitosin | PDF | Pituitary Gland | Hypothalamus
News

... 10.1111/j.1471- 0528.1999.tb08112.x. 31. Arletti R, Benelli A, Bertolini A ... cog- 917. Scheele D, Striepens N, Güntürkün O, Deutschländer S, Maier W ...

Dec 15, 2025 View →
Cengizhan & Ucar- 2023 - The Effect of Mindfulness‐Based Sexual ...
News

Mindfulness and cog- Psychiatr Care 2018;54(3):416-421. doi:10.1111/ppc ... 2018;97(4):380-387. Laeger. 2019;181(18):V12180853. doi:10.1111/aogs.13309 ...

Dec 15, 2025 View →
ICPCG-Chapter-8-2024 | PDF | Glycated Hemoglobin | Diabetes
News

Current glycemic target rec- Optimal glycemia is associated with improved cog- ... doi.org/10.1111/pedi.13309 practice consensus guidelines 2022: manag- 69 ...

Dec 15, 2025 View →
2022 Book HCIInternational2022Posters | PDF | Computer Graphics ...
News

LNCS 13309, Universal Access in Human-Computer Interaction: User and Context ... 2(4), 716–724. https://doi.org/10.1111/j.1756-8765.2010.01115.x 4 ...

Dec 15, 2025 View →
Language Model | PDF | Language Mechanics | Syntax
News

Cognitive (EMNLP-IJCNLP), pages 5831–5837. Science, 47(7):e13309. https://doi.org https://doi.org/10.18653/v1/D19-1592 /10.1111/cogs.13309, PubMed: 37401923 ...

Dec 15, 2025 View →
Are Language Models More Like Libraries or Like Librarians | PDF ...
News

mans know? Cognitive Science, 47(7):e13309. doi.org/10.1177/17456916231201401, https://doi.org/10.1111/cogs.13309 ...

Dec 15, 2025 View →
human positron emission tomography study of intranasal insulin in ...
News

doi: 10.1111/acel.12498. 8. Guo Z, Chen Y, Mao YF, et al. Long-term ... doi: 10.3233/jad-2008-13309. 19. Reger MA, Watson GS, Green PS ...

May 27, 2025 View →
Re-evaluating TOM Evaluation in Large Language Models | PDF ...
News

Do Large Language Models Know What Humans Know? Cognitive Science, 47(7):e13309, July 2023. ISSN 0364-0213. doi: 10.1111/cogs.13309. URL https ...

Feb 28, 2025 View →
At Boys Town, we focus on six areas of research, including hearing ...
Facebook

... cogs.advising@ubc.ca :) The UBC Social Health Lab: Smartphones and ... com/doi/10.1111/aogs.13309 Kudos Mr Agata!! Power on making your ...

Jul 19, 2024 View →
Artificial Intelligence Design | Medium
News

Do Large Language Models Know What Humans Know? https://onlinelibrary.wiley.com/doi/pdf/10.1111/cogs.13309 [9] Scammers use AI to mimic ...

Dec 5, 2023 View →
通俗解构语言大模型的工作原理|上下文|向量|字母|工作原理|神经网络 ...
News

com/doi/full/10.1111/cogs.13309)的那样,成功的表现可能归因于任务中的混淆因素——一种“聪明汉斯(clever Hans,指一匹名为汉斯的马看似能完成一些 ...

Aug 1, 2023 View →