Syst Rev April 2023 PMID 37120563

Are ChatGPT and large language models "the answer" to bringing us closer to systematic review automation?

Riaz Qureshi, Daniel Shaughnessy, Kayden A R Gill, Karen A Robinson, Tianjing Li, Eitan Agai

Full text PDF Download social card

Mentions

Peak: 24 in May 2023

across 4 sources since Apr 2023

Extended reach

76,519

potential audience

Total likes

Video views

Mentions per month

Apr 2023 – Aug 2023

Where it's discussed

X / Twitter34 posts
Blogs3 articles
News2 articles
YouTube1 videos

AI synopsis

What people are saying

The discussions reflect a cautious optimism about the prospects of large language models in systematic review automation. For example, comments like 'promising but not reliable' and 'still in its infancy' highlight the recognition of technological potential alongside current limitations. The tone varies from hopeful to reserved, emphasizing the importance of ongoing development to achieve impactful automation tools.

AgreementNeither agree nor disagree

The discussions show mixed opinions, with some posts acknowledging the promise of LLMs like ChatGPT, while others emphasize its current limitations and the need for further development.

InterestModerate interest

Most comments express at least moderate curiosity, especially with references to the potential and challenges of applying these models to systematic reviews.

EngagementModerate engagement

There is some engagement with the topic, as posters reference specific articles and mention the infancy stage of the technology, indicating a moderate level of critical reflection.

ImpactNeutral impact

The discussions suggest that the current state of LLMs might offer some helpful assistance but is unlikely to revolutionize systematic review processes in the immediate future, making the perceived impact moderate.

Abstract in brief

ChatGPT and large language models (LLMs) like OpenAI's are being looked at as potential tools to help automate systematic reviews (SRs), which are time-consuming and resource-intensive research processes.
Right now, these AI tools can provide some useful assistance with SR tasks, but they are still in early development stages and require significant improvement before they can be reliably integrated into scientific research.
The authors caution that non-experts should be careful when using ChatGPT for SRs because, although some responses seem valid, many contain errors and need careful review and validation.]

Read the full abstract

All mentions

Evaluating ChatGPT and Large Language Models for Systematic Review Automation

ChatGPT and large language models are being explored as tools to automate systematic reviews, which are currently resource-intensive. While promising, these AI tools are still in early stages and require careful…

Medicine RTCL TV · Jul 28, 2023 5 views

npj Digital Medicine

@npjDigitalMed · X

(2/2) ...A related commentary covers this topic and is worth adding to your reading list

Aug 3, 2023 · 3,591 followers View post →

Cochrane Brazil

@CochraneBrazil · X

RT @biblioGetafe: Aunque #ChatGPT resulta prometedor como ayuda para #RevisionesSistemáticas aún no es fiable Are ChatGPT and large languag…

May 29, 2023 · 9 shares · 712 followers View post →

Heather McEwen

@HeatherMcEwen3 · X

RT @tomroper: Qureshi R….Are ChatGPT and large language models "the answer" to bringing us closer to systematic review automation? Syst Rev…

May 10, 2023 · 6 shares · 1,442 followers View post →

Alexia Trombert

@AlexiaTrombert · X

RT @tomroper: Qureshi R….Are ChatGPT and large language models "the answer" to bringing us closer to systematic review automation? Syst Rev…

May 10, 2023 · 6 shares · 42 followers View post →

Mala Mann MCLIP

@SysReviews · X

RT @tomroper: Qureshi R….Are ChatGPT and large language models "the answer" to bringing us closer to systematic review automation? Syst Rev…

May 10, 2023 · 6 shares · 2,572 followers View post →

Maga Aceves-Martins

@maga_aceves · X

Are #ChatGPT and large language models “the answer” to bringing us closer to #systematicreview automation? Nice read to start a Tuesday

May 9, 2023 · 2 likes · 292 followers View post →

Evidencia Nutrición

@EvidNutrition · X

RT @biblioGetafe: Aunque #ChatGPT resulta prometedor como ayuda para #RevisionesSistemáticas aún no es fiable Are ChatGPT and large languag…

May 9, 2023 · 9 shares · 12,144 followers View post →

Rita Calixto

@DeJuncoYCapuli · X

RT @biblioGetafe: Aunque #ChatGPT resulta prometedor como ayuda para #RevisionesSistemáticas aún no es fiable Are ChatGPT and large languag…

May 8, 2023 · 9 shares · 313 followers View post →

Antonio-Campos et al ;)

@aac_phd · X

RT @biblioGetafe: Aunque #ChatGPT resulta prometedor como ayuda para #RevisionesSistemáticas aún no es fiable Are ChatGPT and large languag…

May 8, 2023 · 9 shares · 631 followers View post →

mariofdelg

@mariodelg · X

RT @biblioGetafe: Aunque #ChatGPT resulta prometedor como ayuda para #RevisionesSistemáticas aún no es fiable Are ChatGPT and large languag…

May 8, 2023 · 9 shares · 296 followers View post →

begil

@BlancaEstherGil · X

RT @biblioGetafe: Aunque #ChatGPT resulta prometedor como ayuda para #RevisionesSistemáticas aún no es fiable Are ChatGPT and large languag…

May 8, 2023 · 9 shares · 552 followers View post →

Álvaro Solaz García

@GarciaSolaz · X

RT @biblioGetafe: Aunque #ChatGPT resulta prometedor como ayuda para #RevisionesSistemáticas aún no es fiable Are ChatGPT and large languag…

May 8, 2023 · 9 shares · 1,545 followers View post →

Nuria de Argila

@NuriaDeArgila · X

RT @biblioGetafe: Aunque #ChatGPT resulta prometedor como ayuda para #RevisionesSistemáticas aún no es fiable Are ChatGPT and large languag…

May 8, 2023 · 9 shares · 7,248 followers View post →

Concepcion Campos-Asensio

@biblioGetafe · X

May 8, 2023 · 21 likes · 9 shares · 4,853 followers View post →

Lucia Ruggiero EALR

@luciaruggiero · X

RT @GlobalPHObserv: Are ChatGPT and large language models “the answer” to bringing us closer to systematic review automation? https://t.co…

May 4, 2023 · 2 shares · 1,031 followers View post →

Joshua Zvi Goldenberg

@JoshuaZvi · X

https://t.co/NWlnF7rWtr

May 4, 2023 · 118 followers View post →

Culture of Health Eq

@CofHEQ · X

RT @GlobalPHObserv: Are ChatGPT and large language models “the answer” to bringing us closer to systematic review automation? https://t.co…

May 3, 2023 · 2 shares · 1,095 followers View post →

Global Health Observ

@GlobalPHObserv · X

Are ChatGPT and large language models “the answer” to bringing us closer to systematic review automation? https://t.co/WOV9TpFhOh

May 3, 2023 · 5 likes · 2 shares · 6,553 followers View post →

Terena Solomons

@TerenaSolomons · X

RT @tomroper: Qureshi R….Are ChatGPT and large language models "the answer" to bringing us closer to systematic review automation? Syst Rev…

May 2, 2023 · 6 shares · 129 followers View post →

Andrew Booth

@AndrewB007h · X

RT @tomroper: Qureshi R….Are ChatGPT and large language models "the answer" to bringing us closer to systematic review automation? Syst Rev…

May 2, 2023 · 6 shares · 3,009 followers View post →

Alan Fricker

@alanfricker · X

RT @tomroper: Qureshi R….Are ChatGPT and large language models "the answer" to bringing us closer to systematic review automation? Syst Rev…

May 2, 2023 · 6 shares · 1,411 followers View post →

Tom Roper

@tomroper · X

May 2, 2023 · 3 likes · 6 shares · 3,641 followers View post →

Giuseppe Biondi-Zoccai

@gbiondizoccai · X

'While ChatGPT and large language models show some promise for aiding in systematic review-related tasks, the technology is in its infancy and needs much development for such applications' https://t.co/WEfHupBf09 #ChatGPT @OpenAI https://t.co/BwGTJamOym

May 2, 2023 · 1 like · 12,170 followers View post →

@equiperenard.bsky.social

@EquipeRENARD · X

May 1, 2023 · 3 likes · 1,098 followers View post →

Mary Shelton

@MaryEShelton · X

Are ChatGPT and large language models "the answer" to bringing us closer to systematic review automation? https://t.co/mtasKxVZKA

May 1, 2023 · 720 followers View post →

渕野　裕 (Fuchino Yutaka)

@yfuchino · X

Are ChatGPT and large language models "the answer" to bringing us closer to systematic review automation? https://t.co/zq4j7KgX0e

Apr 30, 2023 · 19 followers View post →

Systematic Review Consultants LTD

@EvidenceReviews · X

RT @FarhadShokrane: Are ChatGPT and large language models “the answer” to bringing us closer to systematic review automation? https://t.co…

Apr 30, 2023 · 5 shares · 190 followers View post →

渕野　裕 (Fuchino Yutaka)

@yfuchino · X

Are ChatGPT and large language models "the answer" to bringing us closer to systematic review automation? https://t.co/rWus34H6Zs

Apr 30, 2023 · 19 followers View post →

Pin Lu

@pinlu · X

RT @FarhadShokrane: Are ChatGPT and large language models “the answer” to bringing us closer to systematic review automation? https://t.co…

Apr 30, 2023 · 5 shares · 808 followers View post →

Bernadette Coles

@Bernadette37 · X

RT @FarhadShokrane: Are ChatGPT and large language models “the answer” to bringing us closer to systematic review automation? https://t.co…

Apr 30, 2023 · 5 shares · 161 followers View post →

うーまく13歳

@pingue7 · X

RT @FarhadShokrane: Are ChatGPT and large language models “the answer” to bringing us closer to systematic review automation? https://t.co…

Apr 29, 2023 · 5 shares · 1,784 followers View post →

DoppelpaSS

@svb_sur_1904 · X

RT @FarhadShokrane: Are ChatGPT and large language models “the answer” to bringing us closer to systematic review automation? https://t.co…

Apr 29, 2023 · 5 shares · 422 followers View post →

Abraham E. Gracia R.

@Abraham_RMI · X

Are ChatGPT and large language models “the answer” to bringing us closer to systematic review automation? Via ⁦@BioMedCentral⁩ CC ⁦@carrieprice78⁩ https://t.co/q4ewD35WwA

Apr 29, 2023 · 6 likes · 4,683 followers View post →

Farhad Shokraneh

@FarhadShokrane · X

Are ChatGPT and large language models “the answer” to bringing us closer to systematic review automation? https://t.co/DIfaeQT5gr

Apr 29, 2023 · 12 likes · 5 shares · 903 followers View post →

Are ChatGPT and large language models "the answer" to bringing us closer to systematic review automation?

Mentions per month

Where it's discussed

What people are saying

Abstract in brief

Top posts

All mentions

Evaluating ChatGPT and Large Language Models for Systematic Review Automation