September 2025 PMID 40726742

: A Question Answering Benchmark with Long Clinical Documents.

Lisa Adams, Felix Busch, Tianyu Han, Jean-Baptiste Excoffier, Matthieu Ortala, Alexander Löser, Hugo J W L Aerts, Jakob Nikolas Kather, Daniel Truhn, Keno Bressem

Mentions

16
Peak: 7 in Aug 2024
across 3 sources since Jan 2021

Extended reach

648,660
potential audience

Total likes

15,116

Video views

633,941

Mentions per month

Jan 2021 – Dec 2025

Where it's discussed

  • YouTube9 videos
  • X / Twitter5 posts
  • Bluesky2 posts

AI synopsis

What people are saying

The analysis reflects a focus on survival and climate discussions, exemplified by mentions of post-collapse worlds and climate crises, which are only loosely connected to the publication about clinical document processing. The choice of words such as 'good news' and 'how humans might survive' indicates a tone of optimism and concern for future scenarios rather than technical or scientific critique, contributing to a neutral impact assessment.

AgreementNeither agree nor disagree

The discussions demonstrate minimal direct agreement or disagreement with the article; most comments are tangential or unrelated.

InterestModerate interest

People show moderate interest primarily in survival scenarios or environmental topics, rather than the technical details of the publication.

EngagementNeutral engagement

Engagement appears superficial, as posts mainly share links or mention related topics without deep analysis of the research.

ImpactNeutral impact

The overall influence of these discussions on the scientific or clinical community seems negligible, focusing more on survival and climate issues than on healthcare NLP advancements.

Abstract in brief

  • The study introduces a new benchmark with 20 fictional long clinical cases, each containing over 5000 words, to evaluate how well large language models (LLMs) can process complex healthcare documents through 400 questions focused on information extraction, negation, and sorting.
  • Eleven open-source LLMs and OpenAI's GPT-3.5 Turbo were tested, with the best results achieved by MistralSmall24B and Llama4Scout17B16EInstruct, especially in retrieving information from single or multiple documents.
  • Despite some success, all models struggled with tasks that involved identifying missing information, indicating a significant gap in current LLM capabilities that needs addressing before these models can be reliably used in clinical settings.

Top posts

Most liked on X and Bluesky
Paul Beckwith
@paulhbeckwith.bsky.social · Bluesky

My new video analysis: How We Could Survive in a Post-Collapse World youtu.be/MFN_uhcBZ1k?... My name is Beckwith. Paul Beckwith. #climate #ClimateCrisis #ClimateEmergency #NewZealand #Ireland #Iceland #UK #Tasmania #Australia #Canada #USA #preppers #Survivor

Apr 3, 2025 · 27 likes · 16 shares View post →
Wild World
@TheWildWorldYT · X

Newest video on sleeper sharks out now: https://t.co/6Kudx7aN3G

Aug 25, 2024 · 8 likes · 3 shares · 115 followers View post →
Legendary Cryptids
@BestCryptids · X

RT @TheWildWorldYT: Newest video on sleeper sharks out now: https://t.co/6Kudx7aN3G

Aug 25, 2024 · 3 shares · 13,620 followers View post →
Truth is Scarier
@TruthScarier · X

RT @TheWildWorldYT: Newest video on sleeper sharks out now: https://t.co/6Kudx7aN3G

Aug 25, 2024 · 3 shares · 825 followers View post →
Notsu
@notsoupframe · X

https://t.co/evSGKJJJLT

Aug 25, 2024 · 64 followers View post →
Sharktoz
@Sharktoz · X

RT @TheWildWorldYT: Newest video on sleeper sharks out now: https://t.co/6Kudx7aN3G

Aug 25, 2024 · 3 shares · 42 followers View post →

All mentions

OJT PhD
@ojtphd.bsky.social · Bluesky

Some good news: Billionaires do NOT have the best survivability chances! WHITEPAPER: How Humans Might Survive in a Post-Collapse World youtu.be/MFN_uhcBZ1k?...

Jun 19, 2025 View post →
Paul Beckwith
@paulhbeckwith.bsky.social · Bluesky

My new video analysis: How We Could Survive in a Post-Collapse World youtu.be/MFN_uhcBZ1k?... My name is Beckwith. Paul Beckwith. #climate #ClimateCrisis #ClimateEmergency #NewZealand #Ireland #Iceland #UK #Tasmania #Australia #Canada #USA #preppers #Survivor

Apr 3, 2025 · 27 likes · 16 shares View post →
Legendary Cryptids
@BestCryptids · X

RT @TheWildWorldYT: Newest video on sleeper sharks out now: https://t.co/6Kudx7aN3G

Aug 25, 2024 · 3 shares · 13,620 followers View post →
Notsu
@notsoupframe · X

https://t.co/evSGKJJJLT

Aug 25, 2024 · 64 followers View post →
Sharktoz
@Sharktoz · X

RT @TheWildWorldYT: Newest video on sleeper sharks out now: https://t.co/6Kudx7aN3G

Aug 25, 2024 · 3 shares · 42 followers View post →
Truth is Scarier
@TruthScarier · X

RT @TheWildWorldYT: Newest video on sleeper sharks out now: https://t.co/6Kudx7aN3G

Aug 25, 2024 · 3 shares · 825 followers View post →
Wild World
@TheWildWorldYT · X

Newest video on sleeper sharks out now: https://t.co/6Kudx7aN3G

Aug 25, 2024 · 8 likes · 3 shares · 115 followers View post →