Nat Mach Intell July 2023 PMID 38706981

Federated benchmarking of medical artificial intelligence with MedPerf.

Alexandros Karargyris, Renato Umeton, Micah J Sheller, Alejandro Aristizabal, Johnu George, Anna Wuest, Sarthak Pati, Hasan Kassem, Maximilian Zenk, Ujjwal Baid, Prakash Narayana Moorthy, Alexander Chowdhury, Junyi Guo, Sahil Nalawade, Jacob Rosenthal

Download social card

Mentions

31
Peak: 9 in Aug 2023
across 5 sources since Jul 2023

Extended reach

82,136
potential audience

Total likes

42

Video views

14

Mentions per month

Jul 2023 – Jan 2024

Where it's discussed

  • X / Twitter21 posts
  • News4 articles
  • YouTube2 videos
  • Facebook2 posts
  • Reddit2 posts

AI synopsis

What people are saying

Discussions frequently reference the innovative nature of MedPerf, with phrases like 'major milestone' and 'open platform' conveying excitement and importance. Comments highlight challenges and solutions in healthcare AI, emphasizing the platform's potential to advance evidence-based practice and data privacy, reflecting both high interest and perceived impact.

AgreementModerate agreement

Most discussions express strong support and recognition of the value of MedPerf's federated benchmarking approach for medical AI.

InterestHigh interest

Comments show high curiosity and enthusiasm, highlighting the platform's innovative design and potential impact.

EngagementModerate engagement

Posts delve into technical details and implications, indicating a moderate level of thoughtful engagement.

ImpactHigh impact

The emphasis on solving current challenges in healthcare AI and the mention of major institutions suggest significant influence on the field.

Abstract in brief

  • Medical AI has the potential to enhance healthcare by improving evidence-based practice, personalizing treatment, cutting costs, and enhancing experiences for providers and patients.
  • MedPerf is introduced as an open platform designed for benchmarking medical AI models, enabling federated evaluation across healthcare organizations while maintaining data privacy.
  • The text outlines the challenges in healthcare AI, highlights the design and current status of MedPerf, and calls for collaboration from researchers and organizations to advance the platform.

Top posts

Most liked on X and Bluesky
Shinichi Takaŷanagi
@_stakaya · X

医療分野のAIモデルの性能評価オープンプラットフォームMedPerfを提案。データではなくAIモデルを連合(Federated)させ、評価可能としている点が肝。結果、医療機関はデータプライバシーを担保可能。 Federated benchmarking of medical artificial intelligence with MedPerf https://t.co/zdGXra8p9D

Aug 18, 2023 · 19 likes · 2 shares · 6,384 followers View post →
MLCommons
@MLCommons · X

@MLCommons medical working group announces a major milestone for evaluating AI model performance on large, diverse, real-world datasets with Federated Benchmarking of Medical Artificial Intelligence with MedPerf in Nature Machine Intelligence. https://t.co/vABY1HDrt2

Jul 17, 2023 · 17 likes · 5 shares · 3,443 followers View post →
Hiro Hamada 濱田太陽 | Health is King
@HiroTHamadaJP · X

Federated benchmarking of medical artificial intelligence with MedPerf https://t.co/SFVHUkR4FY

Aug 4, 2023 · 2 likes · 5,640 followers View post →
Medz AI
@Medz_AI · X

Federated benchmarking of medical artificial intelligence with MedPerf | Nature Machine Intelligence: current challenges healthcare and AI communities face, the need for an open platform, the design philosophy of MedPerf, its current implementation status. https://t.co/MWF46vCi1I

Jul 24, 2023 · 2 likes · 5 followers View post →
BioDecoded
@BioDecoded · X

Federated benchmarking of medical artificial intelligence with MedPerf | Nature Machine Intelligence https://t.co/yc8Q3gEJA8 #AI https://t.co/ZCg3Rfg9xi

Aug 8, 2023 · 1 like · 8,900 followers View post →
Katharina Koerner
@KatharinaKoern1 · X

Also see the publication of „Federated Benchmarking of Medical Artificial Intelligence with MedPerf“ in the Nature Machine Intelligence journal. https://t.co/HceISaIPYE 2/2

Jul 27, 2023 · 1 like · 2,031 followers View post →

All mentions

mpyllan
@mpyllan · X

Federated benchmarking of medical artificial intelligence with MedPerf - https://t.co/D7o0pUraVP

Sep 11, 2023 · 857 followers View post →
OxS
@splusoh · X

Federated benchmarking of medical artificial intelligence with MedPerf https://t.co/bWDnv4eWN1

Sep 8, 2023 · 638 followers View post →
Winson Tang
@winsontang · X

Federated benchmarking of medical artificial intelligence with MedPerf https://t.co/RgoVtqYOmJ

Sep 8, 2023 · 9,044 followers View post →
Karmyn Kast - NYC
@karmynkast · X

Federated benchmarking of medical artificial intelligence with MedPerf https://t.co/M30eLVZBQB #HackerNews

Sep 8, 2023 · 387 followers View post →
生成AI研究会(GAIS)
@GAIS_jp · X

Federated benchmarking of medical artificial intelligence with MedPerf https://t.co/x4KwDrayJU #ChatGPT #GPT #GAIS #AI

Aug 24, 2023 · 524 followers View post →
Akihiro Ueno | PharmaX
@ueeeeniki · X

あとで読む Federated benchmarking of medical artificial intelligence with MedPerf | Nature Machine Intelligence https://t.co/1wD9VP8c1S

Aug 19, 2023 · 2,487 followers View post →
Akihiro Ueno | PharmaX
@ueeeeniki · X

RT @_stakaya: 医療分野のAIモデルの性能評価オープンプラットフォームMedPerfを提案。データではなくAIモデルを連合(Federated)させ、評価可能としている点が肝。結果、医療機関はデータプライバシーを担保可能。 Federated benchmarkin…

Aug 19, 2023 · 2 shares · 2,487 followers View post →
ironman
@hommedefer3 · X

RT @_stakaya: 医療分野のAIモデルの性能評価オープンプラットフォームMedPerfを提案。データではなくAIモデルを連合(Federated)させ、評価可能としている点が肝。結果、医療機関はデータプライバシーを担保可能。 Federated benchmarkin…

Aug 18, 2023 · 2 shares · 1,963 followers View post →
Shinichi Takaŷanagi
@_stakaya · X

医療分野のAIモデルの性能評価オープンプラットフォームMedPerfを提案。データではなくAIモデルを連合(Federated)させ、評価可能としている点が肝。結果、医療機関はデータプライバシーを担保可能。 Federated benchmarking of medical artificial intelligence with MedPerf https://t.co/zdGXra8p9D

Aug 18, 2023 · 19 likes · 2 shares · 6,384 followers View post →
葉隠れ
@osanpochuudayo · X

MIT/ Harvard/ Stanford/ MSが連携、 医療用AIの一般化に向け、臨床別、施設毎に各性能を評価する「MedPerf」を開発。臨床場面でのAIの有用性を確認する。 Nature Medicine Intelligence Federated benchmarking of medical artificial intelligence with MedPerf https://t.co/oliXQdzn8k

Aug 17, 2023 · 875 followers View post →
knishimae
@knishimae0531 · X

Alexandros Karargyris et al. Federated benchmarking of medical artificial intelligence with MedPerf https://t.co/MlyjsmSgLF https://t.co/lweGZojFHH https://t.co/X4nlW1f4wn

Aug 9, 2023 · 417 followers View post →
BioDecoded
@BioDecoded · X

Federated benchmarking of medical artificial intelligence with MedPerf | Nature Machine Intelligence https://t.co/yc8Q3gEJA8 #AI https://t.co/ZCg3Rfg9xi

Aug 8, 2023 · 1 like · 8,900 followers View post →
Hiro Hamada 濱田太陽 | Health is King
@HiroTHamadaJP · X

Federated benchmarking of medical artificial intelligence with MedPerf https://t.co/SFVHUkR4FY

Aug 4, 2023 · 2 likes · 5,640 followers View post →
Katharina Koerner
@KatharinaKoern1 · X

Also see the publication of „Federated Benchmarking of Medical Artificial Intelligence with MedPerf“ in the Nature Machine Intelligence journal. https://t.co/HceISaIPYE 2/2

Jul 27, 2023 · 1 like · 2,031 followers View post →
Medz AI
@Medz_AI · X

Federated benchmarking of medical artificial intelligence with MedPerf | Nature Machine Intelligence: current challenges healthcare and AI communities face, the need for an open platform, the design philosophy of MedPerf, its current implementation status. https://t.co/MWF46vCi1I

Jul 24, 2023 · 2 likes · 5 followers View post →
Frank Lindseth
@FLindseth · X

RT @MLCommons: @MLCommons medical working group announces a major milestone for evaluating AI model performance on large, diverse, real-wor…

Jul 18, 2023 · 5 shares · 88 followers View post →
Google for Health
@GoogleForHealth · X

RT @MLCommons: @MLCommons medical working group announces a major milestone for evaluating AI model performance on large, diverse, real-wor…

Jul 18, 2023 · 5 shares · 31,007 followers View post →
Sarthak Pati
@SarthakPati · X

RT @MLCommons: @MLCommons medical working group announces a major milestone for evaluating AI model performance on large, diverse, real-wor…

Jul 17, 2023 · 5 shares · 248 followers View post →
Laura Stadler
@LauraBStadler1 · X

RT @MLCommons: @MLCommons medical working group announces a major milestone for evaluating AI model performance on large, diverse, real-wor…

Jul 17, 2023 · 5 shares · 52 followers View post →
David Kanter
@TheKanter · X

RT @MLCommons: @MLCommons medical working group announces a major milestone for evaluating AI model performance on large, diverse, real-wor…

Jul 17, 2023 · 5 shares · 4,574 followers View post →
MLCommons
@MLCommons · X

@MLCommons medical working group announces a major milestone for evaluating AI model performance on large, diverse, real-world datasets with Federated Benchmarking of Medical Artificial Intelligence with MedPerf in Nature Machine Intelligence. https://t.co/vABY1HDrt2

Jul 17, 2023 · 17 likes · 5 shares · 3,443 followers View post →