Synopsis of Social media discussions
Discussions consistently praise the study’s findings, such as mentions of ChatGPT producing questions with acceptable psychometric properties, and highlight how AI can revolutionize exam development, using words like 'transformative' and 'remarkable.' The tone and choice of examples reflect a high level of engagement and recognition of the research’s importance in education and assessment fields.
Agreement
Moderate agreementMost discussions acknowledge the potential and usefulness of AI-generated questions, emphasizing the positive findings related to psychometric quality and efficiency.
Interest
High level of interestPosts demonstrate high interest by highlighting studies, results, and the transformative potential of AI in exam creation, indicating enthusiasm and engagement with the topic.
Engagement
High engagementThrough references to specific research findings, discussions of quality, and the importance of prompts, the posts show a deep level of analysis and active involvement.
Impact
High level of impactThe discussions suggest this research may significantly influence educational assessments and testing practices by showcasing AI's capabilities and limitations.
Social Mentions
YouTube
3 Videos
26 Posts
News
1 Articles
Metrics
Video Views
1,403
Total Likes
74
Extended Reach
46,034
Social Features
30
Timeline: Posts about article
Top Social Media Posts
Medical Education Flamingo, MD, PhD
Our study published today!
"#ChatGPT for generating MCQs: Evidence on the use of #artificialintelligence in automatic item generation for a rational pharmacotherapy exam"
It presents the first psychometric evidence for ChatGPT-generated case-based MCQs.
https://t.co/NxhAuoeGA4
view full post
Medical Education Flamingo, MD, PhD
"... we found that ChatGPT is able to generate multiple choice questions with acceptable levels of item psychometrics. Our findings showed that the questions can effectively differentiate between students who perform at high and low levels."
Ref: 10.1007/s00228-024-03649-x
view full post
Medical Education Flamingo, MD, PhD
There is a group of authors who has published 100+ commentaries on many diverse fields only in the last 8 months.
They didn't miss our #ChatGPT paper (free read-only access via this link: https://t.co/oPTuS5E9qR) as well.
Here is our reply to them: https://t.co/ADcaQxa29e https://t.co/zrwarhYhM4
view full post
Medical Education Flamingo, MD, PhD
"... [in generating MCQs using #ChatGPT] it is essential to recognize that the quality of multiple-choice questions is closely tied to prompt quality."
Ref: 10.1007/s00228-024-03649-x
view full post
Medical Education Flamingo, MD, PhD
"Despite the presence of studies that focus on providing human-generated questions to ChatGPT, there has been a lack of research focused to asking ChatGPT-generated questions to humans."
Ref: 10.1007/s00228-024-03649-x
This is why we conducted this study, btw.
view full post
Posts referencing the article
Enhancing Medical Education with Customized ChatGPT for MCQ Generation
This presentation from St Georges University of London on April 17, 2024, discusses using ChatGPT to generate medical cases and multiple-choice questions. It highlights a customized tool for efficient, high-quality question creation, including evidence from clinical studies.
May 15, 2024
815 views
Using ChatGPT and Large Language Models for Medical Education Effectively
This presentation discusses utilizing ChatGPT to generate medical cases and questions for teaching, supported by a randomized controlled study and evidence from related research. It highlights how AI can improve educational material quality and efficiency.
June 15, 2024
428 views
Evaluating ChatGPT for Medical Case and Question Generation Efficiency
This video explores how to use ChatGPT and specific prompts to generate medical cases and multiple-choice questions for teaching and assessment, presenting results from a randomized controlled study highlighting the effectiveness of AI-assisted educational tools.
April 15, 2024
161 views
-
“Bir diğer önemli dezavantaj ise yapay zeka modellerinin “kara kutu” olmasıdır. Bu, her seferinde benzersiz sorular üretmemizi sağlasa da, girdimizin çıktıyı tam olarak nasıl etkileyeceğini bilememekteyiz.” Kaynak: 10.1007/s00228-024-03649-x
view full postAugust 26, 2024
-
Medical Education Flamingo, MD, PhD
@MedEdFlamingo (Twitter)"Another significant drawback is the “black box” nature of AI models. Although this enables us to generate unique questions each time, we cannot know how our input will precisely affect the output." Ref: 10.1007/s00228-024-03649-x
view full postMay 13, 2024
1
-
Medical Education Flamingo, MD, PhD
@MedEdFlamingo (Twitter)There is a group of authors who has published 100+ commentaries on many diverse fields only in the last 8 months. They didn't miss our #ChatGPT paper (free read-only access via this link: https://t.co/oPTuS5E9qR) as well. Here is our reply to them: https://t.co/ADcaQxa29e https://t.co/zrwarhYhM4
view full postMarch 18, 2024
7
-
Prof. Nasser Alzerwi
@NAlzerwi (Twitter)RT @MedEdFlamingo: Couldn't agree more! "Despite the presence of studies that focus on providing human-generated questions to ChatGPT, the…
view full postFebruary 26, 2024
1
-
Medical Education Flamingo, MD, PhD
@MedEdFlamingo (Twitter)Couldn't agree more! "Despite the presence of studies that focus on providing human-generated questions to ChatGPT, there has been a lack of research focused to asking ChatGPT-generated questions to humans." Ref: 10.1007/s00228-024-03649-x https://t.co/DQuHuIzIyq
view full postFebruary 26, 2024
1
1
-
Teresa Hartman
@thartman2u (Twitter)RT @MedEdFlamingo: "... while it is efficient to generate questions with #ChatGPT, constructing an entire exam without any revisions can be…
view full postFebruary 24, 2024
1
-
Medical Education Flamingo, MD, PhD
@MedEdFlamingo (Twitter)"... while it is efficient to generate questions with #ChatGPT, constructing an entire exam without any revisions can be challenging." #MedEd Ref: 10.1007/s00228-024-03649-x
view full postFebruary 23, 2024
1
1
-
SANDRAJOHNSTON
@sandra04850184 (Twitter)RT @MedEdFlamingo: "... [in generating MCQs using #ChatGPT] it is essential to recognize that the quality of multiple-choice questions is c…
view full postFebruary 22, 2024
2
-
Teresa Hartman
@thartman2u (Twitter)RT @MedEdFlamingo: "... [in generating MCQs using #ChatGPT] it is essential to recognize that the quality of multiple-choice questions is c…
view full postFebruary 22, 2024
2
-
Medical Education Flamingo, MD, PhD
@MedEdFlamingo (Twitter)"... [in generating MCQs using #ChatGPT] it is essential to recognize that the quality of multiple-choice questions is closely tied to prompt quality." Ref: 10.1007/s00228-024-03649-x
view full postFebruary 22, 2024
3
2
-
Teresa Hartman
@thartman2u (Twitter)RT @MedEdFlamingo: "The efficiency achieved through #AI would appear remarkable to test developers from a decade ago, who were engaged in t…
view full postFebruary 21, 2024
2
-
Prof. Nasser Alzerwi
@NAlzerwi (Twitter)RT @MedEdFlamingo: "The efficiency achieved through #AI would appear remarkable to test developers from a decade ago, who were engaged in t…
view full postFebruary 21, 2024
2
-
Medical Education Flamingo, MD, PhD
@MedEdFlamingo (Twitter)"The efficiency achieved through #AI would appear remarkable to test developers from a decade ago, who were engaged in the effortful task of manually writing multiple-choice questions." #MedEd Ref: 10.1007/s00228-024-03649-x
view full postFebruary 21, 2024
3
2
-
Medical Education Flamingo, MD, PhD
@MedEdFlamingo (Twitter)Ref: ChatGPT for generating multiple‑choice questions: Evidence on the use of artificial intelligence in automatic item generation for a rational pharmacotherapy exam Here is the link for accessing to a view-only version of the paper: https://t.co/p3OLk1mxQT
view full postFebruary 20, 2024
1
-
Medical Education Flamingo, MD, PhD
@MedEdFlamingo (Twitter)"This [#AI] transformation is readily observable in our new ability, as humans, to produce appropriate case-based MCQs with minimal human efforts, accomplished by the simple process of inputting a prompt and hitting the enter key." #MedEd Ref: 10.1007/s00228-024-03649-x
view full postFebruary 20, 2024
2
-
SANDRAJOHNSTON
@sandra04850184 (Twitter)RT @MedEdFlamingo: "... we found that ChatGPT is able to generate multiple choice questions with acceptable levels of item psychometrics. O…
view full postFebruary 19, 2024
2
-
MedEd Models
@MedEdModels (Twitter)RT @MedEdFlamingo: "... we found that ChatGPT is able to generate multiple choice questions with acceptable levels of item psychometrics. O…
view full postFebruary 19, 2024
2
-
Medical Education Flamingo, MD, PhD
@MedEdFlamingo (Twitter)Ref: ChatGPT for generating multiple‑choice questions: Evidence on the use of artificial intelligence in automatic item generation for a rational pharmacotherapy exam Here is the link for accessing to a view-only version of the paper: https://t.co/p3OLk1mxQT
view full postFebruary 19, 2024
1
-
Medical Education Flamingo, MD, PhD
@MedEdFlamingo (Twitter)"... we found that ChatGPT is able to generate multiple choice questions with acceptable levels of item psychometrics. Our findings showed that the questions can effectively differentiate between students who perform at high and low levels." Ref: 10.1007/s00228-024-03649-x
view full postFebruary 19, 2024
8
2
-
Ikemen
@HandsomeKinoko (Twitter)ChatGPT for generating multiple-choice questions: Evidence on the use of artificial intelligence in automatic i @HandsomeKinoko #note https://t.co/WbwL3tTsyp
view full postFebruary 18, 2024
-
Teresa Hartman
@thartman2u (Twitter)RT @MedEdFlamingo: "Despite the presence of studies that focus on providing human-generated questions to ChatGPT, there has been a lack of…
view full postFebruary 18, 2024
1
-
Medical Education Flamingo, MD, PhD
@MedEdFlamingo (Twitter)ChatGPT for generating multiple‑choice questions: Evidence on the use of artificial intelligence in automatic item generation for a rational pharmacotherapy exam Here is the link for accessing to a view-only version of the paper: https://t.co/oPTuS5E9qR
view full postFebruary 18, 2024
1
-
Medical Education Flamingo, MD, PhD
@MedEdFlamingo (Twitter)"Despite the presence of studies that focus on providing human-generated questions to ChatGPT, there has been a lack of research focused to asking ChatGPT-generated questions to humans." Ref: 10.1007/s00228-024-03649-x This is why we conducted this study, btw.
view full postFebruary 18, 2024
3
1
-
Robert Trevino, MD, PhD
@trevy13 (Twitter)RT @MedEdFlamingo: Our study published today! "#ChatGPT for generating MCQs: Evidence on the use of #artificialintelligence in automatic i…
view full postFebruary 14, 2024
2
-
Prof. Nasser Alzerwi
@NAlzerwi (Twitter)RT @MedEdFlamingo: Our study published today! "#ChatGPT for generating MCQs: Evidence on the use of #artificialintelligence in automatic i…
view full postFebruary 14, 2024
2
-
Medical Education Flamingo, MD, PhD
@MedEdFlamingo (Twitter)Our study published today! "#ChatGPT for generating MCQs: Evidence on the use of #artificialintelligence in automatic item generation for a rational pharmacotherapy exam" It presents the first psychometric evidence for ChatGPT-generated case-based MCQs. https://t.co/NxhAuoeGA4
view full postFebruary 14, 2024
9
2
-
AMEE Guide No. 178 - AI in HPE Assessment | PDF | Artificial ...
doi:10. professions education. Part 2: tools and practical application: 1007/s00228-024-03649-x ... doi:10.1007/978-3-031-72315-5_20 review. Smart Learn ...
view full postDecember 12, 2025
News
Abstract Synopsis
Tıp Eğitimi
@tipegitim (Twitter)