Bariatric Evaluation Through AI: a Survey of Expert Opinions Versus ChatGPT-4 (BETA-SEOV)

Amir Hossein Davarpanah Jazi, Mohammad Mahjoubi, Shahab Shahabi, Aayed R. Alqahtani, Ashraf Haddad, Abdolreza Pazouki, Arun Prasad, Bassem Y. Safadi, Sonja Chiappetta, Halit Eren Taskin, Helmuth Thorlakur Billy, Kazunori Kasama, Kamal Mahawar, Khaled Gawdat, Karl Peter Rheinwalt, Karl A. Miller, Lilian Kow, Manoel Galvao Neto, Wah Yang, Mariano PalermoOmar M. Ghanem, Panagiotis Lainas, Ralph Peterli, Radwan Kassir, Ramon Vilallonga Puy, Rui José Da Silva Ribeiro, Sergio Verboonen, Tadeja Pintar, Asim Shabbir, Mario Musella, Mohammad Kermansaravi

Research output: Contribution to journalArticlepeer-review

10 Citations (Scopus)

Abstract

Background: Recent advancements in artificial intelligence, such as OpenAI’s ChatGPT-4, are revolutionizing various sectors, including healthcare. This study investigates the use of ChatGPT-4 in identifying suitable candidates for bariatric surgery and providing surgical recommendations to improve decision-making in obesity treatment amid the global obesity epidemic. 

Methods: We devised ten patient scenarios, thoughtfully encompassing a spectrum that spans from uncomplicated cases to more complex ones. Our objective was to delve into the decision-making process regarding the recommendation of bariatric surgery. From July 29th to August 10th, 2023, we conducted a voluntary online survey involving thirty prominent bariatric surgeons, ensuring that there was no predetermined bias in the selection of a specific type of bariatric surgery. This survey was designed to collect their insights on these scenarios and gain a deeper understanding of their professional experience and background in the field of bariatric surgery. Additionally, we consulted ChatGPT-4 in two separate conversations to evaluate its alignment with expert opinions on bariatric surgery options. 

Results: In 40% of the scenarios, disparities were identified between the two conversations with ChatGPT-4. It matched expert opinions in 30% of cases. Differences were noted in cases like gastrointestinal metaplasia and gastric adenocarcinoma, but there was alignment with conditions like endometriosis and GERD. 

Conclusion: The evaluation of ChatGPT-4’s role in determining bariatric surgery suitability uncovered both potential and shortcomings. Its alignment with experts was inconsistent, and it often overlooked key factors, emphasizing human expertise’s value. Its current use requires caution, and further refinement is needed for clinical application. Graphical Abstract: [Figure not available: see fulltext.]

Original languageEnglish
Pages (from-to)3971-3980
Number of pages10
JournalObesity Surgery
Volume33
Issue number12
Early online date27 Oct 2023
DOIs
Publication statusPublished - Dec 2023

Keywords

  • Artificial Intelligence
  • Bariatric Evaluation
  • Bariatric Surgery
  • ChatGPT
  • Health Literacy
  • Language Learning Models

Fingerprint

Dive into the research topics of 'Bariatric Evaluation Through AI: a Survey of Expert Opinions Versus ChatGPT-4 (BETA-SEOV)'. Together they form a unique fingerprint.

Cite this