Transparent Intelligence Publishing Transparent Intelligence Publishing

Search

Search results:
Evaluating Large Language Models for Symptom-Based Medical Diagnosis: A Comparative Performance Analysis
This research undertook an assessment of Large Language Models (LLMs) within the domain of clinical diagnostics, specifically investigating their capacity to interpret symptom-centered inputs and generate precise clinical assessments. The investigation focused on evaluating several prominent architectures—including GPT-4, GPT-4o, Gemini, o1 Preview, and GPT-3.5—to gauge their proficiency in identifying clinical conditions solely from presented symptomatology. To guarantee clinical validity and appropriateness, symptom profiles were compiled from verified medical literature. Each architecture underwent testing within standardized environments to quantify diagnostic accuracy, precision, recall, and underlying logical processing. Specialized clinical scenarios were structured to examine performance boundaries across both routine and critical diagnostic conditions. The findings indicated that GPT-4 delivered the highest overall diagnostic accuracy, displaying a strong synergy with established medical logic. Conversely, Gemini demonstrated superior performance in high-stakes environments where exact decision-making is vital. Both GPT-4o and o1 Preview presented equitable metrics, maintaining a stable balance between precision and recall while managing real-time diagnostic scenarios. While possessing less advanced capabilities, GPT-3.5 remained functional for standard diagnostic duties. Ultimately, this investigation outlines the current capabilities and constraints of utilizing LLMs for clinical determination. Even though architectures like GPT-4 and Gemini show significant capability, critical barriers regarding data confidentiality, ethical protocols, and training bias correction must still be overcome. These insights offer strategic directions for the ethical incorporation of LLMs into diagnostic frameworks to optimize patient care outcomes.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2022 | Article: 19

Towards Trustworthy Brain Tumor Diagnosis: An Explainable Deep Learning Framework for MRI Analysis
Among the most critical and fatal medical conditions are brain malignancies, making early identification vital for enhancing survival rates. Currently, magnetic resonance imaging (MRI) stands as the premier diagnostic tool for early detection because of its exceptional capability to capture soft tissue details. Nevertheless, relying solely on human interpretation of brain MRI scans introduces risks of oversight, which are frequently exacerbated by the fatigue and varying expertise of radiologists. To mitigate these limitations, computer-aided diagnosis (CAD) systems have taken on an increasingly vital role. Leveraging state-of-the-art computer vision methodologies like deep learning, these systems generate highly precise diagnoses from clinical imagery, thereby boosting both precision and consistency in clinical settings. This study introduces an innovative CAD architecture designed for multi-class classification of brain malignancies. The system evaluates six pre-trained deep learning networks as its foundational architecture, integrating robust data preprocessing and augmentation protocols to optimize computational throughput. To counter the opaque "black box" nature of deep learning architectures and improve interpretability, Gradient-weighted Class Activation Mapping (Grad-CAM) is integrated to illuminate the network's deductive steps when identifying anomalies in MRI data. Furthermore, an accessible, web-based Brain Tumor Detection System was constructed using the Streamlit framework, highlighting its utility for clinical environments and offering meaningful support to medical professionals. All experimental simulations were carried out using an open benchmark repository, proving that the introduced system delivers state-of-the-art diagnostic capabilities, achieving accuracy levels near 99% with the ResNet-50, Xception, and InceptionV3 architectures.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2024 | Article: 45