Transparent Intelligence Publishing Transparent Intelligence Publishing

Search

Search results:
Evaluating Large Language Models for Symptom-Based Medical Diagnosis: A Comparative Performance Analysis
This research undertook an assessment of Large Language Models (LLMs) within the domain of clinical diagnostics, specifically investigating their capacity to interpret symptom-centered inputs and generate precise clinical assessments. The investigation focused on evaluating several prominent architectures—including GPT-4, GPT-4o, Gemini, o1 Preview, and GPT-3.5—to gauge their proficiency in identifying clinical conditions solely from presented symptomatology. To guarantee clinical validity and appropriateness, symptom profiles were compiled from verified medical literature. Each architecture underwent testing within standardized environments to quantify diagnostic accuracy, precision, recall, and underlying logical processing. Specialized clinical scenarios were structured to examine performance boundaries across both routine and critical diagnostic conditions. The findings indicated that GPT-4 delivered the highest overall diagnostic accuracy, displaying a strong synergy with established medical logic. Conversely, Gemini demonstrated superior performance in high-stakes environments where exact decision-making is vital. Both GPT-4o and o1 Preview presented equitable metrics, maintaining a stable balance between precision and recall while managing real-time diagnostic scenarios. While possessing less advanced capabilities, GPT-3.5 remained functional for standard diagnostic duties. Ultimately, this investigation outlines the current capabilities and constraints of utilizing LLMs for clinical determination. Even though architectures like GPT-4 and Gemini show significant capability, critical barriers regarding data confidentiality, ethical protocols, and training bias correction must still be overcome. These insights offer strategic directions for the ethical incorporation of LLMs into diagnostic frameworks to optimize patient care outcomes.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2022 | Article: 19

The Anyon Hypothesis: A Topological Quantum Framework for Interpreting Large Language Models
While large language models (LLMs) demonstrate exceptional predictive capabilities, their internal reasoning mechanisms remain obscure, creating an urgent demand for enhanced interpretability in artificial intelligence. In this paper, we suggest addressing this explanatory deficit by incorporating principles from topological quantum computing (TQC), specifically the anyonic structures derived from S(2)k theories. Anyons serve as an interpolation between fermions and bosons, offering a formal mathematical paradigm that could clarify the latent configurations and decision-making pathways within LLMs. By investigating the relationships between these topological models, token interactions, and contextual dependencies within neural systems, we seek to offer an alternative viewpoint on the emergence of meaning and coherence. Drawing upon insights obtained from ChatGPT alongside an examination of low-level instances of S(2)k models, we propose that the formal machinery of modular tensor categories and topological phases could guide the development of clearer, more stable, and more resilient AI frameworks. This cross-disciplinary approach indicates that quantum-theoretic concepts may provide the foundation for a novel paradigm in explainable AI.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2024 | Article: 46

Leveraging Chain-of-Thought Prompt Engineering to Enhance Knowledge Creation through Improvable Student Ideas
Within a student learning community, the generation of new knowledge represents a vital mechanism for expanding collective understanding and driving original synthesis. Students assume critical responsibilities when they target knowledge deficiencies and engage in cooperative efforts to refine communal concepts emerging from dialogue. Nonetheless, the standard of these concepts can frequently be constrained by resource deficits or a narrow spectrum of viewpoints. The introduction of generative Artificial Intelligence and large language models (LLMs) into educational settings has unlocked new opportunities for analyzing and enriching idea-focused debates that were formerly unachievable. Maximizing the utility of LLMs necessitates specialized competencies in prompt engineering, particularly regarding the in-context methodology termed Chain-of-Thought (CoT) to formulate and scaffold progressive concepts within student conversations. This investigation gathered a dataset of 721 conversational entries—encompassing 272 applicable question–answer dynamics and 149 distinct discussion tracks—produced by 31 participants during a 2-day student Knowledge Building Design Studio (sKBDS). The researchers augmented student inputs utilizing the CoT technique and subsequently evaluated the AI-generated outputs against the original student assertions. The outcomes are demonstrated through two explicit conversational tracks, confirming that CoT-configured prompts enable LLMs to output responses that actively advance malleable concepts during knowledge construction. This inquiry examines data from genuine classroom discourse and offers actionable insights for both educational research and instructional implementation.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2024 | Article: 51

Can Foundation Models Be Trusted? A Scoping Review of Interpretability, Hallucination, Uncertainty, Alignment, Evaluation, and Human Oversight
Foundation models have expanded the scope of artificial intelligence by supporting language generation, multimodal reasoning, knowledge-intensive assistance, decision support, and adaptable downstream applications. Their broad capabilities, however, do not establish that their outputs, explanations, internal processes, or deployment arrangements are trustworthy. This scoping review maps the research landscape concerning foundation-model trustworthiness across interpretability, explanation capabilities, hallucination, uncertainty, reliability, alignment, evaluation, and human oversight. The review uses structured search concepts, eligibility principles, evidence extraction, and dimension-based mapping to examine how peer-reviewed scholarship characterizes foundation models as general-purpose intelligent systems and how trustworthiness evidence is distributed across technical, human-centered, organizational, and governance domains. The synthesis indicates that interpretability methods can expose selected behavioral or representational features but do not independently demonstrate explanation fidelity, usefulness, or safety. Hallucination and factuality research identifies persistent risks involving fabrication, unsupported claims, weak grounding, and persuasive misinformation, while uncertainty methods remain constrained by calibration, context shift, and user-communication challenges. Alignment and post-training techniques may shape preferred behaviors but retain risks associated with proxy objectives, preference representation, and residual failure. Benchmarking, human evaluation, stress testing, and oversight provide partial evidence, yet their value depends on construct validity, domain relevance, intervention capacity, accountability, and lifecycle monitoring. The research landscape is therefore fragmented across disciplines and frequently model-centred rather than socio-technical. Key priorities include stronger foundation-model interpretability validation, consistent hallucination measurement, usable uncertainty communication, externally valid evaluation, meaningful oversight testing, multimodal analysis, and lifecycle governance. The review contributes an integrated evidence map while emphasizing that no single trustworthiness dimension certifies safety, reliability, accountability, or deployment readiness.
Journal of Trustworthy and Explainable Intelligent Systems
Review | Open access | 15 March 2026 | Article: 80