Transparent Intelligence Publishing Transparent Intelligence Publishing

Search

Search results:
An Explainable EfficientNet-ResNet Framework for Automated Breast Ultrasound Lesion Classification
Breast cancer represents a leading cause of mortality among women. Consequently, early detection is crucial for effective screening and reducing the overall death rate. Therefore, the development of computer-aided diagnosis systems is essential for identifying breast cancer in its initial stages. Because of its affordability, ultrasound serves as a vital examination tool for breast cancer diagnosis. Although numerous learning-based methods have recently been introduced to categorize breast cancer using the breast ultrasound imaging (BUSI) dataset, manual processing remains a difficult and highly time-consuming task. This study presents an XAI-based framework utilizing an EfficientNet-integrated ResNet deep network to precisely categorize breast cancer as either benign or malignant. Initially, data augmentation is applied to expand the training sample size. To achieve this, three-pixel flip mathematical equations are implemented: horizontal, vertical, and 90°. Subsequently, two pre-trained deep learning models are utilized, selectively skipping specific layers before fine-tuning. These adjusted models are then trained via a deep transfer learning process to extract features from their deeper layers. The performance of these trained models is evaluated utilizing explainable artificial intelligence (XAI). Following this, a novel feature selection approach known as cuckoo search controlled standard error mean is introduced, which is grounded in the cuckoo search algorithm. This method isolates the optimal features, which are then combined using a novel parallel zero-padding maximum correlated coefficient fusion technique. Finally, the selection algorithm is re-applied to the integrated feature vector prior to classification via machine learning algorithms. Experimental evaluations of the proposed framework, performed on the publicly accessible BUSI dataset, achieved accuracies of 98.4% and 98% across two distinct experiments. Comparisons with contemporary techniques demonstrate that the proposed framework offers enhanced accuracy. Furthermore, it requires less execution time compared to the standalone original deep learning models.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2022 | Article: 5

Machine Learning-Driven Obesity Classification and Tailored Treatment Recommendations
As a leading risk factor for chronic illnesses, obesity highlights the critical need for prompt diagnosis and active management. This research introduces an innovative expert system developed to precisely categorise obesity severity and offer individualised treatment advice. Utilising the SEMMA data mining framework alongside the tidymodels ecosystem, the study assessed five machine learning algorithms: decision tree, random forest, multinomial logistic regression (MLR), Naive Bayes, and support vector machine (SVM). Achieving the highest predictive accuracy (97.48%), MLR was chosen as the definitive model. The platform incorporates an intuitive R Shiny interface, promoting seamless real-time user engagement. Treatment protocols are formulated via if-then rule-based logic to guarantee customised advice for every obesity classification. A comparative evaluation emphasises the system's exceptional diagnostic precision and its functional utility in recommending treatments. By improving accessibility—especially for marginalised rural communities—this system bolsters public health by facilitating preliminary diagnosis, specific interventions, and forward-looking obesity care.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2022 | Article: 7

Explainable AI for Automatic Detection of Equatorial Plasma Bubbles Using 2DPCA and Recursive Feature Elimination
Equatorial plasma bubbles (EPBs) represent areas of reduced electron density that develop within Earth’s ionosphere as a result of Rayleigh–Taylor instability. These formations can trigger signal scintillation, which induces signal degradation and navigation positioning inaccuracies. EPBs can be identified via imagery gathered by All-Sky Imager (ASI) networks. The present research introduces an inexpensive, automated technique for identifying EPBs within ASI datasets, suitable for real-time monitoring as well as categorization tasks. This approach couples Two-Dimensional Principal Component Analysis (2DPCA) and Recursive Feature Elimination (RFE) alongside a Random Forest machine learning classifier to construct an Explainable Artificial Intelligence (XAI) framework. This framework extracts image characteristics to automate EPB detection using minimal dimensionality, yielding a compact and exceptionally rapid-to-train model designed to discern EPBs in recorded ASI frames. A collection of 2458 images, categorized into "Event" and "Empty" classes, was assembled to construct the database. This image repository was partitioned randomly into two distinct portions: an 80% training dataset and a 20% testing dataset. The developed XAI framework achieved a marginally better detection accuracy relative to the conventional 2DPCA approach while maintaining a notably smaller structural footprint. Additionally, the execution of the proposed framework was assessed and contrasted against alternative deep learning baselines (ResNet18, Inception-V3, VGG16, and VGG19) under identical environmental conditions.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2022 | Article: 10

Bridging Hand-Crafted Features and Deep Learning Through an Explainable Shallow CNN for Medical Image Segmentation
In clinical environments, the transparency of artificial intelligence models is paramount, as understanding the rationale behind automated choices is vital. Although black-box AI frameworks exhibit remarkable efficacy, their deployment in healthcare remains impractical unless their underlying mechanisms can be clarified for medical professionals. Deep neural networks (DNNs) achieve state-of-the-art results, yet the justifications they provide are frequently incomprehensible to human observers. Conversely, traditional machine learning approaches and manually designed features extracted to capture distinct data characteristics offer greater transparency, though human constraints in feature engineering often limit their overall effectiveness. To bridge this gap, we present ExShall-CNN, a novel and transparent shallow convolutional neural network tailored for medical image analytics. This framework builds upon hand-crafted feature methodologies to preserve human interpretability, guaranteeing clear and verifiable decision-making. We introduce the explainable shallow convolutional neural network (ExShall-CNN), which merges the high performance of sophisticated deep architectures like U-Net with the inherent clarity of hand-crafted features for segmenting medical images. Grounded in contemporary machine learning progress, ExShall-CNN integrates widely utilized kernels while maintaining structural openness, allowing medical practitioners to visually inspect and comprehend its outputs. This balanced strategy delivers the precision expected of deep learning paradigms alongside the explainability required for clinical deployment.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2022 | Article: 12

Brain-Wide Mental State Analysis Using Explainable Shallow Neural Networks on HCP fMRI Data
Artificial neural networks (ANNs) have frequently been deployed for classification objectives within functional magnetic resonance imaging (fMRI) research, though such analyses traditionally isolate only specific regional sub-volumes of the brain. Recent methodology has integrated shallow neural networks (SNNs) with explainable artificial intelligence (xAI) frameworks to uncover underlying mechanisms of neural processing. Although prior research validated this paradigm utilizing fMRI data from motor execution tasks, the current investigation implements this framework on Theory of Mind (ToM) cognitive tasks, leveraging data extracted from the Human Connectome Project (HCP) Young Adult repository. Cognitive paradigms introduce greater computational complexity due to the fundamentally non-linear dynamics of neural functions. The HCP multimodal parcellation brain atlas is utilized to partition the cortex, thereby guiding the systematic training, pruning, and subsequent retraining of an SNN. Shapley values are subsequently computed to decode the retrained architecture, with the resulting outputs benchmarked against a General Linear Model (GLM) analysis for empirical validation. The baseline network demonstrated a classification accuracy of 88.2%, which decreased to 80.0% following network pruning, and subsequently recovered to 84.7% after the retraining phase. The SHAP-derived explanations demonstrated strong convergence with both GLM observations and established neuroanatomical regions associated with ToM. This fMRI investigation effectively navigated a highly complex cognitive paradigm, illustrating the efficacy of explainability techniques in deciphering non-linear neurological dynamics. These outcomes indicate that xAI platforms, particularly knowledge extraction frameworks, offer substantial utility for progressing mental health research and neural state decoding applications.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2022 | Article: 13

Enhanced MINDWALC Node Classification for Explainable Knowledge Graph Analytics
This research investigates and refines the MINDWALC node classification algorithm, specifically targeting its capacity to extract human-interpretable decision trees from knowledge graph (KG) architectures. We propose techniques to tailor MINDWALC for environments where the knowledge graph is bifurcated into internal background knowledge (domain-specific data) and instance knowledge (specific case data). While the core logic of MINDWALC—utilizing discriminative graph walks as features—is preserved, we introduce two primary enhancements. First, we implement relation-tail merging to empower the algorithm to process relation-modified nodes. Second, we propose flexible walking depths that, when combined with the original MINDWALC strategy, improve the detection of commonalities between node instances. Our findings suggest that these flexible walks can markedly increase classification accuracy in hierarchical or incomplete tree-like graphs, though performance varies on more heterogeneous KG structures. Ultimately, this work demonstrates that our refinements significantly boost MINDWALC’s utility in tree-structured environments, allowing the system to use background knowledge to bridge gaps in instance data in a transparent way. Initial evaluations on medical toy datasets suggest these optimizations could refine clinical decision-making, particularly in sectors requiring explainable artificial intelligence.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2022 | Article: 14

Pixel-Level Interpretability for Explainable Medical Imaging: A Comparative Evaluation against Grad-CAM
To overcome critical constraints regarding diagnostic accuracy and model transparency in medical imaging, this paper presents a novel framework termed the Pixel-Level Interpretability (PLI) model. The investigation primarily aims to benchmark PLI against Gradient-Weighted Class Activation Mapping (Grad-CAM) to attain superior localization correctness and highly detailed explainability. Operating on a VGG19 convolutional neural network infrastructure, the methodology incorporates three open-access COVID-19 chest X-ray datasets containing over 1000 categorized images; these underwent augmentation, normalization, and resizing steps to achieve generalizability and algorithmic stability. The experimental evaluation focused on vital performance metrics: structural similarity (SSIM), mean squared error (MSE), interpretability, computational speed, and diagnostic precision. The findings indicate that PLI drastically surpasses Grad-CAM across every evaluated metric. Specifically, PLI generated fine-grained, pixel-granular heatmaps that yielded reduced MSE, superior SSIM metrics, and expedited inference rates, demonstrating an capability to reveal minute diagnostic elements without sacrificing processing speed. Conversely, the explanations produced via Grad-CAM regularly lack the detailed resolution necessary for dependable clinical integration. By incorporating fuzzy logic to refine both numeric and visual explanations, PLI delivers transparent data that corresponds with clinical logic, thereby allowing healthcare professionals to execute decisions with greater certainty. Ultimately, this research validates PLI as a dependable framework for resolving deficiencies in AI explainability and clinical adoption. By simultaneously managing the dual demands of precision and transparency, PLI advances medical AI deployment and establishes a precedent for implementation within other high-stakes environments.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2022 | Article: 15

Advancing Trustworthy AI in Indian Healthcare: Ethical, Legal, and Implementation Challenges
The medical industry in India has undergone substantial evolution driven by progress in technology and infrastructure. Yet, prominent hurdles remain when addressing critical problems like inadequate medical infrastructure for the nation's massive population, restricted accessibility, a deficit of qualified practitioners, and high-quality services. Artificial intelligence (AI)-based interventions offer the possibility to ease the burden on the Indian medical network; nevertheless, incorporating reliable AI into this domain is still obstructed by moral and legal barriers. The objective of this research is to critically analyze the contemporary state of AI system engineering in Indian medical care and its alignment with the moral and legal dimensions of AI, while also pinpointing the obstacles and prospects for implementing reliable AI within the Indian medical domain. This investigation assessed 15 papers chosen from an initial pool of 1136 papers collected across two digital databases, PubMed and Google Scholar, alongside project sites. This inquiry utilizes the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR). The findings indicate that current publications primarily deployed traditional machine learning (ML) models and artificial neural networks (ANNs) for diverse operations, including drug discovery, disease monitoring networks, early sickness identification and diagnostic precision, and medical resource administration in India. This analysis uncovers a deficiency in the integration of reliable AI within Indian medical care and various obstructions linked to it. It examines pathways for engineering reliable AI within Indian medical environments, prioritizing patient protection, information confidentiality, and adherence to moral and statutory criteria.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2022 | Article: 16

Mapping Understanding through Biometric Signals: AI Approaches to Cognitive and Affective Phases
The connection between the cognitive and emotional components of comprehension has remained largely unexamined because of a shortage of dependable techniques for assessing feelings and emotions during educational activities. Concentrating on five distinct stages of comprehension—nascent understanding, misunderstanding, confusion, emergent understanding, and deep understanding—this investigation presents an AI-based method to assess subjective comprehension by tracking the physiological activity visible in facial expressions. To examine these stages, 103 individuals worked on 15 riddles in a remote setting while their facial expressions were video recorded. Action units (AUs) for each stage occurrence were quantified utilizing AFFDEX software. Recurring AU configurations linked to each stage were subsequently pinpointed by implementing six supervised machine learning algorithms. Unique AU configurations were identified for all five stages, with gradient boosting machine and random forest models delivering the greatest predictive precision. These outcomes indicate that physiological activity can be utilized to dependably assess comprehension. Furthermore, they propose an innovative methodology for assessing and encouraging comprehension in instructional environments, as well as designing adaptive educational technologies and tailored learning interventions. Future research should investigate how the physiological indicators of comprehension stages simultaneously mirror and impact their related cognitive workflows, alongside the generalizability of these outcomes across varied demographics and educational environments (A suite of AI tools was employed in the development of this paper: (1) ChatGPT4o (for writing clarity and reference checking), (2) Grammarly (for grammar and editorial corrections), and (3) ResearchRabbit (reference management)).
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2022 | Article: 17

A Hybrid Fuzzy Multi-Criteria Decision-Making Framework for Evaluating AI-Driven Mental Health Interventions
Artificial intelligence (AI) applications in mental health possess immense potential to revolutionize clinical results, yet determining the most optimal strategies remains a persistent difficulty. This research fills this gap by assessing and establishing priorities among various AI-based mental health options. The evaluation is grounded in essential benchmarks: implementation feasibility, economic efficiency, scalability, adherence to ethical standards, user satisfaction, and overall clinical efficacy. A fuzzy multi-criteria decision-making (MCDM) framework, integrating fuzzy TOPSIS and fuzzy ARAS, was utilized to determine the ranking of the alternatives. A hybrid combination of these two approaches was subsequently implemented to reconcile variations in the results, as each methodology highlights distinct evaluative dimensions. Fuzzy TOPSIS, which privileges proximity to the ideal target, positioned the personalization of care (A5) as the primary alternative, yielding a closeness coefficient of 0.50, with user engagement (A2) following at 0.45. Similarly, fuzzy ARAS, which measures aggregate performance, ranked A5 as the leading option, demonstrating a total performance score of Si = 0.90 and a utility degree of Qi = 0.92. The integration of both frameworks offered a well-rounded analysis, wherein A5 maintained its premier ranking because of its superior performance in user satisfaction and clinical outcomes. These findings highlight the critical role that personalization and active engagement play in refining AI-enabled mental health platforms. This indicates that customized, patient-centric strategies are vital for maximizing therapeutic efficacy and sustaining user commitment.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2022 | Article: 18

Evaluating Large Language Models for Symptom-Based Medical Diagnosis: A Comparative Performance Analysis
This research undertook an assessment of Large Language Models (LLMs) within the domain of clinical diagnostics, specifically investigating their capacity to interpret symptom-centered inputs and generate precise clinical assessments. The investigation focused on evaluating several prominent architectures—including GPT-4, GPT-4o, Gemini, o1 Preview, and GPT-3.5—to gauge their proficiency in identifying clinical conditions solely from presented symptomatology. To guarantee clinical validity and appropriateness, symptom profiles were compiled from verified medical literature. Each architecture underwent testing within standardized environments to quantify diagnostic accuracy, precision, recall, and underlying logical processing. Specialized clinical scenarios were structured to examine performance boundaries across both routine and critical diagnostic conditions. The findings indicated that GPT-4 delivered the highest overall diagnostic accuracy, displaying a strong synergy with established medical logic. Conversely, Gemini demonstrated superior performance in high-stakes environments where exact decision-making is vital. Both GPT-4o and o1 Preview presented equitable metrics, maintaining a stable balance between precision and recall while managing real-time diagnostic scenarios. While possessing less advanced capabilities, GPT-3.5 remained functional for standard diagnostic duties. Ultimately, this investigation outlines the current capabilities and constraints of utilizing LLMs for clinical determination. Even though architectures like GPT-4 and Gemini show significant capability, critical barriers regarding data confidentiality, ethical protocols, and training bias correction must still be overcome. These insights offer strategic directions for the ethical incorporation of LLMs into diagnostic frameworks to optimize patient care outcomes.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2022 | Article: 19

A SHAP-Guided Bi-GRU Framework for Explainable Short-Term Load Forecasting in Smart Energy Systems
This research introduces an innovative prediction framework utilizing a parallel multi-input Bi-GRU structure coupled with a sliding window-based Multi-Input Multi-Output (MIMO) forecasting approach. The primary novelty centers on feature-specific Bi-GRU encoding, which independently processes historical demand, meteorological variables, and calendar indicators prior to data fusion, thereby empowering the network to more effectively capture temporal correlations across disparate data streams. In contrast to preceding models, our methodology distinctively merges a structured feature-specific Bi-GRU encoding mechanism with interpretability via SHAP analysis, providing both superior predictive fidelity and transparent algorithmic decision-making suitable for practical deployment within electrical grids. The introduced Bi-GRU MIMO architecture operates as the foundational model. To rigorously evaluate its performance, an attention-enhanced LSTM model is incorporated solely as a baseline for comparative analysis. Empirical validation using actual data from Singapore’s National Electricity Market System (NEMS) demonstrates that the Bi-GRU MIMO framework enhances forecasting accuracy by 1.64% and decreases MAE by 2.19% relative to traditional models, underscoring its capability to improve decision-making in smart grids.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2022 | Article: 20

AI in Recruitment: How Trust and Procedural Justice Influence Organizational Attraction and Intent to Apply
The escalating value placed on organizational human capital underscores the necessity for firms to optimize their systems for sourcing, evaluating, acquiring, onboarding, deploying, and retaining premium talent. Although embedding artificial intelligence (AI) within recruitment infrastructure promises unmatched workflow acceleration, operational scalability, minimized human subjectivity, and enhanced candidate sourcing, its deployment introduces distinct friction points that can degrade candidate attitudes and behavioral trajectories. Grounded in signaling and organizational justice frameworks, the deficit of interpersonal relational dynamics paired with the opaque nature of automated screening algorithms can prompt prospective candidates to question the integrity and structural fairness of the employment screening process. These institutional challenges risk modifying not only how job seekers deduce corporate principles, but also whether they choose to abandon the submission process altogether. Consequently, this investigation explores the comparative impact of AI-mediated versus human-mediated selection pathways on applicant trust, perceived procedural equity, corporate appeal, and subsequent intent to apply. Furthermore, we map the precise pathways through which trust and structural fairness mediate the link between the initial screening modality and early-stage candidate attraction and submission intentions. Data from an experimental student questionnaire indicate that job candidates view automated hiring protocols as significantly less credible, less equitable, and less appealing. Similarly, respondents exhibited depressed motivation to pursue open roles within enterprises leveraging automated recruitment architectures. Cultivating higher levels of institutional trust during the selection pathway and designing touchpoints that allow candidates to authentically showcase their professional capabilities can constructively reshape applicant attitudes and behavioral outcomes. These insights challenge the reductive assumption that operational velocity inherently yields strategic talent management success, emphasizing instead the vital role of interpersonal markers in securing top-tier talent within an automated recruitment environment.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2022 | Article: 21

Structured Assessment of AI-Assisted Systematic Reviews: Workflow and Rubric Insights
The application of Artificial Intelligence (AI) tools to assist with systematic literature reviews (SLRs) is expanding rapidly, yet researchers still lack structured frameworks for assessing and incorporating these tools into their research practices. This paper introduces and implements a rubric-based framework designed to evaluate AI toolchains across essential SLR stages, such as literature searching, screening, and data synthesis. A mixed-methods study was executed with 63 postgraduate student researchers, who represent the early-stage investigators that serve as primary adopters of these digital workflows. The results demonstrate that workflows structured around the rubric enhanced the participants' perceived utility of AI utilities, provided organized criteria for comparative analysis, and promoted greater transparency during tool selection. Although formal indicators of inter-rater reliability (such as Cohen’s or Fleiss’ Kappa) were not calculated due to the fact that participants did not evaluate identical benchmark sets concurrently, the consistency of the rubric was qualitatively validated through pilot evaluations, iterative updates, and structured focus group discussions. These efforts confirm interpretative alignment among users while recognizing that future validation via independent assessors is required. This research contributes a validated assessment rubric, an operational example of an AI-augmented SLR workflow, and a discussion regarding the consequences for research training, study reproducibility, and cross-disciplinary translation.
Journal of Trustworthy and Explainable Intelligent Systems
Review | Open access | 15 September 2022 | Article: 22

Enhancing Transparency in Spatial PM₂.₅ Prediction over Singapore through Explainable Machine Learning
The climate system is heavily influenced by aerosols through direct and indirect pathways, notably the absorption and scattering of radiant energy. Beyond climate impacts, these particles compromise atmospheric visibility and jeopardize public health. Specifically, human populations face exposure to fine particulate matter PM2.5, a major driver of respiratory and cardiovascular pathologies. Long-term modifications in PM levels are generally governed by emission shifts and meteorological patterns, whereas short-term fluctuations are predominantly dictated by immediate weather dynamics. Surface variations in PM2.5 levels are further driven by environmental variables such as temperature, wind velocity, relative humidity, and vegetative coverage.Air quality forecasting has advanced significantly through the application of machine learning. This research explores PM2.5 estimation by utilizing these environmental and meteorological metrics as spatiotemporal inputs. This study evaluates seven years (2014–2021) of in situ PM2.5 measurements gathered from five distinct monitoring stations across Singapore, establishing a baseline dataset for spatial modeling.The primary contribution of this paper is a novel predictive architecture tailored for temporal analysis, utilizing Random Forest (RF), Gradient Boosting (GB) regression, and the Tree-based Pipeline Optimization Tool (TP) Auto ML framework, which optimizes via a meta-heuristic genetic algorithm. The TP model demonstrated strong predictive capabilities, achieving a peak Global Performance Index (GPI) of 7.4 in August 2016 and a minimum value of −0.6 in June 2019. These metrics highlight the robust nature of the TP framework; its negative values remained superior to competing models, indicating less pessimistic errors. Finally, the underlying logic of these machine learning systems is clarified using eXplainable Artificial Intelligence (XAI) methods, which validate the integrity of feature importance and offer deeper insights into the cyclical variations of PM2.5 concentrations.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2025 | Article: 61

Towards Explainable Deep Reinforcement Learning: Interpreting Experience Replay through SHAP
Although Reinforcement Learning (RL) exhibits significant potential for refining intricate control and decision-making systems, Deep Reinforcement Learning (DRL) suffers from a distinct lack of explainability. This limitation restricts its deployment within highly regulated domains, including manufacturing, finance, and healthcare. The opacity of DRL decision-making introduces structural challenges that impede operational efficiency and resource management—an issue that intensifies alongside ongoing algorithmic advancements. While current trends favor transitioning from traditional Experience Replay configurations to A3C architectures, the latter imposes substantially greater resource demands. Furthermore, despite continuous efforts to refine selection mechanisms within Experience Replay, repository capacities generally remain elevated. In this study, we evaluate a Deep Convolutional Q-learning agent across 20 Atari environments while deliberately downsizing the Experience Replay capacity from 1×106 to 5×102. Our findings indicate that lowering the capacity from 1×104 to 5×103 does not meaningfully degrade performance rewards, thereby establishing a viable strategy for resource-efficient DRL frameworks. To clarify agent choices and correlate them with inherent game mechanics, we introduce a novel methodology: visualizing the Experience Replay mechanism utilizing the Deep SHAP Explainer. This framework enhances domain comprehension and delivers transparent, interpretable accounts, though capacity constraints must be managed carefully to mitigate overfitting. Ultimately, this research validates the practicality of minimizing Experience Replay storage and supports the integration of transparent explanations via the Deep SHAP Explainer to advance resource conservation.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2025 | Article: 65

Explainable Machine Learning for COVID-19 Prognosis: Assessing Variant Influence and Clinical Risk Factors
Machine learning (ML) techniques have been applied in diverse manners to combat the COVID-19 pandemic. Predictive ML models have been constructed, for example, for both diagnostic and prognostic objectives, utilizing varying data modalities such as textual, visual, and structured formats. Because of the distinct characteristics of this disease and its temporal transformation, a comprehensive understanding of the central elements driving the clinical trajectory of COVID-19 in individual patients remains incomplete. Throughout all phases of this study, a medical specialist was actively engaged via a human-in-the-loop framework. This collaborative element represents a vital yet frequently overlooked component of the ML and knowledge extraction (KE) workflow. Our findings indicate that explainable artificial intelligence (XAI) can offer substantial reinforcement to this dimension of ML and KE. This investigation centered on employing ML for knowledge extraction across two distinct operational scenarios. In the initial scenario, we sought to determine if integrating data regarding the dominant COVID-19 variant affects the predictive performance of the ML models. In the subsequent scenario, we concentrated on prognostic classification models designed to predict a patient's requirement for intensive care unit admission, integrating various XAI methodologies. We implemented nine distinct ML techniques, specifically XGBoost, CatBoost, LightGBM, logistic regression, Naive Bayes, random forest, SGD, SVM-linear, and SVM-RBF. The predictive quality of these models was evaluated using precision, accuracy, and AUC metrics. Following this evaluation, knowledge extraction was performed on the highest-performing models through two discrete pathways: (a) automated feature extraction using forward stepwise selection (FSS); and (b) the identification of attributes and their interactions using model explainability tools. Both sets of features were evaluated against a baseline configuration of attributes selected a priori by medical professionals using domain expertise. Our empirical tests demonstrated that incorporating data on the prevailing COVID-19 variant did not alter the performance of the generated ML models. Furthermore, the results indicated that human medical experts displayed significantly higher precision in identifying meaningful attributes compared to the automated FSS approach. Explainability tools identified nearly identical sets of attributes as the medical expert, while additionally uncovering noteworthy attribute interactions that the specialist subsequently evaluated from a clinical perspective. The outcomes of this investigation and their broader implications are examined.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2025 | Article: 66

Interactive Explainable Fair Machine Learning: A Human-in-the-Loop Framework for Bias Detection and Mitigation
The expansion of machine-learning frameworks into sectors with significant end-user consequences has heightened concerns regarding the equity of trained models, particularly the necessity of preventing biases that disadvantage distinct demographic sub-groups. The majority of current bias-mitigation techniques adjust the relative weight of data observations during the pre-processing phase. Because fairness depends heavily on context, we support an interactive machine-learning strategy that empowers human supervisors to offer iterative guidance for model refinement. To this end, we adapt the explanatory interactive machine-learning framework Caipi for equitable machine learning. This modified approach, FairCaipi, integrates human-in-the-loop interventions regarding both model predictions and underlying explanations to enhance model equity. Empirical outcomes indicate that FairCaipi outpaces a state-of-the-art pre-processing bias mitigation strategy in both the equity metrics and the predictive accuracy of the resulting machine-learning framework. We show that FairCaipi serves to expose and minimize algorithmic bias in machine-learning architectures while simultaneously identifying underlying human bias.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2025 | Article: 68

Designing Transparent Public Sector AI Systems: Lessons from the UK Algorithmic Transparency Standard
With the introduction of the Algorithmic Transparency Standard, UK authorities have renewed their emphasis on increasing operational openness for automated tools within public administration. This framework demonstrates that the UK is progressing its artificial intelligence regulatory goals while ensuring these benchmarks are grounded in the practical, real-world experiences of operators to achieve uniform, widespread integration. By utilizing a dual-level reporting structure, the Standard encourages inclusive disclosure tailored to different groups, thereby strengthening confidence among varied institutional and public actors. Furthermore, deploying these protocols across public agencies will likely serve as a blueprint for broader corporate benchmarks, guiding compliance models within commercial markets. This paper delivers a structured analysis and critique of the policy document.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2025 | Article: 71

What Makes Artificial Intelligence Worthy of Trust? A Systematic Review of Transparency, Robustness, Fairness, Privacy, Accountability, and Human Oversight
Artificial intelligence increasingly informs consequential decisions, yet high predictive performance alone does not establish that an intelligent system is worthy of trust. This systematic review examines trustworthy AI as a multidimensional, socio-technical, and lifecycle-dependent research domain. It synthesises selected peer-reviewed journal evidence addressing transparency, interpretability, explainability, robustness, safety, privacy, security, fairness, accountability, governance, and meaningful human oversight. The review applies predefined questions, eligibility principles, trustworthiness-dimension mapping, claim-level evidence extraction, and cross-dimensional synthesis without undertaking meta-analysis or inventing quantitative screening results. The evidence indicates that transparency and explanation must be assessed in relation to fidelity, stability, completeness, usefulness, stakeholder needs, contestability, recourse, and the practical authority of human overseers. Robustness and safety require evaluation under adversarial conditions, uncertainty, context shift, system failure, and residual risk, while privacy-preserving approaches must still be examined for leakage, cybersecurity vulnerabilities, and governance limitations. Fairness depends on context-sensitive definitions, bias identification, distributional consequences, documentation, responsibility allocation, auditability, and institutional mechanisms for correction. Cross-dimensional analysis reveals persistent tensions between transparency and privacy, explainability and security, automation and human control, and performance and fairness. Important gaps remain in multidimensional evaluation, realistic human-oversight studies, explanation-usefulness validation, lifecycle monitoring, accountability operationalisation, stakeholder participation, and foundation-model assurance. The review contributes an integrated evidence synthesis showing that AI worthiness of trust should be supported through coordinated technical validation, human-centred assessment, institutional governance, and continuing monitoring rather than inferred from any isolated property.
Journal of Trustworthy and Explainable Intelligent Systems
Review | Open access | 15 March 2025 | Article: 74

Beyond Opening the Black Box—A Critical Review of Explainability for Human Understanding, Decision Usefulness, Trust Calibration, and Accountability
Explainability has become central to discussions of trustworthy and responsible intelligent systems, yet it is frequently reduced to the technical production of information about model structure, features, rules, or predictions. This critical review examines why opening a computational black box is not equivalent to producing an explanation that people can understand or use responsibly. The review synthesises conceptual, technical, human-centred, decisional, and accountability-oriented scholarship to evaluate the shift from model interpretability toward meaningful explanation. It distinguishes technical properties such as transparency, fidelity, plausibility, completeness, stability, and local or global scope from human outcomes such as comprehension, cognitive accessibility, mental-model development, decision usefulness, calibrated trust, and appropriate reliance. It further examines how explanations may produce overreliance, underreliance, automation bias, false reassurance, cognitive overload, or explanation mismatch when their content and presentation are not aligned with users, tasks, uncertainty, and decision consequences. From an accountability perspective, explanations may contribute to auditability, traceability, contestability, and recourse, but they cannot independently assign responsibility, provide institutional authority, or guarantee effective remedies. The main contribution is a human-centred critical synthesis that treats explainability as a socio-technical achievement rather than a model output. Meaningful explanation requires technical credibility, cognitive accessibility, contextual relevance, decision-sensitive evaluation, uncertainty communication, opportunities for challenge, and governance mechanisms capable of acting on explanatory evidence. The review therefore rejects universal explanation-sufficiency claims and identifies conditions under which explanations may assist understanding and responsible decision use without being treated as proof of trustworthiness, accountability, fairness, safety, or deployment readiness.
Journal of Trustworthy and Explainable Intelligent Systems
Review | Open access | 15 March 2025 | Article: 75

Making AI Decisions Answerable: A Governance Framework for Transparency Duties, Auditable Evidence, Contestability, Human Review, and Meaningful Redress
Artificial intelligence decisions are often described as explainable when a system can produce reasons, feature contributions, counterfactuals, or other interpretive outputs. Such outputs, however, do not by themselves make an institutional decision answerable. This article develops a conceptual explainable AI governance framework that treats explainability as an organizational obligation connected to transparency duties, system documentation, evidence preservation, auditability, responsibility allocation, contestability, human review, and redress. The framework distinguishes technical explanation from the governance capacities required to identify who must justify a decision, what information must be recorded, how evidence can be examined, how affected stakeholders may challenge an outcome, and whether an organization can correct errors or remediate consequences. Transparency and documentation are organized around system, model, data, dataset, and decision records, together with data, model, and decision provenance. Auditability is connected to traceability, lifecycle records, risk documentation, monitoring, incident response, and clearly allocated organizational responsibility. Contestability is connected to decision justification, appeal and complaint pathways, competent and sufficiently independent human review, escalation, correction, recourse, and redress capacity. The framework also identifies governance gaps that arise when these functions are separated across the AI lifecycle, including documentation, evidence-trail, accountability, human-review, monitoring, and remediation gaps. Its principal contribution is an answerability-oriented governance architecture that links explanation to institutional evidence and response mechanisms while preserving explicit boundaries: transparency does not independently establish accountability, auditability does not prove responsibility, human involvement does not guarantee meaningful review, and a conceptual governance framework does not establish legal compliance, procedural fairness, ethical sufficiency, or deployment readiness.
Journal of Trustworthy and Explainable Intelligent Systems
Review | Open access | 15 March 2026 | Article: 78

Can Foundation Models Be Trusted? A Scoping Review of Interpretability, Hallucination, Uncertainty, Alignment, Evaluation, and Human Oversight
Foundation models have expanded the scope of artificial intelligence by supporting language generation, multimodal reasoning, knowledge-intensive assistance, decision support, and adaptable downstream applications. Their broad capabilities, however, do not establish that their outputs, explanations, internal processes, or deployment arrangements are trustworthy. This scoping review maps the research landscape concerning foundation-model trustworthiness across interpretability, explanation capabilities, hallucination, uncertainty, reliability, alignment, evaluation, and human oversight. The review uses structured search concepts, eligibility principles, evidence extraction, and dimension-based mapping to examine how peer-reviewed scholarship characterizes foundation models as general-purpose intelligent systems and how trustworthiness evidence is distributed across technical, human-centered, organizational, and governance domains. The synthesis indicates that interpretability methods can expose selected behavioral or representational features but do not independently demonstrate explanation fidelity, usefulness, or safety. Hallucination and factuality research identifies persistent risks involving fabrication, unsupported claims, weak grounding, and persuasive misinformation, while uncertainty methods remain constrained by calibration, context shift, and user-communication challenges. Alignment and post-training techniques may shape preferred behaviors but retain risks associated with proxy objectives, preference representation, and residual failure. Benchmarking, human evaluation, stress testing, and oversight provide partial evidence, yet their value depends on construct validity, domain relevance, intervention capacity, accountability, and lifecycle monitoring. The research landscape is therefore fragmented across disciplines and frequently model-centred rather than socio-technical. Key priorities include stronger foundation-model interpretability validation, consistent hallucination measurement, usable uncertainty communication, externally valid evaluation, meaningful oversight testing, multimodal analysis, and lifecycle governance. The review contributes an integrated evidence map while emphasizing that no single trustworthiness dimension certifies safety, reliability, accountability, or deployment readiness.
Journal of Trustworthy and Explainable Intelligent Systems
Review | Open access | 15 March 2026 | Article: 80

Why Explainable AI Is Adopted, Ignored, or Misused—A Realist Review of Contexts, Trust Mechanisms, Human Responses, and Decision Outcomes
Explainable artificial intelligence is often presented as a means of making intelligent systems more understandable, trustworthy, and usable, yet explanation availability does not reliably produce adoption, appropriate reliance, accountability, or improved decisions. This realist review examines why explainable AI is adopted, ignored, rejected, discontinued, overused, underused, or misused across organizational, professional, technical, and decision settings. It applies context–mechanism–outcome reasoning to interpret how explanation design interacts with workflow integration, user and domain expertise, decision risk, organizational incentives, governance arrangements, and human-oversight conditions. The synthesis focuses on mechanisms including perceived transparency, cognitive accessibility, mental-model formation, perceived usefulness, trust calibration, accountability confidence, contestability awareness, algorithm aversion, algorithm appreciation, automation bias, and explanation overload. These mechanisms may support selective reliance and meaningful challenge, but they may also generate false reassurance, superficial compliance, defensive rejection, or uncritical dependence. The review distinguishes adoption from acceptance, trust from trustworthiness, reliance from appropriate reliance, and explanation usefulness from decision quality. It identifies plausible configurations in which professional expertise, uncertainty communication, traceability, feedback, and contestability support careful use, while poor workflow fit, limited accessibility, weak governance, and automation pressure suppress scrutiny or encourage misuse. The main contribution is a bounded realist synthesis and design agenda for evaluating explainable AI through context-sensitive human responses and decision outcomes rather than explanation availability alone. The configurations are explanatory propositions requiring human-centered, organizational, and decision-context validation; they are not universal causal laws, implementation protocols, or evidence of deployment readiness.
Journal of Trustworthy and Explainable Intelligent Systems
Review | Open access | 15 March 2026 | Article: 82

Making Machine Reasoning Open to Question: An Integrative Review of Causal, Neuro-Symbolic, Knowledge-Grounded, and Uncertainty-Aware Explainability
Explainable artificial intelligence increasingly seeks to provide more than visualisations of feature importance or simplified descriptions of model outputs. For intelligent systems used in consequential settings, machine reasoning should be open to questioning, inspection, contextualisation, correction, and evaluation under uncertainty. This integrative review examines emerging approaches that may support this broader objective. It connects causal explainability and counterfactual reasoning with neuro-symbolic intelligence, knowledge-grounded inference, uncertainty-aware explanation, reliability evaluation, and human-centred interpretability. The review uses a structured integrative approach to compare how these paradigms represent causes, alternatives, rules, concepts, knowledge sources, inferential steps, confidence, and limitations. Causal and counterfactual approaches can support questions about mechanisms, contrasts, interventions, actionability, and recourse, but their conclusions depend on explicit assumptions, feasible alternatives, and appropriate causal evidence. Neuro-symbolic and knowledge-grounded approaches can make concepts, relations, rules, provenance, and intermediate reasoning more traceable, although symbolic structure or retrieved knowledge does not automatically ensure faithful, valid, or truthful explanation. Uncertainty-aware approaches can qualify predictions and explanations through uncertainty characterisation, calibration, confidence communication, robustness assessment, and human interpretation, but uncertainty estimates alone do not establish reliability. The synthesis indicates that no individual paradigm is sufficient. More defensible machine reasoning requires complementary evaluation of explanation fidelity, causal plausibility, knowledge validity, reasoning traceability, uncertainty communication, cognitive accessibility, contestability, and lifecycle accountability. Important research opportunities concern causal validation, feasible recourse, provenance governance, explanation uncertainty, hybrid-system evaluation, human-centred testing, and cross-paradigm assessment. The review contributes an integrated account of how machine reasoning may become not merely visible, but meaningfully open to question.
Journal of Trustworthy and Explainable Intelligent Systems
Review | Open access | 15 March 2026 | Article: 83

Responsible Foundation Models Need More Than Alignment: A Governance and Technical Safeguard Framework for Explainability, Reliability, Human Control, and Institutional Accountability
Foundation models are increasingly embedded in information access, content production, analysis, communication, and decision-support processes. Their broad capabilities have intensified interest in alignment, yet alignment alone cannot establish responsible use. A model may appear responsive to instructions or preferences while remaining opaque, weakly grounded, unreliable under changing conditions, overconfident, difficult to contest, or insufficiently governed. This article proposes a conceptual governance and technical safeguard framework for responsible foundation models. The framework treats foundation models as components of decision infrastructure situated within socio-technical and institutional environments rather than as isolated predictive tools. It integrates eight interdependent areas: model and alignment safeguards; explainability and interpretability; knowledge grounding and provenance; reliability, uncertainty, and hallucination containment; human control and escalation; institutional accountability; auditability and documentation; and lifecycle monitoring and governance updating. Explainability requirements are differentiated from interpretability, transparency, explanation usefulness, and human understanding, while knowledge grounding is separated from factuality, truthfulness, source quality, and provenance. Reliability is addressed through calibration, robustness assessment, boundary testing, uncertainty communication, failure containment, and continuing monitoring. Human oversight is defined through authority, competence, review capacity, escalation pathways, contestability, and recourse rather than nominal human presence. Institutional responsibility is connected to role allocation, evidence trails, documentation, review authority, and consequences. The principal contribution is an integrated framework that clarifies how technical and governance safeguards may support responsible foundation-model assessment without treating alignment, explanation, grounding, testing, oversight, or auditing as independently sufficient. The framework requires empirical validation, domain-specific evaluation, human-centred assessment, institutional governance, and residual-risk management before it can inform consequential operational decisions.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2026 | Article: 84

Ground, Qualify, Verify, and Abstain—A Safety Framework for Hallucination Control, Evidence Grounding, Uncertainty Communication, and Decision Boundaries in Generative AI
Generative artificial intelligence can produce fluent, context-sensitive, and apparently authoritative responses even when relevant knowledge is incomplete, evidence is unavailable, or generated claims are false. This creates an epistemic safety problem concerning not only what a system produces, but also what it appears to know, how its claims are supported, how uncertainty is expressed, and when answering should be limited. This article develops a conceptual safety framework organized around four operational principles: ground, qualify, verify, and abstain. The framework treats hallucination as a multidimensional risk involving fabrication, factuality failure, groundedness failure, unsupported claims, false confidence, source and context errors, reasoning errors, citation errors, overgeneralization, confabulation, speculative output, and incomplete evidence. Grounding links material claims to relevant and sufficiently reliable evidence; qualification communicates uncertainty, assumptions, scope, and evidential limitations; verification examines claims, sources, citations, and inferential consistency; and abstention enables refusal, deferral, escalation, or constrained output when evidence or system competence is insufficient. Human review, meaningful oversight, decision boundaries, failure containment, incident monitoring, and lifecycle updating operate across these principles rather than functioning as final guarantees. The main contribution is an integrated generative AI safety framework that connects output-level hallucination control with source quality, knowledge verification, uncertainty communication, review quality, response limitation, and downstream risk containment. The framework is intended to structure domain-specific assessment and future research. It does not independently establish factual reliability, ethical sufficiency, legal compliance, operational safety, certification, or deployment readiness.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2026 | Article: 85

Who Controls the Agent? A Conceptual Architecture for Governing Goals, Tool Use, Memory, Action Verification, and Human Override in Agentic AI
Agentic artificial intelligence extends beyond conventional model-output generation by interpreting objectives, decomposing tasks, maintaining contextual information, selecting tools, interacting with external environments, and executing sequences of actions that may create downstream consequences. These capabilities complicate the question of who controls an agent and expose limitations in governance approaches based only on alignment, instruction following, output review, or nominal human supervision. This article develops a conceptual governance architecture for trustworthy agentic AI. The approach treats agentic AI as an autonomous decision system embedded within a wider socio-technical environment and organizes governance around explicit control points rather than a single supervisory mechanism. It distinguishes governance requirements for goal formation, goal interpretation, instruction hierarchy, task boundaries, tool access, memory retention, environmental interaction, action verification, failure containment, human approval, override capacity, responsibility allocation, auditability, and lifecycle review. The architecture proposes that consequential actions should be connected to authorized goals, bounded permissions, traceable memory and data inputs, pre-action checks, post-action evaluation, escalation pathways, and accountable human or institutional actors. It also establishes explicit sufficiency boundaries: goal alignment does not guarantee appropriate behavior; tool restrictions do not eliminate harmful use; memory controls do not guarantee reliable context; verification does not certify safe action; and human override does not independently establish meaningful control. The principal contribution is an integrated architecture-level account of how technical, human, and organizational controls may be connected across the agent lifecycle. The architecture supports conceptual analysis, governance planning, and future empirical evaluation, but does not establish legal compliance, operational safety, ethical sufficiency, institutional accountability, or deployment readiness.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2026 | Article: 86

Following the Evidence Across Modalities: A Conceptual Architecture for Explainability in Text, Vision, Audio, Sensor, and Structured-Data Intelligent Systems
Multimodal intelligent systems combine evidence from text, vision, audio, sensors, and structured data, but their explanations often remain fragmented into separate saliency maps, feature scores, textual rationales, attention visualisations, or confidence indicators. Such outputs may describe isolated aspects of a model while obscuring how modality-specific evidence was represented, transformed, fused, and communicated. This article develops a conceptual multimodal explainability architecture organised around the principle of following evidence across modalities. The approach begins by distinguishing the evidential and representational characteristics of textual, visual, acoustic, temporal-sensor, and structured inputs. It then identifies attribution difficulties created by early, intermediate, late, and hybrid fusion, including modality dominance, missing evidence, conflicting inputs, representation alignment, and uncertainty about joint contributions. Evidence traceability is treated as an end-to-end requirement connecting input provenance, modality-specific representation, fusion operations, attribution processes, consistency assessment, uncertainty communication, and decision explanation. The architecture further incorporates human interpretation because technically detailed multimodal explanations may remain cognitively inaccessible, visually persuasive, incomplete, or poorly calibrated to user expertise and decision context. Its central contribution is a layered framework linking modality inventory, evidence classification, representation mapping, fusion attribution, provenance, consistency review, human-centred presentation, evaluation, and feedback updating. The architecture is intended to structure research and design reasoning rather than prescribe a particular model, explanation technique, evaluation metric, or deployment procedure. It does not establish that an explanation is faithful, that users understand it, that reliance is appropriate, or that the underlying intelligent system is trustworthy or ready for operational use.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2026 | Article: 87

From Prediction to Intervention: A Causal Explainability Framework for Counterfactual Reasoning, Mechanism Discovery, Confounding Control, and Decision Validity
Explainable artificial intelligence increasingly supports decisions whose consequences extend beyond prediction, yet many explanations remain grounded in associations, feature contributions, saliency, or local perturbations. Such outputs may clarify model behaviour without establishing what would happen under intervention, why an outcome arose through a particular mechanism, or whether a proposed change is feasible and decision-valid. This article develops a conceptual causal explainability framework for moving from prediction-oriented explanation toward intervention-aware reasoning. The framework begins by separating predictive, associative, and model-behaviour claims from causal questions. It then connects explicit causal assumptions with causal structures, mechanistic reasoning, interventional explanation, counterfactual reasoning, confounding assessment, identifiability, sensitivity, external validity, uncertainty communication, and human interpretation. Particular attention is given to the distinction between model counterfactuals and real-world recourse, the risks created by unmeasured confounding, selection and collider bias, and the need to define decision boundaries before explanations inform action. Human users are treated as active interpreters whose causal literacy, expertise, cognitive constraints, and susceptibility to false causal confidence affect explanation usefulness. The main contribution is an integrated framework that organizes the evidential transition from prediction to intervention while preserving explicit no-guarantee boundaries concerning causal truth, intervention validity, recourse, identifiability, human understanding, decision validity, and deployment readiness. The framework is intended to support disciplined conceptual development and evaluation planning, not to prescribe a universal causal model, intervention procedure, or operational decision system.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2026 | Article: 88