Transparent Intelligence Publishing Transparent Intelligence Publishing

Search

Search results:
Bridging Hand-Crafted Features and Deep Learning Through an Explainable Shallow CNN for Medical Image Segmentation
In clinical environments, the transparency of artificial intelligence models is paramount, as understanding the rationale behind automated choices is vital. Although black-box AI frameworks exhibit remarkable efficacy, their deployment in healthcare remains impractical unless their underlying mechanisms can be clarified for medical professionals. Deep neural networks (DNNs) achieve state-of-the-art results, yet the justifications they provide are frequently incomprehensible to human observers. Conversely, traditional machine learning approaches and manually designed features extracted to capture distinct data characteristics offer greater transparency, though human constraints in feature engineering often limit their overall effectiveness. To bridge this gap, we present ExShall-CNN, a novel and transparent shallow convolutional neural network tailored for medical image analytics. This framework builds upon hand-crafted feature methodologies to preserve human interpretability, guaranteeing clear and verifiable decision-making. We introduce the explainable shallow convolutional neural network (ExShall-CNN), which merges the high performance of sophisticated deep architectures like U-Net with the inherent clarity of hand-crafted features for segmenting medical images. Grounded in contemporary machine learning progress, ExShall-CNN integrates widely utilized kernels while maintaining structural openness, allowing medical practitioners to visually inspect and comprehend its outputs. This balanced strategy delivers the precision expected of deep learning paradigms alongside the explainability required for clinical deployment.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2022 | Article: 12

Deep Learning-Based Detection of Manipulated Fundus Images: A CNN Concatenation Approach for Medical Image Integrity
The fraudulent application of image transformation methods to clinical data represents a severe hazard that can jeopardize patient safety. Consequently, identifying artificial alterations using deep learning frameworks is vital for mitigating the challenges posed by modified medical imagery in clinical environments. The experimental data were partitioned into an authentic fundus dataset and a manipulated dataset. The proposed framework for detecting fundus image modification utilizes a deep learning architecture rooted in a Convolutional Neural Network (CNN) structure, incorporating a concatenation mechanism to achieve rapid processing speeds and minimize the attenuation of input image weights. When evaluating authentic data, the system attained an average sensitivity of 0.08, precision of 1.00, F1-score of 0.99, and an AUC of 0.988. On the manipulated dataset, the framework achieved a sensitivity of 1.00, precision of 0.84, F1-score of 0.92, and an AUC of 0.988. In comparison, a panel of five ophthalmologists demonstrated lower average metrics on the altered images, yielding a sensitivity of 0.71, precision of 0.61, F1-score of 0.65, and an AUC of 0.822. This investigation highlights the potential for mitigating and preventing the complications arising from fabricated medical imagery within healthcare systems. The introduced methodology for identifying altered fundus photographs via a deep learning model outperforms human specialists, proving to be an efficient diagnostic strategy.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2023 | Article: 25

Interpretable Deep CNNs through Binary Tree Structure Convolution and Decision-Path Learning
While deep convolutional neural networks (DCNNs) have achieved substantial breakthroughs in computer vision, these models are frequently criticized for their lack of interpretability during decision-making. A core issue is that their underlying operational mechanism is generally perceived as a "black-box." To address this, the authors introduce the binary tree structure convolution (BTSC) module and control the activation thresholds of specific neurons to construct an interpretable DCNN framework. First, the authors develop the BTSC module, where every parent node branches into two distinct child layers, which are subsequently integrated into a standard DCNN architecture. The primary benefits of the BTSC module include: 1) child nodes emerging from separate parent nodes operate without mutual interference; 2) parent and child nodes are capable of knowledge inheritance. Second, by managing neural activation states, the authors design an information coding objective that directs neural nodes toward acquiring a predefined, targeted information coding scheme. Empirical evaluations demonstrate that: 1) the decisions executed by both ResNet and DenseNet models can be effectively clarified via the "decision information flow path" (termed the decision-path) established within the BTSC module; 2) this decision-path offers a logical explanation for the decision reversal mechanism (Robustness mechanism) inherent in DCNN models; 3) the reliability of a decision can be quantified by evaluating the alignment between the actual and anticipated decision-paths.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2023 | Article: 31

Multi-Task Learning and Attention-Enhanced 3D CNNs for Alzheimer's disease Classification
In recent years, deep learning has emerged as a promising framework for identifying Alzheimer's disease (AD) within clinical neuroimaging. Nonetheless, conventional architectures frequently fail to optimize feature extraction from medical scans and underutilize auxiliary data resources vital for diagnostic categorization. To resolve these challenges, this paper introduces a deep three-dimensional convolutional neural network architecture that integrates attention mechanisms with multi-task learning. An enhanced primary C3D network is deployed to generate initial, coarse low-level feature maps. This design implements a novel convolutional block tailored to capture the specific structural properties of magnetic resonance imaging (MRI) data, along with a secondary block configured to compute localized attention weights for distinct pixel coordinates within the feature map, which are subsequently combined with the map's output. Thereafter, a series of fully connected layers implements multi-task learning, producing three distinct outputs that encompass the primary classification objective. During the training phase, the two auxiliary outputs leverage backpropagation to refine and enhance the primary classification performance. Empirical results demonstrate that this proposed framework outperforms existing state-of-the-art models for AD detection, yielding superior classification accuracy and enhanced performance metrics on the Alzheimer's disease Neuroimaging Initiative dataset. These outcomes illustrate a compelling direction for prospective diagnostic classification research.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2023 | Article: 33

Explainable CNN-Based Cavitation Detection in Axial Piston Pumps Using Grad-CAM Visualization
The reliability and safety of an entire hydraulic system are compromised by the occurrence of cavitation in axial piston pumps. Because vibration signals can indicate cavitation states within these pumps, they have been increasingly coupled with machine learning techniques for detection purposes. Nevertheless, raw vibration signals captured under actual operating conditions are frequently corrupted by noise, complicating the precise identification of cavitation within noisy environments. To address this issue, this study introduces an intelligent methodology designed to identify cavitation in axial piston pumps under high-noise conditions. Initially, a convolutional neural network (CNN) is trained utilizing spectrogram images that are converted from raw, unstructured vibration datasets across varying cavitation states. Subsequently, the gradient-weighted class activation mapping (Grad-CAM) technique is applied to highlight and visualize the class-discriminative zones within these spectrogram images. Ultimately, a novel image processing approach leveraging the Grad-CAM heatmap is introduced to automatically filter out background noise and amplify the key class features in the spectrograms. The empirical outcomes demonstrate that this strategy substantially boosts the diagnostic efficacy of the CNN framework under noisy conditions. Specifically, the accuracy of cavitation condition classification is elevated from 0.50 to 0.89 at a signal-to-noise ratio of 4 dB, and from 0.80 to 0.92 at 6 dB.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2024 | Article: 55

Interpretable Deep Learning for Verbal Autopsy Analysis: A Stacked Ensemble Approach to Cause-of-Death Determination
Verbal autopsies (VA) serve as a frequent mechanism within Low- and Medium-Income Countries (LMIC) to ascertain the cause of death (CoD) for individuals who pass away outside of clinical environments, relative to the established international gold standard of physician medical certification. Field interviewers gather detailed testimonies from the families of the deceased concerning the events and circumstances preceding the fatality. This gathered information is documented in text format, referred to as VA narratives. These textual records contain granular details suitable for identifying the CoD. Nonetheless, this methodology continues to be a manual operation characterized by high costs, inconsistency, prolonged processing times, and subjectivity (making it susceptible to errors), among other limitations. Consequently, these disadvantages undermine the VA reporting infrastructure, which is otherwise crucial for defining public health agendas and populating civil registration frameworks.To address this operational gap, the present study introduces interpretable deep learning (DL) methodologies designed to analyze VA narratives and deliver CoD predictions in an efficient, transparent, economical, and precise manner. The verification of our DL models is conducted via optimization and performance accuracy machine learning (ML) curves mapped against the volume of training samples. Our models achieved training set accuracies of (LSTM = 76.11%, CNN = 76.35%, and SEDL = 82.1%), validation accuracies of (LSTM = 67.05%, CNN = 66.16%, and SEDL = 82%), and test set accuracies of (LSTM = 67%, CNN = 66.2%, and SEDL = 82%). Additionally, Local Interpretable Model-agnostic Explanations (LIME) are utilized to enhance the interpretability of the outcomes, thereby fostering confidence in automated healthcare solutions.This work offers robust deep learning strategies for CoD determination via VAs, where the stacked ensemble deep learning (SEDL) model achieved optimal performance, outperforming both Long Short-Term Memory (LSTM) and Convolutional Neural Networks (CNN). Our empirical evidence suggests that ensemble DL paradigms can be successfully integrated into the CoD classification workflow to assist medical experts in reaching a diagnosis. Ultimately, this integration aims to compress the diagnostic turnaround time for physicians reviewing the narratives, while simultaneously reducing operational expenses and mitigating human error. The scope of this study was constrained by the volume of training data required for model optimization and the substantial lexical diversity present within the unstructured text.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2025 | Article: 64