Transparent Intelligence Publishing Transparent Intelligence Publishing

Search

Search results:
Bridging Hand-Crafted Features and Deep Learning Through an Explainable Shallow CNN for Medical Image Segmentation
In clinical environments, the transparency of artificial intelligence models is paramount, as understanding the rationale behind automated choices is vital. Although black-box AI frameworks exhibit remarkable efficacy, their deployment in healthcare remains impractical unless their underlying mechanisms can be clarified for medical professionals. Deep neural networks (DNNs) achieve state-of-the-art results, yet the justifications they provide are frequently incomprehensible to human observers. Conversely, traditional machine learning approaches and manually designed features extracted to capture distinct data characteristics offer greater transparency, though human constraints in feature engineering often limit their overall effectiveness. To bridge this gap, we present ExShall-CNN, a novel and transparent shallow convolutional neural network tailored for medical image analytics. This framework builds upon hand-crafted feature methodologies to preserve human interpretability, guaranteeing clear and verifiable decision-making. We introduce the explainable shallow convolutional neural network (ExShall-CNN), which merges the high performance of sophisticated deep architectures like U-Net with the inherent clarity of hand-crafted features for segmenting medical images. Grounded in contemporary machine learning progress, ExShall-CNN integrates widely utilized kernels while maintaining structural openness, allowing medical practitioners to visually inspect and comprehend its outputs. This balanced strategy delivers the precision expected of deep learning paradigms alongside the explainability required for clinical deployment.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 March 2022 | Article: 12

Building Trustworthiness into Intelligent Systems: From Data Provenance and Model Reliability to Human Control and Institutional Accountability
Intelligent systems increasingly influence decisions, allocate attention, generate recommendations, and mediate interactions across technical, organizational, and social environments. Yet trustworthiness is often approached through isolated interventions, such as improving model accuracy, adding post-hoc explanations, documenting datasets, or assigning nominal human oversight. This article proposes a trustworthy-by-design conceptual framework that treats trustworthiness as a system-level property requiring coordinated design and evaluation across the full intelligent-system lifecycle. The framework begins with system-purpose and risk-context definition, followed by stakeholder and responsibility mapping, data-integrity assessment, provenance and lineage review, data documentation and governance, model-reliability evaluation, robustness and uncertainty assessment, and bias and fairness review where relevant. It then connects explanation quality with human interpretability and decision usefulness, rather than assuming that technically generated explanations will necessarily support understanding. Human oversight, meaningful control, contestability, recourse, institutional accountability, traceability, auditability, monitoring, and feedback updating form additional interdependent layers. The framework’s principal contribution is to clarify how technical evidence must be connected to human decision conditions and institutional responsibility without treating any individual safeguard as sufficient. Data provenance does not establish data appropriateness, robustness does not prove safety, explanations do not guarantee interpretability, human presence does not ensure meaningful control, and governance arrangements do not independently establish accountability. The framework may support conceptual analysis, assurance-oriented evaluation, and lifecycle governance planning, but requires empirical validation, human-centered assessment, domain-specific interpretation, and continuing institutional review.
Journal of Trustworthy and Explainable Intelligent Systems
Original Research | Open access | 15 September 2025 | Article: 76