Transparent Intelligence Publishing Transparent Intelligence Publishing

Search

Search results:
Can Foundation Models Be Trusted? A Scoping Review of Interpretability, Hallucination, Uncertainty, Alignment, Evaluation, and Human Oversight
Foundation models have expanded the scope of artificial intelligence by supporting language generation, multimodal reasoning, knowledge-intensive assistance, decision support, and adaptable downstream applications. Their broad capabilities, however, do not establish that their outputs, explanations, internal processes, or deployment arrangements are trustworthy. This scoping review maps the research landscape concerning foundation-model trustworthiness across interpretability, explanation capabilities, hallucination, uncertainty, reliability, alignment, evaluation, and human oversight. The review uses structured search concepts, eligibility principles, evidence extraction, and dimension-based mapping to examine how peer-reviewed scholarship characterizes foundation models as general-purpose intelligent systems and how trustworthiness evidence is distributed across technical, human-centered, organizational, and governance domains. The synthesis indicates that interpretability methods can expose selected behavioral or representational features but do not independently demonstrate explanation fidelity, usefulness, or safety. Hallucination and factuality research identifies persistent risks involving fabrication, unsupported claims, weak grounding, and persuasive misinformation, while uncertainty methods remain constrained by calibration, context shift, and user-communication challenges. Alignment and post-training techniques may shape preferred behaviors but retain risks associated with proxy objectives, preference representation, and residual failure. Benchmarking, human evaluation, stress testing, and oversight provide partial evidence, yet their value depends on construct validity, domain relevance, intervention capacity, accountability, and lifecycle monitoring. The research landscape is therefore fragmented across disciplines and frequently model-centred rather than socio-technical. Key priorities include stronger foundation-model interpretability validation, consistent hallucination measurement, usable uncertainty communication, externally valid evaluation, meaningful oversight testing, multimodal analysis, and lifecycle governance. The review contributes an integrated evidence map while emphasizing that no single trustworthiness dimension certifies safety, reliability, accountability, or deployment readiness.
Journal of Trustworthy and Explainable Intelligent Systems
Review | Open access | 15 March 2026 | Article: 80

Making Machine Reasoning Open to Question: An Integrative Review of Causal, Neuro-Symbolic, Knowledge-Grounded, and Uncertainty-Aware Explainability
Explainable artificial intelligence increasingly seeks to provide more than visualisations of feature importance or simplified descriptions of model outputs. For intelligent systems used in consequential settings, machine reasoning should be open to questioning, inspection, contextualisation, correction, and evaluation under uncertainty. This integrative review examines emerging approaches that may support this broader objective. It connects causal explainability and counterfactual reasoning with neuro-symbolic intelligence, knowledge-grounded inference, uncertainty-aware explanation, reliability evaluation, and human-centred interpretability. The review uses a structured integrative approach to compare how these paradigms represent causes, alternatives, rules, concepts, knowledge sources, inferential steps, confidence, and limitations. Causal and counterfactual approaches can support questions about mechanisms, contrasts, interventions, actionability, and recourse, but their conclusions depend on explicit assumptions, feasible alternatives, and appropriate causal evidence. Neuro-symbolic and knowledge-grounded approaches can make concepts, relations, rules, provenance, and intermediate reasoning more traceable, although symbolic structure or retrieved knowledge does not automatically ensure faithful, valid, or truthful explanation. Uncertainty-aware approaches can qualify predictions and explanations through uncertainty characterisation, calibration, confidence communication, robustness assessment, and human interpretation, but uncertainty estimates alone do not establish reliability. The synthesis indicates that no individual paradigm is sufficient. More defensible machine reasoning requires complementary evaluation of explanation fidelity, causal plausibility, knowledge validity, reasoning traceability, uncertainty communication, cognitive accessibility, contestability, and lifecycle accountability. Important research opportunities concern causal validation, feasible recourse, provenance governance, explanation uncertainty, hybrid-system evaluation, human-centred testing, and cross-paradigm assessment. The review contributes an integrated account of how machine reasoning may become not merely visible, but meaningfully open to question.
Journal of Trustworthy and Explainable Intelligent Systems
Review | Open access | 15 March 2026 | Article: 83