CGRA-DeBERTa 概念引导残差增强变换器在伊斯兰神学理解中的应用
📄 中文摘要
针对经典伊斯兰文本的准确问答仍然面临挑战,主要由于领域特定的语义、长上下文依赖性以及概念敏感推理。因此,提出了一种新的 CGRA DeBERTa 概念引导残差领域增强变换器框架,以提升对圣训语料库的神学问答能力。CGRA DeBERTa 基于定制的 DeBERTa 变换器骨干,结合轻量级的 LoRA 适配和残差概念感知门控机制。定制的 DeBERTa 嵌入块学习全局和位置上下文,而概念引导残差块则从精心策划的伊斯兰概念词典中融入12个核心术语的神学先验。此外,概念门控机制选择性地放大语义相关性,从而提高问答的准确性和有效性。
📄 English Summary
CGRA-DeBERTa Concept Guided Residual Augmentation Transformer for Theologically Islamic Understanding
Accurate question answering (QA) over classical Islamic texts remains challenging due to domain-specific semantics, long context dependencies, and concept-sensitive reasoning. A new framework, CGRA DeBERTa, is proposed to enhance theological QA over Hadith corpora. CGRA DeBERTa builds on a customized DeBERTa transformer backbone with lightweight LoRA-based adaptations and a residual concept-aware gating mechanism. The customized DeBERTa embedding block learns global and positional context, while Concept Guided Residual Blocks incorporate theological priors from a curated Islamic Concept Dictionary of 12 core terms. Furthermore, the Concept Gating Mechanism selectively amplifies semantically relevant features, thereby improving the accuracy and effectiveness of the QA process.
Powered by Cloudflare Workers + Payload CMS + Claude 3.5
数据源: OpenAI, Google AI, DeepMind, AWS ML Blog, HuggingFace 等