📄 中文摘要
联邦学习允许地理分散的医疗中心在保护数据隐私的同时协作训练模型。然而,数据中的领域偏移和异质性常常导致模型性能下降。医学影像应用尤其受到采集协议、扫描仪类型和患者群体差异的影响。为解决这些问题,FeTTL(联邦模板与任务学习)被提出。FeTTL通过引入联邦模板学习框架,旨在从不同机构的共享知识中提取通用表示,同时通过任务学习适应每个机构的特定数据特征。该方法的核心思想是将模型分解为可共享的模板部分和机构特定的任务部分。模板部分在所有参与机构之间进行联邦训练,以捕获跨机构的共同模式和特征,从而增强模型的泛化能力。任务部分则在每个机构本地进行训练,以学习和适应其独特的数据分布和特定任务需求,有效应对领域偏移和异质性。这种分解策略确保了模型在保持隐私的同时,能够有效利用来自多个机构的丰富数据,提高在复杂多变的医学影像环境中的鲁棒性和准确性。FeTTL通过优化联邦聚合机制,确保共享模板能够有效地整合来自不同源的数据洞察,同时避免敏感信息泄露。实验结果表明,FeTTL在处理多机构医学影像数据时的性能显著优于传统联邦学习方法,特别是在处理具有显著领域差异的数据集时,展现出卓越的适应性和泛化能力。
📄 English Summary
FeTTL: Federated Template and Task Learning for Multi-Institutional Medical Imaging
Federated learning enables collaborative model training across geographically distributed medical centers while preserving data privacy. However, domain shifts and heterogeneity in data often lead to a degradation in model performance. Medical imaging applications are particularly affected by variations in acquisition protocols, scanner types, and patient populations. To address these issues, Federated Template and Task Learning (FeTTL) is introduced. FeTTL proposes a novel federated learning framework that aims to extract generalizable representations from shared knowledge across different institutions while adapting to institution-specific data characteristics through task learning. The core idea of this method is to decompose the model into a sharable template component and institution-specific task components. The template component is federatedly trained across all participating institutions to capture common patterns and features, thereby enhancing the model's generalization capabilities. The task components are trained locally at each institution to learn and adapt to its unique data distribution and specific task requirements, effectively addressing domain shifts and heterogeneity. This decomposition strategy ensures that the model can leverage rich data from multiple institutions while maintaining privacy, improving robustness and accuracy in complex and varied medical imaging environments. FeTTL optimizes the federated aggregation mechanism to ensure that the shared template effectively integrates data insights from diverse sources while preventing the leakage of sensitive information. Experimental results demonstrate that FeTTL significantly outperforms traditional federated learning methods in handling multi-institutional medical imaging data, particularly showcasing superior adaptability and generalization when dealing with datasets exhibiting significant domain differences.
Powered by Cloudflare Workers + Payload CMS + Claude 3.5
数据源: OpenAI, Google AI, DeepMind, AWS ML Blog, HuggingFace 等