用于可微图像配准的分解Levenberg-Marquardt:FireANTs的高效优化器
📄 中文摘要
FireANTs提出了一种新颖的欧拉下降方法,适用于可微图像配准的即插即用行为,将其视为测试时优化问题,并实现了GPU加速。FireANTs默认使用Adam优化器,以实现快速且更稳健的优化。然而,Adam需要存储状态变量(即动量和平方动量估计),这些变量会消耗大量内存,限制了其在大图像上的应用。研究提出了一种改进的Levenberg-Marquardt(LM)优化器,仅需一个标量阻尼参数作为优化器状态,并通过信任区域方法自适应调整。该优化器在内存使用上减少了高达24%的需求,适用于更大规模的图像处理。
📄 English Summary
Factored Levenberg-Marquardt for Diffeomorphic Image Registration: An efficient optimizer for FireANTs
FireANTs introduces a novel Eulerian descent method for plug-and-play behavior tailored for diffeomorphic image registration, treating it as a test-time optimization problem with a GPU-accelerated implementation. The default optimizer used by FireANTs is Adam, which allows for fast and robust optimization. However, Adam's requirement to store state variables, such as momentum and squared-momentum estimates, can lead to significant memory consumption, limiting its applicability for large images. A modified Levenberg-Marquardt (LM) optimizer is proposed, which requires only a single scalar damping parameter as optimizer state, adaptively tuned using a trust region approach. This results in a memory reduction of up to 24%, making it feasible for larger image processing tasks.
Powered by Cloudflare Workers + Payload CMS + Claude 3.5
数据源: OpenAI, Google AI, DeepMind, AWS ML Blog, HuggingFace 等