InverseNet:压缩成像模式下操作不匹配与校准的基准测试

📄 中文摘要

高效压缩成像(EfficientSCI)在其假设的前向操作与物理现实偏离的情况下,损失高达20.58 dB,且这种偏差仅涉及八个参数。然而,目前尚无现有基准量化操作不匹配,这在实际部署的压缩成像系统中是默认情况。研究提出了InverseNet,这是第一个跨模态操作不匹配基准,涵盖了CASSI、CACTI和单像素相机。在27个模拟场景和9个真实硬件捕获下,评估了12种方法,采用四种场景协议(理想、不匹配、oracle校正、盲校准)。结果显示:深度学习方法在不匹配情况下损失10-21 dB,消除了其相对于经典基线的优势;不同模态下的性能和鲁棒性呈负相关。

📄 English Summary

InverseNet: Benchmarking Operator Mismatch and Calibration Across Compressive Imaging Modalities

The study reveals that state-of-the-art EfficientSCI suffers a loss of 20.58 dB when its assumed forward operator deviates from physical reality across just eight parameters. Despite this significant impact, no existing benchmarks quantify operator mismatch, which is a default condition in deployed compressive imaging systems. InverseNet is introduced as the first cross-modality benchmark for operator mismatch, covering CASSI, CACTI, and single-pixel cameras. Evaluating 12 methods under a four-scenario protocol (ideal, mismatched, oracle-corrected, blind calibration) across 27 simulated scenes and 9 real hardware captures, findings indicate that deep learning methods lose 10-21 dB under mismatch, negating their advantages over classical baselines. Additionally, performance and robustness are found to be inversely correlated across modalities.

Powered by Cloudflare Workers + Payload CMS + Claude 3.5

数据源: OpenAI, Google AI, DeepMind, AWS ML Blog, HuggingFace 等