从轻量级卷积神经网络到脉冲神经网络:通过修剪脉冲压缩网络评估准确性与能量的权衡
📄 中文摘要
脉冲神经网络(SNN)作为卷积神经网络(CNN)的能效替代方案,越来越受到关注,尤其是在边缘智能领域。然而,现有研究主要集中在大规模模型上,轻量级CNN到SNN的设计与评估尚未得到充分探索。本研究系统性地基准测试了通过将紧凑的CNN架构转换为脉冲网络而获得的轻量级SNN,采用漏积分发放(LIF)神经元对激活进行建模,并在统一的设置下使用代理梯度下降进行训练。构建了ShuffleNet、SqueezeNet、MnasNet和MixNet的脉冲变体,并在CIFAR-10、CIFAR-100和TinyImageNet上进行了评估,测量其准确性与能量消耗的权衡。
📄 English Summary
From Lightweight CNNs to SpikeNets: Benchmarking Accuracy-Energy Tradeoffs with Pruned Spiking SqueezeNet
Spiking Neural Networks (SNNs) are gaining attention as energy-efficient alternatives to Convolutional Neural Networks (CNNs), particularly in the context of edge intelligence. However, previous research has predominantly focused on large-scale models, leaving the design and evaluation of lightweight CNN-to-SNN pipelines underexplored. This study presents the first systematic benchmark of lightweight SNNs derived from compact CNN architectures, modeling activations with Leaky-Integrate-and-Fire (LIF) neurons and training using surrogate gradient descent in a unified framework. Spiking variants of ShuffleNet, SqueezeNet, MnasNet, and MixNet are constructed and evaluated on CIFAR-10, CIFAR-100, and TinyImageNet, measuring the trade-offs between accuracy and energy consumption.
Powered by Cloudflare Workers + Payload CMS + Claude 3.5
数据源: OpenAI, Google AI, DeepMind, AWS ML Blog, HuggingFace 等