稀疏轴突和树突延迟使竞争性脉冲神经网络在关键词分类中表现出色

📄 中文摘要

研究表明,在脉冲神经网络(SNNs)中训练传输延迟可以显著提升其在复杂时间任务上的表现。学习轴突或树突延迟使得由漏积分发火(LIF)神经元组成的深度前馈SNNs能够达到与现有突触延迟学习方法相当的准确率,同时显著降低内存和计算开销。采用轴突或树突延迟的SNN模型在Google语音命令(GSC)数据集上达到了95.58%的准确率,在脉冲语音命令(SSC)数据集上达到了80.97%的准确率,匹配或超越了基于突触延迟或更复杂神经元模型的先前方法。通过调整延迟参数,研究获得了进一步的性能提升。

📄 English Summary

Sparse Axonal and Dendritic Delays Enable Competitive SNNs for Keyword Classification

Training transmission delays in spiking neural networks (SNNs) has been shown to significantly enhance their performance on complex temporal tasks. Learning either axonal or dendritic delays allows deep feedforward SNNs composed of leaky integrate-and-fire (LIF) neurons to achieve accuracy comparable to existing synaptic delay learning approaches while substantially reducing memory and computational overhead. SNN models with either axonal or dendritic delays achieve up to 95.58% accuracy on the Google Speech Command (GSC) dataset and 80.97% on the Spiking Speech Command (SSC) dataset, matching or exceeding prior methods based on synaptic delays or more complex neuron models. By adjusting the delay parameters, further performance improvements are obtained.

Powered by Cloudflare Workers + Payload CMS + Claude 3.5

数据源: OpenAI, Google AI, DeepMind, AWS ML Blog, HuggingFace 等