Preprint Open access
SpikeMoE: Brain-Inspired Competitive Routing for Flexible Spiking Mixture-of-Experts
Spiking Neural Networks (SNNs) enable event-driven computation through biologically inspired dynamics at the neuronal scale, while Mixture-of-Experts (MoE) perform conditional computation through expert selection at the model scale. Integrating their strengths offers potential for flexible neural architectures. A key c …