dead-neurons

Star

Here are 2 public repositories matching this topic...

matthewfernst / Late-Residual-Connections

Star

Code repository for my CSU master's research on dead ReLU's

machine-learning deep-learning vanishing-gradient dead-neurons dead-relu

Updated Aug 10, 2023
Python

leonardocaloi / neural-network-entry-exit-law

Star

Independent research on inactive-neuron entry-exit dynamics, with mathematical analysis, archived experiments, reproducibility guides, and a connected research roadmap.

reproducible-research optimization numpy mathematics pytorch transformer neural-networks dynamical-systems gradient-flow research-methodology relu independent-research softplus gelu dead-neurons singular-perturbation loss-of-plasticity

Updated Oct 11, 2026
Python

Add this topic to your repo

To associate your repository with the dead-neurons topic, visit your repo's landing page and select "manage topics."

Learn more