SGHS: Dynamic Hybrid Sparse Pruning via Fine-grained Sensitivity Allocation for LLMs — one-shot N:M semi-structured pruning with sub-block heterogeneous patterns
-
Updated
Sep 14, 2026 - Python
SGHS: Dynamic Hybrid Sparse Pruning via Fine-grained Sensitivity Allocation for LLMs — one-shot N:M semi-structured pruning with sub-block heterogeneous patterns
Iterative magnitude pruning in PyTorch for finding lottery tickets (Frankle & Carbin), with late rewinding, quantisation-aware training and resumable checkpoints. Started for my ML MSc.
Official Repository for CSRv2 - ICLR 2026
A feed-forward neural network that learns to prune itself during training using differentiable gate parameters
Official Repository for SeqTopK
Molecular-property prediction with sparsity
A supervised autoencoder with structured sparsity for efficient and informed clinical prognosis.
A pure implementation for sparse denoising autoencoder with adaptive evolutionary training using Scipy. The sparse implementation makes the algorithm scalable to high dimensional data and trainable on CPUs.
Efficient neural network compression through sparse weight pruning for NPU oriented inference.
Simple world models lead to good abstractions, Google Cerebra internship 2020/master thesis at EPFL LCN 2021 ⬛◼️▪️🔦
Code to reproduce the experiments of ICLR2023-paper: How I Learned to Stop Worrying and Love Retraining
Minimal Reproducibility Study of (https://arxiv.org/abs/1911.05248). Experiments with Compression of Deep Neural Networks
Deterministic search over per-layer bit-widths to fit a model into a fixed VRAM budget. An LLM agent proposing allocations lost to a plain greedy loop by 4,386x at the same memory envelope; 2:4 structured sparsity lost to dense by 3,307x at equal memory.
Public code of the ML course
[ECCV 2026] KATANA: Knowledge-Aligned Topology-Aware Neural Agents for RL-Driven Vision-Language Model Compression
Reproducible Apple M2 study of dynamic FFN block sparsity for LLM inference: quality vs. latency, packed vs. per-neuron kernels, with all raw data and validators
SinkSLOT: Sinkhorn via Sparse Lifted Optimal Transport
To associate your repository with the sparsity topic, visit your repo's landing page and select "manage topics."