Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
-
Updated
Mar 10, 2024 - Python
Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
K-CAI NEURAL API - Keras based neural network API that will allow you to create parameter-efficient, memory-efficient, flops-efficient multipath models with new layer types. There are plenty of examples and documentation.
A parameter-efficient mixture-of-experts module for computational pathology - ICLR
Frame Flexible Network (CVPR2023)
ENGRAFT: write facts into an LLM's n-gram (Engram) memory table as a removable overlay: 100 facts in a 9 MB file, no weights touched, verified on llama.cpp GGUF (Qwen3.8-Flash-Next).
PEFT-compatible SingLoRA: single-matrix low-rank adaptation with half the adapter parameters of standard LoRA, drop-in for transformers workflows.
Official source code for the paper "Tailored Design of Audio-Visual Speech Recognition Models using Branchformers"
Toward controlled evolution of artificial intelligence through validated neural grafting.
ASSTF (Adaptive State-Space Transfer Function): A PyTorch framework for dynamic neural topology that reduces parameters by 5-10x, enables test-time adaptation, and outperforms static models on structure-sensitive tasks.
Various LoRA adapters. One shared basis. Up to 122× compression at scale.
Train the smallest LM you can that fits in 16MB. Best model wins!
How many parameters are needed to get 99% on MNIST? Personal record of 697 parameters.
Reduce LLM inference compute by 4x with no accuracy loss. Oscillatory adapter for pretrained Transformers.
A modular and extensible LoRA fine-tuning framework for question-answering tasks with PEFT integration
BiDoRA: Bi-Level Optimization for Parameter-Efficient Fine-Tuning of LLMs - Optimized for 3D Code Generation
To associate your repository with the parameter-efficient topic, visit your repo's landing page and select "manage topics."