mmangkad-dev
Popular repositories Loading
-
flash-attention-prebuild-wheels
flash-attention-prebuild-wheels PublicForked from mjun0812/flash-attention-prebuild-wheels
Provide with pre-build flash-attention package wheels on Linux and Windows platforms using GitHub Actions
Python
-
-
Model-Optimizer
Model-Optimizer PublicForked from NVIDIA/Model-Optimizer
A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks …
Python
-
vllm
vllm PublicForked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Python
-
DeepEP
DeepEP PublicForked from deepseek-ai/DeepEP
DeepEP: an efficient expert-parallel communication library
Cuda
-
python-build-standalone
python-build-standalone PublicForked from astral-sh/python-build-standalone
Produce redistributable builds of Python
Python
Repositories
- sglang Public Forked from sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
- DeepGEMM Public Forked from sgl-project/DeepGEMM
DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
- Model-Optimizer Public Forked from NVIDIA/Model-Optimizer
A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
- python-build-standalone Public Forked from astral-sh/python-build-standalone
Produce redistributable builds of Python
- vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
- flash-attention-prebuild-wheels Public Forked from mjun0812/flash-attention-prebuild-wheels
Provide with pre-build flash-attention package wheels on Linux and Windows platforms using GitHub Actions
- DeepEP Public Forked from deepseek-ai/DeepEP
DeepEP: an efficient expert-parallel communication library
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…