Neural Magic
Neural Magic helps developers in accelerating machine learning performance using automated model sparsification techniques and inference technologies.
Pinned Loading
Repositories
Showing 10 of 47 repositories
- compressed-tensors Public
A safetensors extension to efficiently store sparse quantized tensors on disk
neuralmagic/compressed-tensors’s past year of commit activity - nm-vllm-certs Public
neuralmagic/nm-vllm-certs’s past year of commit activity - upstream-llm-foundry Public Forked from mosaicml/llm-foundry
LLM training code for MosaicML foundation models
neuralmagic/upstream-llm-foundry’s past year of commit activity