Announcing Humming: Fast, Flexible Kernels for Quantized Inference | vLLM Blog
vllm.ai · saved by 1 readers
Introducing Humming, a quantized inference kernel library from Ant Group and the vLLM community, with broad GPU and quantization support, dense and MoE performa