Swordfish: Blackwell-Native GEMM Kernel Family for GPU Inference (PR #1707)
Swordfish is a Blackwell-native (sm100 and sm110) GEMM kernel family descended from the same lineage as Marlin and Machete. Supported modes: symmetric GPTQ int4 (uint4b8) and int8 (uint8b128), AWQ ...
Read the full articleYou might also wanna read
GPT-OSS Performance Optimizations on NVIDIA Blackwell: Pushing the Pareto Frontier
How vLLM and NVIDIA optimized GPT-OSS on Blackwell with FlashInfer, torch.compile fusion, FP8 KV cache, async scheduling, stream interval tu
APEX4: Platform-Dependent W4A4 LLM Inference via Intra-SM Compute Rebalancing
W4A4 quantization promises full utilization of INT4 Tensor Cores, yet group dequantization overhead on CUDA Cores has driven existing system
arxiv.org·1mo ago
NVIDIA "Blackwell-Next" GPU codename appears in Linux kernel patch for VFIO driver
NVIDIA engineers are already preparing Linux support for hardware listed as “Blackwell-Next.” The name appears in a Linux kernel patch for t
videocardz.com·25d ago
Accelerating GPU Inference of Large Language Models with Moderately Unstructured Sparse Weight Matrices
arXiv:2607.08786v1 Announce Type: new Abstract: With the growing deployment of large language models (LLMs), LLM inference cost has become a
Driving vLLM WideEP and Large-Scale Serving Toward Maturity on Blackwell (Part I)
How vLLM improves WideEP and large-scale DeepSeek-style MoE serving on NVIDIA GB200 with NVFP4 and FP8 kernels, fusion, prefill/decode disag
Building high-performance expert-parallel dispatch and combine kernels for MoE LLM inference
How expert-parallel dispatch and combine kernels work, built up from scratch: the high-throughput shape and the low-latency one.
fergusfinn.com·1mo ago
Comments
Sign in to join the conversation.
No comments yet. Be the first.