volta

Hand-written NVFP4 W4A16 CUDA kernels for Volta

Dissecting NVIDIA GPU Architecture

The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; benchmarks vs llama.cpp in the README.

llama.cpp optimized for NVIDIA Tesla V100 (SM70): Qwen3.8-Flash-Next with MTP (prefill 3402 tok/s at 200K context on 6x V100-16GB; also runs on 2x V100-16GB) and Qwen3.8-27B with DFlash2 (decode up to 220 tok/s); 2-6 GPUs, 262K-512K context, multimodal, concurrent serving, built-in web UI.

Agentic-coding oriented inference engine for N x V100-SXM2, based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash, MiniMax-H3.

Superseded by github.com/poisonxa16/pxa — PXA, the set-and-forget engine for Pascal and Volta

Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.

RFCs for changes to Volta

Like Volta, but for Java — automatic per-project JDK switching via .java-version

FlashAttention brought back to Tesla V100 — a deep llama.cpp fork: SM 7.0 D256 kernels, SplitKV3, q4_0 KV cache, DFlash2 speculative decoding and multimodal fixes.

Qwen3.8-27B in native NVFP4/FP8 on 2x PCIe Tesla V100-32GB (SM70): the PCIe runbook for v100-skinny + 1Cat-vLLM, with the 3 fixes that make it work without NVLink. 61-74 tok/s decode, MTP speculative decoding, OpenAI-compatible.

Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/disk KV offload, and MTP or DFlash2 speculative decoding.

Unlocking the NVIDIA CMP 100-210 (GV100): an L3 privilege primitive from an unbounded copy in NVIDIA's own boot firmware. FP64 15.5x, tensor cores 14.4x, PCIe 3.95x, memory +8.4% — measured.

volta 简体中文版文档

Multi-GPU acceleration for MiniMax H3 video generation on NVIDIA V100 (sm_70). Ulysses sequence parallelism as a drop-in ComfyUI custom node — ~19 min to ~7 min on 8x V100.

Windows-only NInfer port for NVIDIA Tesla V100 32GB (sm_70), with Qwen3.8-27B NVFP4 at 228 tok/s.

Running large LLMs on pre-Ampere NVIDIA hardware — Tesla V100 (sm_70), RTX 2080 Ti (sm_75), CMP 170HX. Measured benchmarks, vLLM forks, and the hardware side: NVLink on SXM2 carrier boards, driver traps, cooling, used-kit acceptance.

Zsh plugin to seamlessly install and configure volta

Run DLSS 5 Neural Rendering in ComfyUI on pre-RTX GPUs (Tesla V100 / Volta and other non-RTX NVIDIA cards) — no NGX required

📦 A fully automated method for installing Nvidia drivers on Arch Linux