Enable validated prefix caching and record DGX Spark optimization benchmarks

2026-09-17 22:09:58 +08:00
parent 5f3030260e
commit 1e2f48d1a4
28 changed files with 707 additions and 8 deletions
@@ -8,3 +8,6 @@ See docs/provenance.md for the exact vendored file hash.
 vLLM and its dependencies remain in the upstream container with their respective licenses.
 Model weights are downloaded separately and governed by their upstream terms.
 No blanket license is assigned here to user-authored deployment files.
+
+`patches/fix_mamba_prefix_blocks.py` is derived from blazux's Apache-2.0 Mamba
+block-alignment patch and preserves that attribution.