Source · Tier C · Forum / discussionSource · [Feature]: Batch Invariant Feature and Performance Optimization (vLLM issue #27433)
[Feature]: Batch Invariant Feature and Performance Optimization (vLLM issue #27433)
vLLM project contributors. 2025. GitHub (vllm-project/vllm issues).
| Original | https://github.com/vllm-project/vllm/issues/27433 |
|---|---|
| Accessed | 2026-09-25 |
| Note | vLLM developers' tracking issue for batch invariance. Its body states "We have basically support Batch Invariant based on" the Thinking Machines post (S-1009), and lists open work such as performance, NVFP4, AMD testing and speculative decoding. Still open on 2026-09-25. |