What is vLLM V1?

vLLM V1 is a rewritten core execution architecture for the vLLM inference engine that splits work between a driver process holding the request scheduler and cache-block manager, and separate stateful worker processes that retain state across steps. It overlaps the scheduling of the next step with execution of the current one, cutting coordination overhead and keeping accelerators more consistently busy.