Article

OxyGen: Unified KV Cache Management for Multi-Task Parallel VLA Inference

OxyGen proposes an inference design for unified KV cache management that treats the KV cache as a shared resource across tasks and control cycles, eliminating redundant prefill of shared observations through cross-task KV sharing and advancing unfinished language requests within each frame's decoding budget via cross-frame continuous batching.

Part of the event: OxyGen paper proposes unified KV-cache inference design for VLAs

This page provides a summary and source link only.