Making data transfer in LLM systems faster, leaner, and more scalable

Introducing Shared Memory IPC Caching — a high-performance caching mechanism contributed by Cohere to the vLLM project.