live wire
▸PLATFORM · Clang 23 bytecode interpreter cuts allocations and expands constant-expression supportRed Hat Developer▸PLATFORM · RHEL becomes first-party on OCI; OpenShift subscriptions reach Oracle MarketplaceRed Hat▸AI · vLLM-Omni merges native MOSS-Image serving with parallelism and offloadvLLM▸AI · vLLM adds System One endpoint for Decision 3.0 multimodal routing models (Oct. 15)vLLM▸SECURITY · Red Hat rates OpenShift AI 3.4.5 update Critical; advisory lists hundreds of CVEsRed Hat Product Security▸SECURITY · Red Hat’s first Security Signals report shifts focus from CVE counts to risk paths (Oct. 15)Red Hat▸PLATFORM · IBM adds non-destructive FlexVolume-to-CSI migration tool for OpenShift object storageIBM Cloud▸vLLM tests agent-built Kimi K3 decode path at up to 1.9× speedup; PR remains openvLLM▸AI · LeaderWorkerSet 1.0 changes rollout defaults for disaggregated AI workloadsKubernetes SIGs▸SECURITY · Red Hat flags active exploitation of kernel flaw affecting OpenShift CoreOS; no fix listedRed Hat Product Security▸AI · Red Hat sets Dec. 9 showcase for AI 3.6 agent governance and model servicesRed Hat▸vLLM 0.32.0 drops Python 3.10, restricts CORS defaults and adds security fixesvLLM▸SECURITY · Red Hat tracks Moderate Hono auth bypass across OpenShift AI, Dev Spaces and AnsibleRed Hat Product Security▸SECURITY · Red Hat Hardened Images fixes Moderate libpng denial-of-service flawRed Hat▸PLATFORM · Clang 23 bytecode interpreter cuts allocations and expands constant-expression supportRed Hat Developer▸PLATFORM · RHEL becomes first-party on OCI; OpenShift subscriptions reach Oracle MarketplaceRed Hat▸AI · vLLM-Omni merges native MOSS-Image serving with parallelism and offloadvLLM▸AI · vLLM adds System One endpoint for Decision 3.0 multimodal routing models (Oct. 15)vLLM▸SECURITY · Red Hat rates OpenShift AI 3.4.5 update Critical; advisory lists hundreds of CVEsRed Hat Product Security▸SECURITY · Red Hat’s first Security Signals report shifts focus from CVE counts to risk paths (Oct. 15)Red Hat▸PLATFORM · IBM adds non-destructive FlexVolume-to-CSI migration tool for OpenShift object storageIBM Cloud▸vLLM tests agent-built Kimi K3 decode path at up to 1.9× speedup; PR remains openvLLM▸AI · LeaderWorkerSet 1.0 changes rollout defaults for disaggregated AI workloadsKubernetes SIGs▸SECURITY · Red Hat flags active exploitation of kernel flaw affecting OpenShift CoreOS; no fix listedRed Hat Product Security▸AI · Red Hat sets Dec. 9 showcase for AI 3.6 agent governance and model servicesRed Hat▸vLLM 0.32.0 drops Python 3.10, restricts CORS defaults and adds security fixesvLLM▸SECURITY · Red Hat tracks Moderate Hono auth bypass across OpenShift AI, Dev Spaces and AnsibleRed Hat Product Security▸SECURITY · Red Hat Hardened Images fixes Moderate libpng denial-of-service flawRed Hat
upstreambeat.ai
releaseAI

vLLM Agentic API 0.8 makes stateful open-model agents easier to operate

The Rust gateway adds opt-in telemetry, preserves images across response continuations and broadens its server-side search and MCP handling.

By The News Desk· Sep 28, 2026the quick take — two AI hosts go live when you do

vLLM’s Agentic API project has released version 0.8.0, expanding the operational layer that sits in front of model servers for stateful agent workloads. The release adds opt-in OpenTelemetry support, keeps image inputs intact across response continuations and introduces Brave Search as another server-owned search provider.

What changed

The release can emit OpenTelemetry traces and HTTP metrics over OTLP HTTP/protobuf, propagate W3C trace context and correlate those traces with local logs. Telemetry remains disabled by default, so operators must opt in rather than absorb a new observability path during an upgrade.

Agentic API 0.8 also preserves images across Responses API requests, stored continuations and both HTTP and WebSocket transports. The project says it now resolves image capabilities consistently for Codex model catalogs and launchers. That closes an important continuity gap for agents that analyze images across multiple turns instead of treating every image request as a disconnected inference call.

The tool layer gained Brave Search as a selectable web-search provider, including provider concurrency limits. MCP discovery now follows pagination cursors returned by tools/list, avoiding an incomplete tool inventory when a server exposes more than one page. The release also separates logical retained-response accounting from raw SSE framing and reports token usage across every round of a Messages tool loop.

Who should care

Platform teams using vLLM behind coding assistants or other agent clients get the clearest benefit. The gateway’s role is not faster token generation; it is to own conversation state, streaming, tool execution and continuation around an inference backend. Version 0.8 makes that control plane more observable and less likely to lose multimodal context during longer sessions.

Developers embedding Agentic API as a Rust dependency should review the migration notes. The release changes source-level APIs around input content, configuration, typed resource-limit errors and web-search provider construction. Existing persistent Codex session homes should also be regenerated so that the updated image capability data is picked up.

What to do

The project publishes 0.8.0 through crates.io and PyPI, with portable Python wheels for Linux x86_64 and both Intel and Apple Silicon macOS. A verified Docker image is available as vllm/agentic-api:v0.8.0.

Operators should enable telemetry first in a test environment, verify their collector and trace-context settings, and exercise stored multimodal continuations before promoting the release. Teams maintaining Rust integrations should treat this as a migration rather than a drop-in library update.

sources

Filed by The News Desk. Corrections: desk@upstreambeat.ai · Our standards →

comments · 0

    Comments are moderated before they appear. Your email is used once to confirm it is you — never shown, never sold. Corrections and questions get an answer from the desk when we have one.

    more from the desk