KServe
v0.17.0AI & MLv0.17.0 delivers substantial LLM-focused improvements with the new LLMInferenceService beta, enhanced storage parallelization, vLLM 0.15.1 upgrade, and important CVE fixes affecting production deployments.
securityApply critical CVE patches immediately
This release addresses several high-impact CVEs including path traversal (storage-initializer), HTTP parser vulnerabilities (h11, starlette), and cryptography subgroup attacks. Update to v0.17.0 promptly, especially if you're using storage-initializer or external model downloads. Review your current CVE scanning results against the patched versions.
enhancementLeverage parallel storage downloads for faster deployments
Storage-initializer now downloads blobs in parallel from S3 and Azure, dramatically reducing model loading times for large models. This is particularly beneficial for LLM workloads. No configuration changes needed - the improvement is automatic upon upgrade.
breakingPlan LLMInferenceService migration path
The new LLMInferenceService CRD introduces a dedicated API for LLM workloads with different semantics than standard InferenceService. If you're running LLM models, evaluate migrating to this new resource type for better autoscaling, routing, and operational features. The CRD includes breaking changes in API structure.
Key changes (5)
- Introduced LLMInferenceService CRD with webhooks, autoscaling support, and comprehensive Gateway API integration
- Added parallel blob downloads for S3 and Azure storage, significantly improving model loading performance
- Upgraded vLLM runtime to 0.15.1 with enhanced startup probes and configuration flexibility
- Fixed multiple CVEs including path traversal, HTTP parser vulnerabilities, and cryptography issues
- Added OpenVINO model server runtime and predictive inference server for expanded model format support