First vLLM Conference Announced at Ray Summit 2025 in San Francisco
Meet the speakers for the first vLLM Conference at Ray Summit, hosted by Inferact.
Read the full articleYou might also wanna read
Technical Analysis of LLM Inference Engines: Exploring Nano-vLLM Architecture and Scheduling
When deploying large language models in production, the inference engine becomes a critical piece of infrastructure.
neutree.ai·5mo ago
vLLM Completes Migration to V1 Engine with DeepSeek Serving at 2.2k Tokens/Second on H200 Hardware
In v0.11.0, the last code from vLLM V0 engine was removed, marking the complete migration to the improved V1 engine architecture. This achie
blog.vllm.ai·5mo ago
Understanding the Architecture of vLLM V1 Inference Engine for Efficient Scaling
vLLM is an open-source inference engine that serves large language models. We deploy vLLM across GPUs and load open weight models like Llama
ubicloud.com·1y ago
tiny-vllm: An Open-Source C++ and CUDA LLM Inference Engine with Educational Course
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM - jmaczan/tiny-vllm
github.com·1mo ago
RTP-LLM: Alibaba's High-Performance Inference Engine for Large Language Model Deployment
Large Language Models (LLMs) have revolutionized AI applications, but deploying them at scale presents significant challenges. We present RT
arxiv.org·1mo agoDeepSeek and Zhipu AI Enter the Chip Arena: The Paradigm Shift of Chinese LLM Companies from Algorithm to Full-Stack Inference Silicon
1. Introduction On July 8, 2026, two explosive reports hit the global tech landscape within hours of each other. Reuters broke the news that
Comments
Sign in to join the conversation.
No comments yet. Be the first.