All Topics
All Topics
Technology
Technology
Design
Design
Programming
Programming
Science
Science
News
News
Gaming
Gaming
Entertainment
Entertainment
Business
Business
Finance
Finance
Sports
Sports
Health
Health
Food
Food
Travel
Travel
Art
Art
Music
Music
Books
Books
Education
Education
Politics
Politics
Personal
Personal
No algorithm. No AI slop. No ads. Just RSS. Pro-human. Indie writers. Real journalism. Open web. Chronological. Hand toasted.

LM Studio 0.4.0 Released with Parallel Requests, Server Deployment, and New REST API

By

jiqiren

4mo ago· 18 min readen

Summary

LM Studio 0.4.0 introduces significant updates including parallel requests with continuous batching for high-throughput serving, a new non-GUI deployment option called 'llmster' for server-native deployment, a stateful REST API, and a refreshed user interface. The release focuses on making the software more versatile for server deployment, CI integration, and production use cases beyond the desktop GUI.

Key quotes

· 5 pulled
Today we are thrilled to share LM Studio 0.4.0, the next generation of LM Studio.
This release introduces parallel requests with continuous batching for high throughput serving, all-new non-GUI deployment option, new stateful REST API, and a refreshed user interface.
Today we're introducing llmster: it's the core of the LM Studio desktop app, but packaged to be server-native, without reliance on the GUI.
We've rearchitected our software to separate the GUI from the core functional
Deploy on servers, deploy in CI, deploy anywhere
Snippet from the RSS feed
Server deployment, parallel requests with continuous batching, new REST API endpoint, and refreshed application UI

You might also wanna read