All Topics
All Topics
Technology
Technology
Design
Design
Programming
Programming
Science
Science
News
News
Gaming
Gaming
Entertainment
Entertainment
Business
Business
Finance
Finance
Sports
Sports
Health
Health
Food
Food
Travel
Travel
Art
Art
Music
Music
Books
Books
Education
Education
Politics
Politics
Personal
Personal
No algorithm. No AI slop. No ads. Just RSS. Pro-human. Indie writers. Real journalism. Open web. Chronological. Hand toasted.

Guide to Running Alibaba's Qwen3.5 LLMs Locally with Unsloth

By

Curiositry

2mo ago· 6 min readen

Summary

This article provides documentation on how to run Alibaba's Qwen3.5 large language models locally using Unsloth. It covers various model sizes in the Qwen3.5 family including Medium (35B, 27B, 122B) and Small (0.8B, 2B, 4B, 9B) series, as well as the 397B model. The documentation explains the models' capabilities including 256K context length, support for 201 languages, thinking/non-thinking modes, and strong performance in agentic coding, vision, chat, and long-context tasks. It focuses on practical implementation guidance for running these models on local devices.

Key quotes

· 3 pulled
Run the new Qwen3.5 LLMs including Medium: Qwen3.5-35B-A3B, 27B, 122B-A10B, Small: Qwen3.5-0.8B, 2B, 4B, 9B and 397B-A17B on your local device!
Qwen3.5 is Alibaba's new model family, including Qwen3.5-35B-A3B, 27B, 122B-A10B and 397B-A17B and the new Small series: Qwen3.5-0.8B, 2B, 4B and 9B.
The multimodal hybrid reasoning LLMs deliver the strongest performances for their sizes. They support 256K context across 201 languages, have thinking + non-thinking, and excel in agentic coding, vision, chat, and long-context tasks.
Snippet from the RSS feed
Run the new Qwen3.5 LLMs including Medium: Qwen3.5-35B-A3B, 27B, 122B-A10B, Small: Qwen3.5-0.8B, 2B, 4B, 9B and 397B-A17B on your local device!

You might also wanna read