All Topics
All Topics
Technology
Technology
AI
AI
Business
Business
Entertainment
Entertainment
News
News
Programming
Programming
Science
Science
Design
Design
Environment
Environment
Finance
Finance
Crypto
Crypto
Politics
Politics
Sports
Sports
Education
Education
Gaming
Gaming
Art
Art
Music
Music
Health
Health
Security
Security
Books
Books
Food
Food
Travel
Travel
Personal
Personal
Bluesky
Twitter

Tencent Releases Hy3: A 295B-Parameter MoE AI Model with 21B Active Parameters

2d ago· 7 min readen

Summary

Tencent's Hy Team has released Hy3, a 295B-parameter Mixture-of-Experts (MoE) AI model with 21B active parameters and 3.8B MTP layer parameters. Building on feedback from 50+ product teams after the Hy3 Preview launch in late April, the team fixed task execution and interaction issues while improving post-training pipeline quality and scale. The model significantly outperforms similar-sized models.

Source

Twitter / XTencent Releases Hy3: A 295B-Parameter MoE AI Model with 21B Active Parametershuggingface.co

Key quotes

· 3 pulled
Hy3 is a 295B-parameter Mixture-of-Experts (MoE) model with 21B active parameters and 3.8B MTP layer parameters, developed by the Tencent Hy Team.
Following the Hy3 Preview launch in late April, we gathered feedback from 50+ product teams.
We fixed various issues in task execution and interaction, and improved both the quality and scale of our post-training pipeline.
Snippet from the RSS feed
We’re on a journey to advance and democratize artificial intelligence through open source and open science.

You might also wanna read

Comments

Sign in to join the conversation.

No comments yet. Be the first.