Year: 2026
Type: preprint
Abstract: We present Hunyuan-A13B, an open-source large language model based on a Mixture-of-Experts architecture. It contains 80 billion total parameters but activates only 13 billion during inference, balancing model capability, computational efficiency, and deployment cost. The model is pretrained on a rigorously filtered 20T-token corpus with enhanced STEM data curation, improving factual reliability and reasoning ability. High-quality supervised fine-tuning and large-scale reinforcement learning further enhance its overall performance. Hunyuan-A13B also introduces a dual-mode Chain-of-Thought framework that adapts reasoning depth to task complexity: fast thinking for routine queries and slow thinking for complex, multi-step problems. Evaluations show competitive performance across mathematics, science, programming, general language understanding, and agent tasks, often approaching that of much larger models. Its high inference throughput makes it suitable for latency-sensitive applications. We release Hunyuan-A13B to support open research and practical LLM deployment.
Source: arXiv (Cornell University)
Authors: Tencent Hunyuan Team, Liu, Ao, Zhou, Botong, Xu, Can, Zhou, Chayse, Zhang, ChenChen, Xu, Chengcheng, Wang, Chenhao, Wu, Decheng, Wu, Dengpeng, Jiao, Dian, Du, Dong, Wang, Dong, Zhang, Feng, Lian, Fengzong, Xu, Guanghui, Zhang, Guanwei, Wang, Hai, Luo, Haipeng, Hu, Han, Xu, Huilin, Wu, Jiajia, Zhu, Jianchen, Yan, Jianfeng, Zhu, Jiaqi, Zhang, Jihong, Xue, Jinbao, Xia, Jun, Zheng, Junqiang, Liu, Kai, Zhang, Kai, Zheng, Kai, Li, Kejiao, Wang, Keyao, Jiang, Lan, Liu, Lixin, Wu, Lulu, Huang, Mengyuan, Yu, Peijie, Wang, Peiqi, Wang, Qian, Xiang, Qianbiao, Liu, Qibin, Sun, Qingfeng, Guo, Richard, Xie, Ruobing, Yang, Saiyong, Chen, Shaohua, Hu, Shihui, Li, Shuai, Li, Shuaipeng, Chen, Shuang, Zheng, Suncong, Yang, Tao, Zhang, Tian, Yu, Tinghao, Han, Weidong, Liu, Weijie, Zhou, Weijin, Wang, Weikang, Chen, Wesleye, Feng, Xiao, Ren, Xiaoqin, Sun, Xingwu, Kuang, Xiong, Huang, Xuemeng, Cao, Xun, Chen, Yanfeng, Du, Yang, Yang, Zhen, Tao, Yangyu, Deng, Yaping, Shen, Yi, Hong, Yigeng, Chen, Yiqi
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7214196674