Work

Nemotron 3.5 Bolt E4B 4GB: An Open and Efficient Small Language Model for Fast Conversational Agents

Year: 2026
Type: preprint
Abstract: We introduce Nemotron 3.5 Bolt E4B 4GB, an open and efficient small language model further post-trained from Gemma-4-E4B-it and optimized for speed and intelligence per GB of memory used for fast conversational agents. The model carries forward Gemma's strong conversational capabilities and further improves multi-turn tool use, instruction following, and input grounding for fast, local voice/device assistants, interactive personas, and embedded/Edge interfaces. The model combines natural conversation with multi-turn agentic capabilities to power voice/device assistants, interactive characters and robotic/IoT interfaces running on GeForce RTX, Jetson, and RTX/DGX Spark. Experiments on 21 benchmarks show that Nemotron 3.5 Bolt E4B 4GB achieves the highest average accuracy while generating the fewest output tokens in both reasoning and non-reasoning modes, compared with Gemma-4-E4B-it and Qwen3.5-4B. The model is released with a DFlash drafter. With DFlash, Bolt E4B achieves $2.74\times$ the per-user decode speed of inference without speculative decoding at concurrency~1, and $1.21\times$ the generation throughput of Gemma-4-E4B-it with MTP at batch size 1.
Authors: NVIDIA, :, Margolin, Adi, Malte, Aditya, Chhabra, Aishwarya, Hodson, Alex, Mahabaleshwarkar, Ameya Sunil, Dantrey, Ambrish, Shen, Amy, Skliar, Andrii, Chockalingam, Annamalai, Pant, Anusha, Aithal, Ashwath, Kumar, Ashwin, Nushi, Besmira, Pawar, Bhavesh, Catanzaro, Bryan, Yu, Bryan, Hwang, Chantal, Yu, Chenhan, Alexiuk, Chris, Currie, Conner, Gao, Cynthia, Mosallanezhad, David, Yared, Dina, Asl, Ehsan Hosseini, Long, Eileen, Galinkin, Erick, Friedmann, Felix, Burachas, Giedrius, Batmaz, Gorkem, Chlebus, Grzegorz, Siman, Guillermo, Qian, Haifeng, Guo, Hao, Ross, Hayley, Thadicherla, Hrishith, Wang, Hui, Li, Huiying, Nnoli, Ike, Filatova, Irina, Liu, Iris, Lee, Ji-Eun, Leong, Jian, Zhang, Jian, Zeng, Jiaqi, Conway, Joey, Cohen, Jonathan, Vergara, Jose, Vialard, Julien Veron, Briski, Kari, Luna, Katherine, Potdar, Kedar Pandurang, Ning, Kevin, Khaled, Khalil Ben, Pawelec, Krzysztof, Dykes, Laura, Tavabi, Leili, Lee, Lily, Liu, Linda, Ding, Liwei, Dong, Maka, Kilaru, Manoj, Bagdasarova, Maria, Lee, Matthew, Price, Meredith, Schaffer, Micah, Boone, Michael, Fukuyama, Michael, Hasper, Michael, Agarwal, Nancy, Habibi, Negar, Kuchaiev, Oleksii, Olabiyi, Oluwatobi, Ribalta, Pablo, Motwani, Payal, Xu, Pinky, Varshney, Prasoon, Biswas, Pritam, Meng, Puhui, Shivbhakta, Rameshwar, Zilberstein, Ran, Kovacs, Reka, Mazzarese, Richard, Garg, Rishabh, Neves, Rita Fernandes, Woods, Rochelle, Ye, Ruby, Virk, Ruvaid, Hill, Ryan, Motiian, Saeid, Mard, Seph, Nun, Shai Ben, Ghosh, Shaona, Yadav, Sharad, Sabnis, Sudeep, Sheshadri, Suhas Hariharapura, Kong, Terry, Do, Thanh, Le, Thinh, Karpas, Udi, Trinh, Viet Anh, Raman, Vinay, Sharma, Vinita, Drones, Warren, Gao, Wenwen, Hsueh, Whei, Efstratis, Will, Suhara, Yoshi, Liu, Yunsheng, Wang, Zhenming, Chen, Zijia, Ahmed, Zuhair
Language: English
Open Access status: green
OpenAlex ID: W7235541712
Cites: 26
Cited by:
Related to: 10