chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
8,264 Commits 1 Branch 0 Tags
60a230b1fda7a405ea08000eb1adad840aa8f081
Commit Graph
29 Commits
Author SHA1 Message Date
Liwansi 8bf7f240b6 [NPU]qwen3 pp bugfix (#15390) 2025-12-25 00:14:40 +08:00
Xuchun Shang e9abb52576 [bug fix][pp] fix qwen3 model load (#15223) 
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
 2025-12-17 17:26:22 +08:00
Peng Zhangandeternally-z 8f5adac8c6 [RL] refactor flash rl weight reload in sglang (#14870) 
Co-authored-by: eternally-z <zzywzj@gmail.com>
 2025-12-12 12:50:47 +08:00
Yuhao YaoandCheng Wan e9e7f15eb5 [bugfix] fix TBO crashes when attn_tp_size > 1 (#13730) 
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
 2025-12-11 18:18:40 -08:00
Peng ZhangHecate0821eternally-zWilboludriverWilboluKe Bao
 		21028b5507 [RL] support weight reload for low-bit rollout (#9650) 
Co-authored-by: Hecate0821 <hec4te0821@gmail.com>
Co-authored-by: eternally-z <zzywzj@gmail.com>
Co-authored-by: Wilboludriver <wilbolu@outlook.com>
Co-authored-by: Wilbolu <81792854+Wilboludriver@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
 2025-12-10 15:44:01 +08:00
Even Zhou 894c0dc57c [NPU][1/N] NPU basic functions refactor and new modelslim quant type (#13359) 2025-12-04 16:15:31 +08:00
LiwansiandEven Zhou 432ecf841e [Ascend] qwen optimization (#12078) 
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
 2025-11-25 19:44:24 +08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Stefan He
 		0296f1cdad [Auto Sync] Update activation.py, logits_processor.py, rota... (20251107) (#12853) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
 2025-11-07 22:07:51 -08:00
Xuchun Shang e5ec976402 [Bug fix][PP] fix deadlock with tie_word_embeddings (#12362) 
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
 2025-10-30 01:03:28 -07:00
fzyzcjy 20bd2271e2 Support true on-policy (#12058) 2025-10-25 10:23:42 +08:00
Lianmin Zhengandsglang-bot a17e70f5cc Use more general heuristics to set the default value of --mem-fraction-static (#10975) 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2025-09-29 10:11:03 -07:00
ronnie_zhengandc30031083 e22f3a5ec9 [Ascend]optimize Qwen3 on Ascend (#10574) 
Co-authored-by: c30031083 <chenxu140@huawei.com>
 2025-09-22 17:18:36 -07:00
jingyu-mlandJingyu Xin bcbeed714f Qwen FP8/NVFP4 ModelOPT Quantization support (#7912) 
Co-authored-by: Jingyu Xin <jingyux@nvidia.com>
 2025-09-02 20:56:03 -07:00
Even Zhou de2dd73831 Revert "[feature] Rework Ascend NPU graph support" (#9385) 2025-08-20 00:35:10 -07:00
Even Zhouronnie_zhengyezhifenganon189TyMaksimssshinigami
 		3680d6f88b [feature] Rework Ascend NPU graph support (#9350) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>
 2025-08-19 20:32:27 -07:00
Even Zhou f4fafacc5d Revert "[feature] Ascend NPU graph support (#8027)" (#9348) 2025-08-19 10:11:23 -07:00
zxy a31ea44824 support for interns1-mini (#9299) 2025-08-18 17:56:04 -07:00
VDV1985ronnie_zhengyezhifenganon189TyMaksimssshinigami
 		94371dbbd6 [feature] Ascend NPU graph support (#8027) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>
 2025-08-16 17:25:17 -07:00
Lifu Huang 6e2151183b Fix incorrect default get_hidden_dim logic (#8987) 2025-08-09 00:25:38 -07:00
Pavel Logachev 877e35d775 Add get_hidden_dim to qwen3.py for correct lora (#7312) 2025-07-19 19:31:16 -07:00
Xiaoze Fanandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 570d33437b [Feature] Layer-wise Prefill (#7634) 
Signed-off-by: jason-fxz <jason341132@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-07-17 01:57:46 +08:00
Ximingwang-09纬杭zyksir
 		1964c325de [feat] Support EAGLE3 for Qwen (#7745) 
Co-authored-by: 纬杭 <ximing.wxm@antgroup.com>
Co-authored-by: zyksir <zyksir@outlook.com>
 2025-07-04 19:50:28 -07:00
Lianmin Zheng 14229ccf8f Move mem_fraction_static adjustment for multimodal models to server_args.py & Fix session control & Other cleanups (#7748) 2025-07-04 16:33:33 -07:00
Yi Zhangandispobock 264dc6e744 [optimize] add two stream norm for qwen3 (#7740) 
Co-authored-by: ispobock <ispobaoke@gmail.com>
 2025-07-03 09:59:17 -07:00
Yi Zhang 646cef2e2e support qwen3 dense model dp attention (#7681) 2025-07-03 09:58:20 -07:00
Pan Lyu 451ffe74d9 support qwen3 emebedding (#6990) 2025-06-09 01:32:49 -07:00
Shenggui Li 3f23d8cdf1 added support for tied weights in qwen pipeline parallelism (#6546) 2025-05-25 00:00:56 -07:00
libra 11553c1a37 Add pipeline parallelism for Qwen2 and Qwen3 Model (#6250) 2025-05-18 00:42:55 -07:00
yhyang201 4db463b1ad [Model] Adding Qwen3 and Qwen3MoE (#4693) 2025-04-18 09:51:29 -07:00