Commit Graph

Select branches

Hide Pull Requests

cch/megamoe-rc-v0.1

Mono Color

• cef11e9a55 fix: resolve gb200 image link (#10343) Yineng Zhang 2025-09-12 13:46:02 -07:00
• 2269cf1e2f [Auto Sync] Update base_grammar_backend.py, llguidance_back... (20250911) (#10333) Lianmin Zheng 2025-09-12 12:55:55 -07:00
• 151e287d1a fix: add fast path for function call (#9023) Yi Zhang 2025-09-13 01:28:54 +08:00
• 8c86595c93 [router] enable sccache in ci and local build (#10099) Simo Lin 2025-09-12 12:43:48 -04:00
• 4634fd5953 [router] Add Rerank Routing Logic in Regular Router (#10219) Frank Fang 2025-09-13 00:10:18 +08:00
• efedbe6ca9 Fix global input scale incompatible with CuTe DSL moe (#10370) fzyzcjy 2025-09-12 18:22:49 +08:00
• 3a77c80b26 Fix FA4 import cause moe_fused_gate output be illegal memory (#10368) fzyzcjy 2025-09-12 18:21:26 +08:00
• 36acd2ff16 Fix chunked prefix cache for nvfp4 (#10180) Shu Wang 2025-09-12 05:20:30 -05:00
• fe6cdf8972 add qwen3-next ut (#10355) Yi Zhang 2025-09-12 18:06:48 +08:00
• 30d20ce84f Support loading weights from remote instance (#8215) amysaq2023 2025-09-12 17:40:22 +08:00
• 1b1701f1f7 model: support dots.vlm1 model (#8778) chenge@xiaohongshu.com 2025-09-12 17:38:38 +08:00
• 6d40308905 Revert add mainprocess's proctitle (#10351) ybyang 2025-09-12 16:48:30 +08:00
• 24dc2bee97 Fix Bailing MoE model bugs (#10362) Yuan Luo 2025-09-12 15:36:02 +08:00
• fac07c9b08 Support LingV2 model (#10359) strgrb 2025-09-12 14:53:52 +08:00
• b3839a7f99 fix: resolve transfer_kv_all_layer_direct_lf_pf import error (#10360) Yineng Zhang 2025-09-11 23:53:23 -07:00
• 4aa39d72c4 fix the break in FlashInferFusedMoE (#10356) chenqianfzh 2025-09-11 23:47:48 -07:00
• b4c2c421e9 support memory_pool_host page first direct layout (#10031) huangtingwei 2025-09-12 14:19:44 +08:00
• 53ca15529a Implement Standalone gRPC Server for SGLang Python Scheduler (#10283) Chang Su 2025-09-11 20:57:17 -07:00
• a23bdeaf04 [router] Basic OAI Response api (#10346) Keyang Ru 2025-09-11 20:56:17 -07:00
• 27778010fc fix dual stream bug (#10352) Yi Zhang 2025-09-12 11:53:42 +08:00
• 46d8fb1c98 model: support Apertus (#9774) EduardDurech 2025-09-12 05:49:10 +02:00
• c7e85f5378 fix: flashinfer_cutlass_moe: Use max of global expert scales instead of local for input scale (#10296) Trevor Morris 2025-09-11 20:19:17 -07:00
• 3df05f4d6a [NVIDIA] [3/N] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#9199) Shu Wang 2025-09-11 22:18:43 -05:00
• 7b141f816c [router][ci] Add gpu utilization analyze with nvml (#10345) Keyang Ru 2025-09-11 19:26:02 -07:00
• 7bc5fb0d78 [CPU][doc] add torch.compile param in example commands (#10349) Zaili Wang 2025-09-12 10:22:46 +08:00
• 144ee5f37c [Auto Sync] Update server_args.py (20250912) (#10347) Lianmin Zheng 2025-09-11 19:18:07 -07:00
• b0d25e72c4 chore: bump v0.5.2 (#10221) Yineng Zhang 2025-09-11 16:09:20 -07:00
• a2424068ec add try catch for quant config hf download (#10340) gongwei-130 2025-09-11 15:00:21 -07:00
• c5d2b01cea [LongCat] Optimize zero_experts_compute_triton by changing mask (#10303) zk-lover 2025-09-12 05:56:25 +08:00
• 46ccbed2cd update GLM nightly test threshold (#10331) Minglei Zhu 2025-09-11 14:54:58 -07:00
• fe68c1486f Fix errors of hicache kernels in sgl-kernel for ROCm (#10339) Hubert Lu 2025-09-11 14:54:34 -07:00
• 70c0c1f926 fix: trtllm-gen attention take zero-init workspace (#10330) eigen 2025-09-11 17:35:23 -04:00
• 760b788a58 add qwen3-next doc (#10327) Yi Zhang 2025-09-12 05:29:11 +08:00
• 1ee11df8ac [router][ci] add gpu process check and free port before start server (#10338) Keyang Ru 2025-09-11 14:24:16 -07:00
• dee197e11b [router] Add OpenAI backend support - core function (#10254) Keyang Ru 2025-09-11 14:13:51 -07:00
• ab795ae840 add h20 qwen3 next config (#10264) Yi Zhang 2025-09-12 05:02:24 +08:00
• 480d1b8b20 [router] add benchmark for regular router and pd router (#10280) Keyang Ru 2025-09-11 12:04:11 -07:00
• 6c18ab46a2 [Qwen3-Next] switch to triton and cache conv states to accelerate MTP from 300 tok/s to 341 tok/s (#10335) Stefan He 2025-09-11 11:59:48 -07:00
• 4a0e0be2a2 [bugfix] fix norm type error in qwen3_next model (#10322) cao1zhg 2025-09-12 00:05:59 +08:00
• 64f296f8e6 [Minor] Improve the style of server args (#10328) Lianmin Zheng 2025-09-11 07:06:29 -07:00
• 956d805dde [Auto Sync] Update parallel_state.py (20250911) (#10326) Lianmin Zheng 2025-09-11 06:36:29 -07:00
• 30c6e1f569 Qwen3-Next support (#10233) Yi Zhang 2025-09-11 19:11:49 +08:00
• bfe01a5eef chore: upgrade v0.3.9.post2 sgl-kernel (#10297) Yineng Zhang 2025-09-11 04:10:29 -07:00
• 3dd6420a4d [CI] add pyproject.toml to deepseek w4a8 ci (#10314) Hank Han 2025-09-11 17:10:50 +08:00
• 532f998b0f chore: bump sgl-kernel 0.3.9.post2 (#10311) Yineng Zhang 2025-09-11 01:29:50 -07:00
• de15d1405a Revert "Fix flashinfer version in sgl-kernel (#10135)" (#10310) Yineng Zhang 2025-09-11 01:27:58 -07:00
• 37367da639 [fix CI] Fix logical condition in fused MoE layer for compressed tensor quantization (#10299) Xiaoyu Zhang 2025-09-11 14:54:09 +08:00
• ef959d7b85 [CPU] fix OOM when mem-fraction is not set (#9090) Zaili Wang 2025-09-11 14:52:22 +08:00
• 4aa1e69bc7 [chore]Add sgl-router to npu images (#10229) BourneSun0527 2025-09-11 14:51:16 +08:00
• dc491b399d add flash linear attention triton kernel (#10239) Yi Zhang 2025-09-11 12:47:20 +08:00
• 5b64f006ec [Feature] Support DeepEP normal & Redundant Experts on NPU (#9881) Even Zhou 2025-09-11 11:35:26 +08:00
• 5b7448de77 chore: bump sgl-kernel 0.3.9.post1 (#10294) Yineng Zhang 2025-09-10 18:26:34 -07:00
• 6d55f60e77 Revert "[1/2] Optimizations and refactors about quant kernel (#9534)" (#10292) Yineng Zhang 2025-09-10 18:24:23 -07:00
• 033b75f559 [Auto Sync] Update serving_base.py, serving_chat.py, servin... (20250910) (#10282) Lianmin Zheng 2025-09-10 16:58:59 -07:00
• f3b5db6ee8 Feat: support disable tool parser (#10184) Xinyuan Tong 2025-09-10 14:03:55 -07:00
• 2286e85e77 pass a_scale from fp8 quant result instead of hard code to 1.0f (#10241) Rain Jiang 2025-09-10 12:56:05 -07:00
• 91b3555d2d Add tests to AMD CI for MI35x (#9662) Hubert Lu 2025-09-10 12:50:05 -07:00
• 9e2f7252db add dual stream for qwen2_moe (#10252) Yi Zhang 2025-09-11 03:49:43 +08:00
• 21176b0093 [Bugfix] Fix Weightloading for the original nvidia/Deepseek-R1-FP4 checkpoint (#9940) Pavani Majety 2025-09-10 12:00:23 -07:00
• 941002945b [1/2] Refactor LoRA to support backend-specific batch preprocessing. (#10251) Lifu Huang 2025-09-10 09:58:37 -07:00
• cda7e47ce7 [router] Add PD router mmlu test (#10256) Keyang Ru 2025-09-10 08:47:24 -07:00
• e903f695c8 Fix potential flakiness in test_lora_qwen3 (#10250) Lifu Huang 2025-09-10 01:04:39 -07:00
• 27760fc1b6 [Auto Sync] Update io_struct.py (20250910) (#10262) Lianmin Zheng 2025-09-10 00:16:37 -07:00
• 0ac809de33 Fix assertion typo in tp_worker.py (#9954) Seunggeun Cho 2025-09-10 14:43:50 +09:00
• 4efe2c57c9 support vlm model spec bench (#10173) Lzhang-hub 2025-09-10 13:37:04 +08:00
• 5be8c2f7f7 Page first direct IO kernel (#10060) huangtingwei 2025-09-10 13:35:34 +08:00
• 737d73ed5b Fix: the default choice is wrong for flashinfer mxfp4 moe precision (#10253) Yiyu Liu 2025-09-10 00:10:38 -04:00
• ebd0e1c18b [doc] add walkthrough for implementing and hosting a simple llama wrapper m… (#10093) Glen Liu 2025-09-10 00:05:06 -04:00
• a1d038924b [Benchmark] Prefil-only benchmark scripts (#10240) Sundara Raman Ramachandran 2025-09-09 19:59:07 -07:00
• dccf52f9c8 [UT for RL] Add UT to cover release/resume memory case for moe model (#8803) ryang 2025-09-10 10:25:12 +08:00
• 676a7b51bd make --speculative-draft-model an alias of --speculative-draft-model-path (#10246) Lianmin Zheng 2025-09-09 19:12:24 -07:00
• 15f993472c refactor(InternVL): Use gpu to preprocess the input image (#9795) Kevin Tuan 2025-09-10 10:09:04 +08:00
• bcf1955f7e Revert "chore: upgrade v0.3.9 sgl-kernel" (#10245) Lianmin Zheng 2025-09-09 19:05:20 -07:00
• a06bf66425 [Auto Sync] Update collector.py, startup_func_log_and_timer... (20250910) (#10242) Lianmin Zheng 2025-09-09 18:05:16 -07:00
• bf72b80122 [Auto Sync] Update io_struct.py (20250909) (#10236) Lianmin Zheng 2025-09-09 14:15:21 -07:00
• 8cbe1538ef Add mamba kernel (#10234) Yi Zhang 2025-09-10 03:58:43 +08:00
• 8471e5e616 [HiCache] feat: add mooncake backend extra config (#10213) Teng Ma 2025-09-10 03:50:00 +08:00
• 4582931ac3 Revert "Revert the changes on NCCL symmetric memory" (#10238) Lianmin Zheng 2025-09-09 12:11:49 -07:00
• d352c29aa0 Revert the changes on NCCL symmetric memory (#10210) Lianmin Zheng 2025-09-09 11:01:33 -07:00
• d3ee70985f chore: upgrade v0.3.9 sgl-kernel (#10220) Yineng Zhang 2025-09-09 03:16:25 -07:00
• 71fc7b7fad [Fix] KV-cache eviction mismatch across PP ranks in DeepSeek V3/R1 (#10214) Rain H 2025-09-09 17:07:13 +08:00
• 9ab72f9895 add variable TP Decode > Prefill size support (#9960) shaharmor98 2025-09-09 11:47:26 +03:00
• f3817cb0b2 chore: bump v0.3.9 sgl-kernel (#10208) Yineng Zhang 2025-09-09 01:40:05 -07:00
• 71133a0426 [Auto Sync] Update sampling_batch_info.py (20250909) (#10212) Lianmin Zheng 2025-09-09 01:29:52 -07:00
• 2cd94dd07e tool-call(dsv3): Fixed a parse problem when there are multiple function definitions in tool_calls (#10209) Yiming 2025-09-09 15:47:28 +08:00
• f5f6b3b4b5 Refactor fused_add_rmsnorm import logic (#10207) Shangming Cai 2025-09-09 15:23:58 +08:00
• 94fb4e9e54 feat: support fa cute in sgl-kernel (#10205) Yineng Zhang 2025-09-09 00:14:39 -07:00
• d1d4074c4e [CPU] Add gelu_and_mul kernel in sgl-kernel and add ut (#9300) blzheng 2025-09-09 14:23:13 +08:00
• 718f25ae6e Explicitly export CMAKE_BUILD_PARALLEL_LEVEL (#10193) Keyang Ru 2025-09-08 22:35:27 -07:00
• 948b01a04c [Refactor] Remove Hicache Load & Write threads (#10127) DarkSharpness 2025-09-08 22:18:50 -07:00
• cdc56ef6c1 feat: use sgl-kernel cu129 as default (#10188) Yineng Zhang 2025-09-08 22:01:17 -07:00
• 16ff3d4b05 Support opt model (#10165) wenhuipeng 2025-09-09 12:45:00 +08:00
• 83d55ac51f [1/N]DP refactor: Improve dp rank scheduling in PD disaggregation mode. (#10169) Liangsheng Yin 2025-09-09 12:27:55 +08:00
• 2fe17735a6 Updated Nvidia Jetson docs (#4422) Shakhizat Nurgaliyev 2025-09-09 08:41:21 +05:00
• 97fff98c68 [CPU] Fix phi4-mm prompt issue in bench_serving (#9900) blzheng 2025-09-09 11:12:32 +08:00
• ba066ca02f Update link for EAGLE speculative decoding (#10191) geray 2025-09-09 11:09:50 +08:00
• 96784a65fd [Fix] Orphan process in data parallel (#7995) Caproni 2025-09-09 11:09:09 +08:00
• df5407fb53 Revert "feat: add fused moe config for Qwen3-30B-A3B on B200" (#10185) Rain Jiang 2025-09-08 18:11:15 -07:00
• 8ad700f735 Cleaning codes for speculative attention mode (#10149) Baizhou Zhang 2025-09-08 17:38:06 -07:00
• 148022fc36 gb200: update dockerfile to latest kernel (#9522) ishandhanani 2025-09-08 17:32:36 -07:00