Commit Graph

Select branches

Hide Pull Requests

cch/megamoe-rc-v0.1

Mono Color

• 15ed27d7d4 [Fix] concat_mla_absorb_q_kernel fails for long inputs (#12453) bingps 2025-11-03 03:52:06 +08:00
• 66fb9b1307 [ServerArgs] allow --mamba-ssm-dtype extend (#12481) Hanming Lu 2025-11-02 11:50:04 -08:00
• 819fc59123 Add prefix for torch symm mem (#12506) Yuan Luo 2025-11-03 03:23:05 +08:00
• 7efd8b3d1f [FEAT] Shared mem pool based cuda ipc for multi-modal data transport (#11917) kousakawang 2025-11-02 16:46:37 +08:00
• a920b9dace chore: bump sgl-kernel version to 0.3.16.post5 (#12511) sglang-bot 2025-11-02 14:08:11 +08:00
• 76196b3cbf feat: Add FP4 (E2M1) KV Cache Support with Quantization Utilities for MLA (#10078) Ho-Ren (Jack) Chuang 2025-11-01 22:24:58 -07:00
• 95191ebdca Migrate weak_ref_tensor to sgl-kernel (#12505) Xiaoyu Zhang 2025-11-02 10:55:39 +08:00
• 9a512cf95b [CI] Move some Lora/Deterministic CI tests to nightly (#12507) Baizhou Zhang 2025-11-01 19:54:22 -07:00
• 3451fc3280 [Feature] Qwen3-Next & FLA: Support MTP topk>1; Up to 6% faster (#11133) Binyao Jiang 2025-11-01 19:47:56 -07:00
• c550ab9125 [Ascend] Add Ascend NPU support for sglang.check_env & rework proposal (#11052) Zhihao Lyu 2025-11-02 10:26:45 +08:00
• 086f0b79fc [CI][NPU] remove pypi mirror site that hangs ci dependency installation (#12499) Even Zhou 2025-11-02 10:25:53 +08:00
• 0afd68321b Update Mooncake EP's a2a interface (#12391) Xun Sun 2025-11-02 09:48:47 +08:00
• 6f858930c8 [Bug] test_flashattn_mla_backend errors in Hopper #12487 (#12488) Johnsonms 2025-11-01 18:28:06 -07:00
• 229256c505 [Deterministic] add deepseek v3 deterministic inference CI test (#12412) Minglei Zhu 2025-11-01 18:10:32 -07:00
• 6b634493c3 [HICache / PD]: Support offloading incremental KV cache in decode side. (#11966) hzh0425 2025-11-02 05:59:37 +08:00
• 756ad9ceb1 Reduce docker image size. mount cache when use pip/cargo build (#12238) ybyang 2025-11-02 05:58:04 +08:00
• d2a8f71c2f [feat] Add SGLANG_TOOL_STRICT_LEVEL for tool-call behavior control (#12423) Xinyuan Tong 2025-11-01 13:15:02 -07:00
• 2b7bf11bd2 [Hotfix] Remove extra comment in sgl-kernel README (#12500) Baizhou Zhang 2025-11-01 12:22:45 -07:00
• 566ade0388 [CI] Build aarch64 kernels for sgl-kernel test (#12480) Baizhou Zhang 2025-11-01 11:55:42 -07:00
• 69193f7122 Filter tokenizer warning for kimi models (#12485) Ke Bao 2025-11-01 16:27:31 +08:00
• d5b6e50fe8 perf: trtllm mla performance minor improvements (#12435) yinghui 2025-10-31 22:48:02 -07:00
• 9632e48f5d [hot fix] Remove from python.sglang.xxx (#12483) Liangsheng Yin 2025-11-01 11:00:05 +08:00
• 59cce5941a Use sgl fp4 quant kernel by default (#12482) Qiaolin Yu 2025-10-31 19:51:28 -07:00
• 795e98f8a6 Forward unknown tool calls instead of dropping (#12226) Surya-Gunukula 2025-10-31 19:10:35 -07:00
• 358ae3563d Tiny fix eos handling for PD disaggregation (#12334) Shangming Cai 2025-11-01 08:57:10 +08:00
• 41c10e67fc chore: bump SGLang version to 0.5.4.post2 (#12439) sglang-bot 2025-11-01 08:38:50 +08:00
• 0bfe1d145c fa3 & trtllm_mha spec overlap (#11874) Xinyuan Tong 2025-10-31 17:38:13 -07:00
• 5f98b7fe61 [CI] Fix kernel installation on aarch runners (#12475) Baizhou Zhang 2025-10-31 14:25:27 -07:00
• a4bf5c6ad2 Support Kimi Linear (#12469) Ke Bao 2025-11-01 05:03:35 +08:00
• 30ad107028 Try to allow NCCL cumem for multi node nvlink case (#11987) fzyzcjy 2025-11-01 03:48:25 +08:00
• a80bcb5a68 Add env var to disable FA4 warmup (#12430) yinghui 2025-10-31 12:25:00 -07:00
• f7f9e41b36 Fix run benchmark (#12473) Ke Bao 2025-11-01 02:39:48 +08:00
• 263eab9f5d fix: dummy health check server not accessible on non-zero rank nodes (#12297) ishandhanani 2025-10-31 11:34:57 -07:00
• 25257d8e00 Tiny assert no running requests when releasing memory to avoid IMA (#12341) fzyzcjy 2025-11-01 01:28:53 +08:00
• cf0c24150a add served model name in bench serving (#12428) daniel, chen 2025-11-01 01:28:11 +08:00
• 5538e05cb1 fix default env var for mooncake store (#12429) huangtingwei 2025-11-01 01:25:33 +08:00
• c30ebb9300 [VLM] Optimize async mm data process mechanism (#12066) Yuan Luo 2025-11-01 01:24:53 +08:00
• 41efcaeb45 [Feature] PD-Multiplexing Context and Scheduler, lazy import spatial. (#12275) ykcombat 2025-11-01 00:40:01 +08:00
• 70562969b9 [Bug] OOM (Out-of-Memory) errors for extreme testing scenarios (min_tokens=2) (#11757) 0xNullPath 2025-11-01 00:28:41 +08:00
• b57dc169eb [Test] Add Functional Tests for Penalty Parameters (#11931) Neelabh Sinha 2025-10-31 09:10:17 -07:00
• 0095e01874 Fix lint in deepseek-ocr (#12470) Ke Bao 2025-11-01 00:08:19 +08:00
• 684864814b Feat: deepseek-ocr logits processor (#12415) Xinyuan Tong 2025-10-31 08:35:22 -07:00
• 410225b719 [Bug fix] Fix severe memory waste issue with torch.empty pin_memory (#12266) sjtu_shenhai 2025-10-31 21:30:37 +08:00
• 2c9aebea70 Simplify watchdog (#12463) Liangsheng Yin 2025-10-31 21:17:38 +08:00
• bc741073a3 fix:watchdog thread exception (#12328) Kindyaa 2025-10-31 20:54:50 +08:00
• 2f6af1a3de Enable bailing_moe to support TP=16 (#12369) Yuhong Guo 2025-10-31 19:32:49 +08:00
• 50b6842b4b fix: Add default value for backend in sample_mmmu_requests (#12256) Zaili Wang 2025-10-31 19:31:40 +08:00
• 2d5605e89b Fix ci install to allow prerelease (#12449) Lianmin Zheng 2025-10-31 02:22:15 -07:00
• 300b4c212e [CI] fix possible port conflicts. (#12452) Liangsheng Yin 2025-10-31 17:20:20 +08:00
• c0652d907b Clean up sgl kernel (#12413) Lianmin Zheng 2025-10-31 01:13:34 -07:00
• 2e48584b62 [bugfix] set is_prefill_only=false when mixed_chunk (#10889) Bruce-x-1997 2025-10-31 15:12:21 +08:00
• 57cc5385c0 [CI] Add more bins for 1-gpu CI test (#12422) Baizhou Zhang 2025-10-31 00:05:01 -07:00
• 5cc0d25a0d Add trait for BasePrefixCache (#12436) Liangsheng Yin 2025-10-31 14:03:27 +08:00
• a076ec1a7a Revert "fix llama4 kv cache layout" (#12437) b8zhong 2025-10-30 22:33:37 -07:00
• 72b5f3d0bb [ci] install released version router (#12410) Keyang Ru 2025-10-30 21:59:08 -07:00
• 2f766f381d [Bugfix]: distinguish processors for deepseek_vl2 and deepseek_ocr to p… (#12384) bppps 2025-10-31 12:51:30 +08:00
• 069e490bcb feat: support trtllm_mha FP8 query attention kernel (#12307) elvischenv 2025-10-31 12:39:35 +08:00
• ab95d35fcb feat: Add Non-intrusive Tensor Dumping for Model Inference (#10566) Yuhong Guo 2025-10-31 12:04:48 +08:00
• 34c286b811 Fix the shared expert & routed expert overlap in Llama 4 (#12405) b8zhong 2025-10-30 20:14:49 -07:00
• 9416ee60dd Reserved abortion API when retracting (#12425) Liangsheng Yin 2025-10-31 10:56:05 +08:00
• d4a09ec9dc [CI] fix tests' time estimation (#12401) Liangsheng Yin 2025-10-31 10:20:35 +08:00
• 662725b936 [DeepSeekV32] Bug fix to ensure page_table and result in same type (#12300) Johnsonms 2025-10-30 18:56:51 -07:00
• 82cfcd3bb8 [Refactor] tuning_fused_moe for MLLM and small refactor (#11224) Xinyuan Tong 2025-10-30 17:54:14 -07:00
• 6c1a3f0cb2 enable cudaProfilerApi for one batch benchmarking (#11116) lpc0220 2025-10-30 15:43:59 -07:00
• 6237754842 [router] 0.2.2 release (#12399) Simo Lin 2025-10-30 14:40:13 -07:00
• 96ac24c09e [router] web_search_preview tool basic implementation (#12290) Keyang Ru 2025-10-30 14:37:28 -07:00
• c0d02cf4d1 [NVIDIA] Add CI workloads for GB200 (#12242) Kaixi Hou 2025-10-30 14:32:03 -07:00
• 7d121448b2 [Bug fix][PD Dissaggregation] fix prefill hanging issue with PP and DP Attention, (#12368) popsiclexu 2025-10-31 05:22:47 +08:00
• 6a63a9852e minor code sync (#12403) Lianmin Zheng 2025-10-30 12:49:31 -07:00
• 4d2f17bd0b [router] Function call support for openai router Responses API (#12386) Keyang Ru 2025-10-30 12:45:10 -07:00
• 7cd716f776 Update news section in README.md (#12409) Lianmin Zheng 2025-10-30 12:41:21 -07:00
• b7fdde4bb4 [ci] Fix ci_install_deepep (#12375) Baizhou Zhang 2025-10-30 11:39:14 -07:00
• 69bf801173 [router] Fix safety_identifier missing (#12404) Keyang Ru 2025-10-30 10:40:50 -07:00
• d8fcbaa38d [CI Monitor] Fix ci_monitor perf analyzer bug (#12281) Xiaoyu Zhang 2025-10-31 00:47:12 +08:00
• 2cf3d0f89f [router] use safety_identifier replace user on chat history storage (#12185) rongfu.leng 2025-10-30 23:47:22 +08:00
• 1ed1abfd45 feat: add EP support in tuning (#12012) Chen1022 2025-10-30 22:58:50 +08:00
• ecb9fa14e6 [docker] clean up main dockerfile for router and dev configurations (#12364) Chang Su 2025-10-30 10:46:09 -04:00
• 700daa3463 [router] harmony responses api streaming support (#12395) Simo Lin 2025-10-30 07:30:48 -07:00
• 39cee0fed2 [sgl-kernel] upd deepgemm hash to rebased commit (#11960) Fan Yin 2025-10-30 22:19:00 +08:00
• 04e5b6faa7 Revert "Triton fused_moe_kernel support ep moe tuning" (#12377) Xiaoyu Zhang 2025-10-30 22:12:06 +08:00
• ce6b17c0f9 [Feature] Support DeepSeek MTP on NPU (#11897) Even Zhou 2025-10-30 21:56:56 +08:00
• cafebef154 [NPU] bugfix for Qwen3-Next and performance update (#11969) Even Zhou 2025-10-30 21:52:16 +08:00
• 73dfd2dfb1 [Test] Enhance radix cache test for spec cases (#12394) Liangsheng Yin 2025-10-30 18:46:28 +08:00
• df5192cffa Enable fast silu-and-mul-and-quant fused kernel (#11806) fzyzcjy 2025-10-30 18:15:39 +08:00
• 78c43d8847 [Feature] Initial eagle3 support for Deepseek-like models (#12319) JensenFire 2025-10-30 17:26:09 +08:00
• 7e28c67d19 Fix DeepSeek chat templates to handle tool call arguments type checking (#11700) (#12123) Kangyan-Zhou 2025-10-30 01:39:25 -07:00
• 3edba9bcc0 [fix] added image token as prefix for deepseek-ocr (#12358) Tanjiro 2025-10-30 14:07:03 +05:30
• e5ec976402 [Bug fix][PP] fix deadlock with tie_word_embeddings (#12362) Xuchun Shang 2025-10-30 16:03:28 +08:00
• 621dfb8886 Import flash_mla from sgl-kernel (#12135) Baizhou Zhang 2025-10-29 23:54:21 -07:00
• fb52d35f63 Super tiny fix AMD ci (#12378) fzyzcjy 2025-10-30 14:25:18 +08:00
• 2b71531a70 Allow benchmarking tool to handle empty response (#12174) Kangyan-Zhou 2025-10-29 20:26:23 -07:00
• 25c5049870 Super tiny add tag for benchmark scripts (#12340) fzyzcjy 2025-10-30 11:19:14 +08:00
• 8e2ac2e628 [NPU] fix pp_size>1 (#12195) Makcum888e 2025-10-30 06:18:36 +03:00
• 17a57fd862 [Perf] Optimize multimodal mm_inputs process in scheduler (#11910) Yuan Luo 2025-10-30 10:48:10 +08:00
• 32438eba45 [Ckpt Engine] feat: new sglang entrypoint support for update (#12216) Teng Ma 2025-10-30 10:39:27 +08:00
• fed02a49c2 [bugfix] fix deepseekvl2 and deepseek_ocr model type conflict (#12050) FlyPanda 2025-10-30 09:54:32 +08:00
• 03b3e89aea [router] Harmony Pipeline: Chat Completion & Responses API with MCP Support (#12153) Simo Lin 2025-10-29 18:52:56 -07:00
• 9ff9fa7f95 Fuse wk and weight_proj in Indexer for DeepSeekV3.2-FP4 (#12094) Trevor Morris 2025-10-29 18:42:56 -07:00
• 7ed8ba05cb [CI] Add Llama 3.1 8B FP4 to B200 CI (#12182) b8zhong 2025-10-29 14:56:41 -07:00
• df08f346ce Fix Duplicate Classmethod in spec_info.py (#12354) Stefan He 2025-10-29 13:57:10 -07:00