Commit Graph

Select branches

Hide Pull Requests

cch/megamoe-rc-v0.1

Mono Color

• f39037fffb HiCache Fix (#8288) Zhiqiang Xie 2025-07-23 01:51:32 -07:00
• ce86e201df bug fix and tag (#8282) Zhiqiang Xie 2025-07-23 01:50:31 -07:00
• b43263307f Hicache IO kernel refactoring (#8264) Zhiqiang Xie 2025-07-23 01:49:03 -07:00
• 8abd3e77fe Introduce Stable LoRA ID System for Overlapped Updates and Prefix Caching (#8261) Lifu Huang 2025-07-23 00:32:16 -07:00
• e885bfdc6a Fix sgl-kernel ci test (#8284) Ke Bao 2025-07-23 14:01:47 +08:00
• e2d66f60c8 Skip llama4 vision module loading when multimodal disabled (#8272) Ke Bao 2025-07-23 12:41:25 +08:00
• 01c000043c chore: bump v0.4.9.post3 (#8265) Yineng Zhang 2025-07-22 15:55:48 -07:00
• 0dfe2491ac Preliminary Support for Qwen3XMLDetector (#8260) yhyang201 2025-07-23 06:49:38 +08:00
• ff45ab7a5f [Benchmark] add disable-auto-run param for hicache/bench_multiturn (#7822) zhongwei 2025-07-23 05:02:40 +08:00
• 0f8b538614 [fix] benchmark : routed_scaling_factor is None (#8059) Peter Pan 2025-07-22 23:55:35 +08:00
• c33499a67b fix: sgl-router remove dead code (#8257) Rui Chen 2025-07-22 23:41:23 +08:00
• e50109f2ed [AMD] Remove vllm's scaled_fp8_quant and moe_sum when SGLANG_USE_AITER=1 (#7484) Hubert Lu 2025-07-21 17:33:19 -07:00
• 69adc4f81c fix: retrieve mm token by modality, raise error if none (#8221) Xinyuan Tong 2025-07-21 17:06:35 -07:00
• 114837854f docs: update 2025 h2 roadmap (#8237) Yineng Zhang 2025-07-21 14:02:48 -07:00
• 7b68d27111 [Feature] Add a test for Layer-wise Prefill (#8231) Xiaoze Fan 2025-07-21 22:06:15 +08:00
• 74f59ae555 chore: upgrade sgl-kernel 0.2.6.post1 (#8202) Yineng Zhang 2025-07-21 02:10:24 -07:00
• 6936be3221 Remve router gemm output dtype conversion (#8204) Ke Bao 2025-07-21 15:37:00 +08:00
• 9b5de6cb06 [router] upgade router version to 0.1.6 (#8209) Simo Lin 2025-07-20 23:13:20 -07:00
• 5c8365a051 [router] add ut for pd router (#8208) Simo Lin 2025-07-20 23:12:52 -07:00
• 8430bfe3e9 [Refactor] simplify multimodal data processing (#8107) Xinyuan Tong 2025-07-20 21:43:09 -07:00
• c9e8613c97 Apply fused sorted token ids padding (#8193) Ke Bao 2025-07-21 11:19:48 +08:00
• 429bb0efa2 chore: bump sgl-kernel v0.2.6.post1 (#8200) Yineng Zhang 2025-07-20 19:50:28 -07:00
• 7eebd44047 [fix] fix modelopt fp4 on b200 (#8195) JieXin Liang 2025-07-21 08:39:57 +08:00
• 93d124ef5a [feature] enable NPU CI (#7935) ronnie_zheng 2025-07-20 23:12:42 +03:00
• 1fc455e8b6 [router] add ut for pd request, metrics and config (#8184) Simo Lin 2025-07-20 10:53:42 -07:00
• 465968b2e3 Fix dtype error in CI (#8197) Ke Bao 2025-07-21 00:27:55 +08:00
• 750838adc4 fix: fix the bug of loading Internvl3 (#8067) GuoYipin 2025-07-20 22:22:54 +08:00
• 99aefa037e Fix eagle3 cuda graph (#8163) Jay Zhou 2025-07-20 00:28:06 -07:00
• bbcfbc1a02 feat: add h200 tp 16 kimi k2 moe config (#8183) Qiaolin Yu 2025-07-20 02:30:08 -04:00
• 83c104b188 Feat: Support for Persimmon Model (#7983) Praneth Paruchuri 2025-07-20 11:37:47 +05:30
• 2db6719cc5 feat: update nccl 2.27.6 (#8182) Yineng Zhang 2025-07-19 22:55:45 -07:00
• 55381a46ac Revert "[Feature] Simple Improve Health Check Mechanism for Production-Grade Stability" (#8181) Lianmin Zheng 2025-07-19 22:41:30 -07:00
• a589a07167 fix moe gate dtype, fix tbo, fix fake dispatch (#7825) Atream 2025-07-20 13:13:46 +08:00
• f62d75b6a1 feat: add b200 tp 16 kimi k2 moe config (#8178) Yineng Zhang 2025-07-19 20:04:12 -07:00
• 0f9b11e310 feat: add h200 tp 16 kimi k2 moe config (#8176) Yineng Zhang 2025-07-19 20:04:02 -07:00
• 877e35d775 Add get_hidden_dim to qwen3.py for correct lora (#7312) Pavel Logachev 2025-07-20 05:31:16 +03:00
• cbdfb77123 Enable FlashInfer support encoder models and add head_dim padding workaround (#6230) Clay 2025-07-20 10:30:16 +08:00
• 282eb59ff3 Add bf16 output option for dsv3_router_gemm kernel (#7999) Baizhou Zhang 2025-07-19 18:49:37 -07:00
• 4540a4666a [Feature] Simple Improve Health Check Mechanism for Production-Grade Stability (#8115) ybyang 2025-07-20 09:10:00 +08:00
• abda2542d5 Fix tuning_fused_moe_triton.py (#8175) Cheng Wan 2025-07-19 17:33:50 -07:00
• 8cddfa56a1 Clean warning logs for gate_proj loading in Lora (#8172) Baizhou Zhang 2025-07-19 15:56:50 -07:00
• 4e3defe5a7 Support start up LoRA server without initial adapters (#8019) Lifu Huang 2025-07-19 15:38:09 -07:00
• 60468da4e2 bugfix: fix sglang crash in NVIDIA MIG container (#8167) Garry Fang 2025-07-20 05:41:27 +08:00
• 41d33e4736 [router] add ut for worker and errors (#8170) Simo Lin 2025-07-19 14:38:33 -07:00
• bfdd226f35 Fix Dockerfile.gb200 (#8169) kyleliang-nv 2025-07-19 14:37:53 -07:00
• 3de617a75b Fix LoRA buffer contamination during adapter eviction (#8103) Lifu Huang 2025-07-19 13:14:08 -07:00
• bb0e8a32b5 Clean up server args (#8161) Lianmin Zheng 2025-07-19 11:32:52 -07:00
• 1b427dae02 Update README.md (#8171) Lianmin Zheng 2025-07-19 11:04:19 -07:00
• f3d9736156 Fix suffix mismatch for the metrics. (#8168) Charles Chen 2025-07-20 01:11:24 +08:00
• 561dd7b2ce chore: upgrade sgl-kernel 0.2.6 (#8166) Yineng Zhang 2025-07-19 03:17:08 -07:00
• f98e88b9fb chore: bump sgl-kernel v0.2.6 (#8165) Yineng Zhang 2025-07-19 00:56:18 -07:00
• 15ad6c9086 [1/N] MoE Refactor: refactor select_experts (#7966) Cheng Wan 2025-07-19 00:51:15 -07:00
• cfab0ff6e2 Add GB200 wide-EP docker (#8157) kyleliang-nv 2025-07-18 22:34:29 -07:00
• b763cf7e8e [router] allow router to have empty workers (#8160) Simo Lin 2025-07-18 22:09:54 -07:00
• 8fcc55cfa1 [router] router metrics cleanup (#8158) Simo Lin 2025-07-18 22:09:17 -07:00
• 610381b75e [health_generate] fix: fix the /health_generate always success bug (#8028) Yingchun Lai 2025-07-19 13:08:46 +08:00
• 1403ea5694 [PD] Support non-MLA models PD different TP with DP attention (#7931) Shangming Cai 2025-07-19 13:00:49 +08:00
• b7e951a6db Feat: Support audio in Phi4-mm model (#8048) Binyao Jiang 2025-07-18 21:03:53 -07:00
• d918ab7985 Support NVFP4 quantized dense models on AMD CDNA2/CDNA3 GPUs (#7302) Haohui Mai 2025-07-18 19:59:39 -07:00
• 3964b352c3 chore: tune mem fraction static for vlm (#6881) Mick 2025-07-19 08:19:27 +08:00
• 9c7a46180c [Doc] Steps to add a new attention backend (#8155) Lianmin Zheng 2025-07-18 16:38:26 -07:00
• 7750b91ca8 [AMD] Add triton awq_dequantize kernel to support AWQ on ROCm (#7661) Hubert Lu 2025-07-18 14:27:25 -07:00
• c8f31042a8 [router] Refactor router and policy traits with dependency injection (#7987) Simo Lin 2025-07-18 14:24:24 -07:00
• 1f76fc8747 [3/n] chore: decouple AWQ implementation from vLLM dependency (#8113) Hongbo Xu 2025-07-19 02:45:22 +08:00
• 6737671c82 [Bugfix] Fix w8a8_int8 import error on NPU (#8147) Even Zhou 2025-07-19 02:34:55 +08:00
• fd63b62eaa fix compressed tensors WNA16 imports (#8142) Enrique Shockwave 2025-07-18 19:34:14 +01:00
• 719b29f218 feat: enchance green context stream creation robust with backward compatibility (#8136) Peng Zhang 2025-07-18 17:45:03 +08:00
• d0510f08fe Revert "Fix different device type adjustment in PP" (#8141) Sai Enduri 2025-07-18 01:12:11 -07:00
• 9d33fcfb8e Hicache Storage Layer Prototype (#7704) Zhiqiang Xie 2025-07-18 00:20:19 -07:00
• 7891bac16b [Quantization][w8a8_int8] Fix weight loading issue for w8a8_int8 path with "ignore" layer list in quantization config (#7820) jianan-gu 2025-07-18 13:03:56 +08:00
• 48c1fa7bb6 [CPU][Llama4] Fix Llama4 MoE inputs with "apply_router_weight_on_input" (#7889) jianan-gu 2025-07-18 12:43:25 +08:00
• 8aa5ae6b04 load draft model fix (#7506) yilian49 2025-07-18 00:41:32 -04:00
• 8a32355704 Feat: Support Granite 3.0 MoE in SGLang (#7959) Minglei Zhu 2025-07-17 20:56:03 -07:00
• 6e92da8fca [Fix][Ready]Fix register spilling in cutlass nvfp4 gemm kernel on Blackwell (#8127) Qi Yuhang 2025-07-18 11:49:36 +08:00
• e1020dc588 refactor: simply MultimodalTokens logic (#7924) Mick 2025-07-18 08:59:15 +08:00
• 3586b4cef2 feat: add production metric for retracted requests due to insufficient kvcache (#7030) Zhao Chen 2025-07-18 02:59:05 +08:00
• 4296021499 [Hunyuan]: Fix Dense Model Support (#8117) Asher 2025-07-18 01:00:11 +08:00
• 01857fab61 fix: update HostKVCache init to report correct msg when available memory is not enough (#8102) Ziqi Fan 2025-07-17 06:24:34 -07:00
• 519ff5c8e6 Super tiny fix typo (#8046) fzyzcjy 2025-07-17 21:15:51 +08:00
• af1cc8fe2d [kernel] opt moe align block kernel by block/warp scan algorithm (#7884) Yuan Luo 2025-07-17 19:33:02 +08:00
• 49b8777460 Refactor: move all quantization-related code to srt/layer/quantization (#7989) Cheng Wan 2025-07-17 00:47:07 -07:00
• 02404a1e35 [ci] recover 8-gpu deepep test (#8105) Cheng Wan 2025-07-17 00:46:40 -07:00
• 5c08a36cbf [Fix] ensure DeepGEMM is only enabled for FP8_W8A8 models (#8110) hzh0425 2025-07-17 12:33:29 +08:00
• 9069884b51 [ci] disable memory imbalance check for draft worker (#8108) Cheng Wan 2025-07-16 20:41:47 -07:00
• 8a7a7770e5 [ci] limit cmake build nproc (#8100) Simo Lin 2025-07-16 18:09:28 -07:00
• 795668dc73 feat: add tp_rank, pp_rank and dp_rank labels for scheduler metrics (#7597) Yingchun Lai 2025-07-17 08:55:59 +08:00
• 4395c87a9b refactor: unify names of the feature field of MultimodalDataItem (#8075) Mick 2025-07-17 08:52:38 +08:00
• c28ad1990d [1/n] chore: decouple quantization implementation from vLLM dependency (#7992) Peng Zhang 2025-07-17 06:56:26 +08:00
• 570d33437b [Feature] Layer-wise Prefill (#7634) Xiaoze Fan 2025-07-17 01:57:46 +08:00
• d9eb5efc71 [misc] update nvshmem and pin deepEP commit hash (#8098) Simo Lin 2025-07-16 08:54:55 -07:00
• 6dc4af4937 fix greenctx stream compability (#8090) Peng Zhang 2025-07-16 22:08:46 +08:00
• b188a89a5d Fix CI xeon test with triton 3.3.1 (#8086) YanbingJiang 2025-07-16 17:12:23 +08:00
• 497efe747d Revert "feat: replace Decord with video_reader-rs" (#8077) Mick 2025-07-16 11:04:56 +08:00
• 69f453e5a4 Use device_group for all_gather when disabling overlap scheduling (#8001) Qiaolin Yu 2025-07-15 19:38:58 -07:00
• 3bc43c683e Fix different device type adjustment in PP (#7760) Qiaolin Yu 2025-07-15 19:37:14 -07:00
• 7498522f7d update transformers to 4.53.2 (#8029) Xinyuan Tong 2025-07-15 18:24:39 -07:00
• 194841e329 remove kv_a.congigous in DeepseekV2AttentionMLA (#8058) strgrb 2025-07-16 09:20:41 +08:00
• ebff5fcb06 feat: replace Decord with video_reader-rs (#5163) kozo 2025-07-16 09:17:34 +08:00
• f06bd210c0 Update amd docker image. (#8045) Sai Enduri 2025-07-15 15:09:56 -07:00
• 14f1f1514b H20 tune config for Kimi (#8047) yhang 2025-07-16 04:48:31 +08:00