Commit Graph

Select branches

Hide Pull Requests

cch/megamoe-rc-v0.1

Mono Color

• f515449582 Fix gpt-oss response api streaming issue (#9368) Keyang Ru 2025-08-19 20:19:42 -07:00
• e0ce171d79 Fix triton backend eagle illegal memory access (#9344) Ke Bao 2025-08-20 11:16:26 +08:00
• fe43e889f8 Fix mini lb timeout issue (#9369) fzyzcjy 2025-08-20 11:15:16 +08:00
• 5ae5ecaa15 [router] Implement OpenAI Responses API specification (#9367) Keyang Ru 2025-08-19 20:14:47 -07:00
• 5fbad308cd [router] add tokenizer chat template support (#9370) Simo Lin 2025-08-19 20:14:02 -07:00
• 7638f5e44e [router] Implement gRPC SGLangSchedulerClient (#9364) Chang Su 2025-08-19 16:44:11 -07:00
• b45f753cba [router] adds reasoning parser pooling and thread-safe (#9360) Simo Lin 2025-08-19 13:35:39 -07:00
• c5057262fa [Router] Add validation module for API parameters (#9335) Keyang Ru 2025-08-19 13:25:53 -07:00
• 46fe8b8cb2 [CI] Fix lint issues (#9361) Chang Su 2025-08-19 13:05:36 -07:00
• 0b95a01a8f [router] add tiktokenizer and sequence in router (#9354) Simo Lin 2025-08-19 10:46:28 -07:00
• a3b810ebdb fix: enable multi-GPU Triton fused MoE tuning (#6295) mpashkovskiy 2025-08-19 20:16:58 +03:00
• 94959237bf [router] add dsr1, kimi, and qwen reasoning parser (#9353) Simo Lin 2025-08-19 10:15:24 -07:00
• f4fafacc5d Revert "[feature] Ascend NPU graph support (#8027)" (#9348) Even Zhou 2025-08-20 01:11:23 +08:00
• 01d47a27b6 [Bugfix] fix kv buffer register & dp attention & deepepmoe (#9327) chenxu140 2025-08-20 01:09:48 +08:00
• ecc9f3e47a [Minor] Fix the style of sgl-kernel (#9332) Lianmin Zheng 2025-08-18 23:45:00 -07:00
• 7e8187e004 docs: fix spec (#9326) Yineng Zhang 2025-08-18 19:35:46 -07:00
• e483ab6d20 enable marlin fp8 blockwise (#8990) Enrique Shockwave 2025-08-19 02:53:15 +01:00
• 720cd308ba Add CMakeLists.txt binary_dir (#7019) EduardDurech 2025-08-19 03:36:33 +02:00
• ce67b2d586 [router]restructure protocol modules for better organization (#9321) Keyang Ru 2025-08-18 18:07:58 -07:00
• 3c2c9f6c9e [Bug] Fix input arguments of flashinfer_trtllm_moe (#9317) Jiaqi Gu 2025-08-18 18:03:19 -07:00
• a31ea44824 support for interns1-mini (#9299) zxy 2025-08-19 08:56:04 +08:00
• 439df4548a [router] Add spec for sglang scheduler (#9322) Chang Su 2025-08-18 17:20:20 -07:00
• 5626e20b2b Tiny fix CI (#9306) fzyzcjy 2025-08-19 07:54:36 +08:00
• c6c379ab31 [AMD] Reorganize hip-related header files in sgl-kernel (#9320) Hubert Lu 2025-08-18 16:53:44 -07:00
• c2fbf60f39 [GLM4.1V and GLM4.5V] Add vision transformer num_dummy_head support: max tp=4 -> max tp=8 (#9059) Binyao Jiang 2025-08-18 14:40:13 -07:00
• 98b44e9e56 [PD] Propagate internal server errors from aborted requests to clients instead of blindly returning 200's (#8936) datdo-msft 2025-08-18 14:23:46 -07:00
• 6805f6da40 upgrade xgrammar 0.1.23 and openai-harmony 0.0.4 (#9284) Swipe4057 2025-08-19 00:02:00 +03:00
• ca533580f2 [Docs] Correct and clarify notes in Engine docstring (#9313) 江家瑋 2025-08-19 04:24:19 +08:00
• 886454e8e7 [MISC] use dynamic choices for tool-call-parser argument (#9316) Keyang Ru 2025-08-18 13:02:10 -07:00
• 0cf3fbeb18 should return invalide request for empty prompt (#9315) gongwei-130 2025-08-18 11:44:11 -07:00
• 2256d62d36 Modelopt quant config adaptation (#8829) Zhiyu 2025-08-18 11:27:30 -07:00
• 6cdcbcc674 [fix] fix enable_pdl for blackwell (#9011) JieXin Liang 2025-08-19 01:16:08 +08:00
• c480a3f6ea Minor style fixes for sgl-kernel (#9289) Lianmin Zheng 2025-08-18 09:38:35 -07:00
• 6e316588f8 [router] add reasoning parser base structure (#9310) Simo Lin 2025-08-18 09:26:09 -07:00
• 24247b4168 [router] add tokenizer metrics (#9307) Simo Lin 2025-08-18 09:25:51 -07:00
• 4c0bb411e5 Further fix memory pool leak error (#9298) fzyzcjy 2025-08-18 15:58:06 +08:00
• 968e181826 Fix triton_fused_moe unit test and benchmark (#9276) Yuan Luo 2025-08-18 15:54:33 +08:00
• d08663eec1 [router] tokenizer factory, hf tokenizer, and stop sequence detector (#9293) Simo Lin 2025-08-17 22:38:38 -07:00
• 716e682721 [Fix] Add undefined update_tensor_inplace function (#6307) b8zhong 2025-08-17 23:11:00 -04:00
• 84b30d9e00 Set the default attention backend for GLM-4.5v to fa3 (#9245) zifeitong 2025-08-17 16:34:19 -07:00
• ff0cf51c8e [router] introducing tokenizer trait (#9287) Simo Lin 2025-08-17 16:30:01 -07:00
• a1c7f742f9 chore: bump sgl-kernel v0.3.6.post1 (#9286) Yineng Zhang 2025-08-17 16:26:17 -07:00
• ebbb75e917 [CPU] Fix TP padding issue on Phi-4 (#8289) blzheng 2025-08-18 07:25:26 +08:00
• b341b7dbce [router] introduce prefill response draining for http compliance (#9281) Simo Lin 2025-08-17 14:23:04 -07:00
• b498cd21d7 Tiny make fp4 moe method parameters more static (#8520) fzyzcjy 2025-08-18 04:26:02 +08:00
• 0fc54b971e [fix]: fix cutlass moe ut and and Opt H20 cutlass groupGemm performance (#9272) kousakawang 2025-08-18 04:09:49 +08:00
• b3c1f2e4f2 Fix memory pool leak error (#9271) fzyzcjy 2025-08-18 03:53:34 +08:00
• be1a3cd9b4 Fix swa eagle verify accuracy for Triton backend (#9279) Ke Bao 2025-08-18 03:52:02 +08:00
• 4b74c3fcca [chore] Clean up redundant lora_weight_names concept to simplify code (#9131) Lifu Huang 2025-08-17 12:36:58 -07:00
• ce3ca9b02f [router] add cargo clippy in CI and fix-up linting errors (#9242) Jeff Nettleton 2025-08-17 11:03:56 -07:00
• 4d98e48649 Revert "[Misc] feat: Deepgemm update for sgl-kernel (#8790)" to fix kernel CI (#9260) Liangsheng Yin 2025-08-17 22:59:50 +08:00
• 3d77a31885 from python.sglang.srt -> from sglang.srt (#9268) Netanel Haber 2025-08-17 12:45:45 +03:00
• 845d12a979 model: support nvidia/Llama-3_3-Nemotron-Super-49B-v1 (#9067) Netanel Haber 2025-08-17 11:48:15 +03:00
• e47800e176 Quick Fix GLM (#9264) Stefan He 2025-08-16 23:43:41 -07:00
• bb10e3a1c3 [router] fix pd prefill http request complinace issue (#9237) Simo Lin 2025-08-16 22:36:45 -07:00
• fda762a27d [Bugfix] Change vLLM install order & Add A2 support (#9232) Even Zhou 2025-08-17 13:36:14 +08:00
• 1df84ff414 ci: simplify multi-modality tests by using mixins (#9006) Mick 2025-08-17 13:25:02 +08:00
• 66d6be0874 Bug fix: use correct mm_items in embed_mm_inputs (#8893) Binyao Jiang 2025-08-16 19:55:56 -07:00
• 1c1f8a118e Combine fp4.py and mxfp4.py into one file and support dynamic mxfp4 quantization in mxfp4.py (#9049) kk 2025-08-17 10:01:54 +08:00
• 384f8ab5ce [PD] Support PD disaggregation with Prefill PP (#8846) Shangming Cai 2025-08-17 09:31:31 +08:00
• 6a9d6ca33c fix unexcepted answer in EAGLE mode (#9252) zyksir 2025-08-17 08:45:36 +08:00
• 94371dbbd6 [feature] Ascend NPU graph support (#8027) VDV1985 2025-08-17 03:25:17 +03:00
• 740f063035 Fix Custom All Reduce CI job. (#9258) Sai Enduri 2025-08-16 16:29:43 -07:00
• 81da16f6d3 [CI] add deepseek w4a8 test on h20 ci (#7758) Hank Han 2025-08-16 16:54:13 +08:00
• bc938ea13f Fix DP load for embedding (#9165) Brayden Zhong 2025-08-16 02:58:44 -04:00
• eff4eb3fdd Add fp4 quantize before all-gather for Flashinfer cutlass MoE DP (max throughput) (#7667) Trevor Morris 2025-08-15 22:08:11 -07:00
• 87dab54824 Revert "chore: bump sgl-kernel v0.3.6 (#9220)" (#9247) Yineng Zhang 2025-08-15 17:24:36 -07:00
• 5121af4627 Revert "chore(docker): update sgl_kernel version to 0.3.6 in Dockerfi… (#9246) Yineng Zhang 2025-08-15 17:19:38 -07:00
• 983aa4967b Fix nan value generated after custom all reduce (#8663) kk 2025-08-16 03:33:54 +08:00
• 9c3e95d98b [AMD] Expand test coverage for AMD CI and enable apply_token_bitmask_inplace_cuda in sgl-kernel (#8268) Hubert Lu 2025-08-15 12:32:51 -07:00
• e52c3866eb chore(docker): update sgl_kernel version to 0.3.6 in Dockerfile.gb200 (#9243) ishandhanani 2025-08-15 12:06:52 -07:00
• da53e13cbb [router] preserve original worker response header in router (#9236) Simo Lin 2025-08-15 11:01:47 -07:00
• d7e38b2f6d [router] clean up lint warnings with clippy execution (#9201) Jeff Nettleton 2025-08-15 11:01:21 -07:00
• 21b8846066 [router] allow more health check configuration (#9198) Simo Lin 2025-08-15 08:07:45 -07:00
• 0c8594e67d Optional extension for green context (#9231) Liangsheng Yin 2025-08-15 21:33:52 +08:00
• c186feed7f chore: bump sgl-kernel v0.3.6 (#9220) Yineng Zhang 2025-08-15 02:50:50 -07:00
• 84b006b278 Cleanup MoE Refactor (#9223) Cheng Wan 2025-08-15 02:28:33 -07:00
• 8ca07bd948 [CI] Fix sgl-router disaggregation test (#9222) Shangming Cai 2025-08-15 17:24:44 +08:00
• 4fc09e0df0 Fp4 MOE quant kernel optimization (#8777) jy-song-hub 2025-08-15 01:46:16 -07:00
• a3d99d6dcd [Misc] feat: Deepgemm update for sgl-kernel (#8790) PGFLMG 2025-08-15 16:05:27 +08:00
• 189af90896 [Eagle Warning fix] replace the deprecated 'and' with & (#9215) Xuchun Shang 2025-08-15 15:43:36 +08:00
• f8644a5632 Tiny update tmux history limit on dev container (#9218) fzyzcjy 2025-08-15 15:22:08 +08:00
• e3e75a786a Fix the deprecation warning for enable_flashinfer_mxfp4_moe (#9214) Cheng Wan 2025-08-14 23:59:35 -07:00
• d4db9b028b fix: the store_dtype typo for ascend mla (#9208) shilinlee 2025-08-15 14:58:42 +08:00
• f7dd651dbd feat(hicache-3fs): 3FS-SGLang Hierarchical Cache Deployment Guide​ (#9213) hzh0425 2025-08-15 14:54:31 +08:00
• 9d54c6e6dd feat: remove sm75 (#9207) Yineng Zhang 2025-08-14 22:27:14 -07:00
• 1f9d65f57d use fast math for per_token_group_quant_8bit. (#9177) strgrb 2025-08-15 13:19:56 +08:00
• 295895120d [6/N] MoE Refactor: Cleanup MoE-related configs (#8849) Cheng Wan 2025-08-14 21:14:53 -07:00
• 584e1ab2d0 fix: fix unsupported palette mode of images in bench_serving for mmmu (#9206) Mick 2025-08-15 09:44:46 +08:00
• 392de007cb Minor fix docker container DeepEP on multi platforms (#9205) fzyzcjy 2025-08-15 08:41:49 +08:00
• 004f7f1972 [typo fix] Fix a typo in communicator.py (#9183) Philo 2025-08-15 08:29:38 +08:00
• d2fbf2de0c feat: add fused moe config for Qwen3-235B-A22B-FP8 on B200 (#9204) zixuanzhang226 2025-08-14 17:21:30 -07:00
• fab0f6e77d chore: bump v0.5.0rc2 (#9203) Yineng Zhang 2025-08-14 16:11:16 -07:00
• 27985c27aa feat: update model config (#9202) Yineng Zhang 2025-08-14 15:15:27 -07:00
• ac474869d4 chore: upgrade transformers 4.55.2 (#9197) Yineng Zhang 2025-08-14 13:51:02 -07:00
• 0b1e04f083 [VLM] Improving multimodal tensor hash kernel (#9008) Adarsh Shirawalmath 2025-08-15 02:15:55 +05:30
• c1c7dc4534 feat: Add model version tracking with API endpoints and response metadata (#8795) Chengxing Xie 2025-08-15 03:13:46 +08:00
• 2cc9eeab01 [4/n]decouple quantization implementation from vLLM dependency (#9191) Hongbo Xu 2025-08-15 03:05:46 +08:00
• 63d82a776a refine mxfp4 shuffling log (#9194) Xiaoyu Zhang 2025-08-15 01:57:29 +08:00
• 53dcc750b6 [sgl-kernel] Support FlashInfer top_k_top_p_sampling_from_logits (#9060) Yuan Luo 2025-08-15 01:56:36 +08:00