Commit Graph

Select branches

Hide Pull Requests

cch/megamoe-rc-v0.1

Mono Color

• 6bc503af73 [Doc] Update support matrix for attn and hybrid attn (#11293) b8zhong 2025-10-14 22:43:11 -07:00
• b2c8566920 [BugFix][Qwen3-VL]: fix cu_seqlens in qwen3-vl (#11458) Zheng Wengang 2025-10-15 13:16:49 +08:00
• 32803fb279 Super tiny improve FA3 import error message (#11590) fzyzcjy 2025-10-15 13:06:31 +08:00
• 91fc5bb5a9 feat: add add_chunked_prefix_cache_attention_backend (#11636) Yineng Zhang 2025-10-14 21:48:13 -07:00
• 780fbf2f38 [Fix] Fix accuracy bug in CSGMV kernel caching key. (#11579) Lifu Huang 2025-10-14 20:25:56 -07:00
• 825432fce6 [1/N]Support DeepSeek-R1 w4a8 normal deepep (#8247) Jinwu 2025-10-15 11:10:53 +08:00
• a40229f6f8 [1/N] Introduce Mooncake Backend and Mooncake EP to Support Elastic EP (#10423) Xun Sun 2025-10-15 10:40:54 +08:00
• 74737b2863 [router] upgrade to 0.2.0 (#11642) Simo Lin 2025-10-14 22:10:30 -04:00
• 40e0082d8d [router] add worker self discovery for metadata (#11638) Simo Lin 2025-10-14 22:07:25 -04:00
• e9e120ac7a fix: upgrade transformers to 4.57.1 (#11628) Sahithi Chigurupati 2025-10-14 18:35:05 -07:00
• e0c2af2ac2 [router] update router doc to latest features (#11639) Simo Lin 2025-10-14 21:32:30 -04:00
• 1d7f783501 Refactor kv cache free (#11351) cctry 2025-10-14 17:45:19 -07:00
• 325951460f [router][grpc] add warm up to grpc server (#11627) Simo Lin 2025-10-14 19:11:16 -04:00
• 86373b9e48 fix: Update SGL_KERNEL_VERSION to 0.3.15 (#11633) Yineng Zhang 2025-10-14 14:45:28 -07:00
• d314bf6010 Update install.md (#11631) Lianmin Zheng 2025-10-14 14:34:46 -07:00
• e28c9e526f [Minor] Update xgrammar dependency (#11622) DarkSharpness 2025-10-15 04:46:50 +08:00
• b98cf39866 [Auto Sync] Update collector.py (20251014) (#11625) Lianmin Zheng 2025-10-14 13:34:33 -07:00
• 27d710457c [Auto Sync] Update scheduler.py, server_args.py (20251014) (#11623) Lianmin Zheng 2025-10-14 13:20:03 -07:00
• c224a4c6cc Fix log for chunked prefix cache (#11624) Baizhou Zhang 2025-10-14 11:49:33 -07:00
• 49345a68cf [router] update router readme to latest features (#11619) Simo Lin 2025-10-14 14:47:38 -04:00
• 94d26d850d use non_blocking h2d in ForwardBatch.prepare_mlp_sync_batch. (#11605) strgrb 2025-10-15 02:30:59 +08:00
• 9e8a15a74c [router] add chang and keyang to sgl router author (#11620) Simo Lin 2025-10-14 14:10:49 -04:00
• 3962e39d7c [router] cleanup app context and move to startup (#11617) Simo Lin 2025-10-14 13:19:28 -04:00
• eb8cac6fe2 [router] add py binding and readme for openai router and history backend (#11453) Keyang Ru 2025-10-14 09:42:34 -07:00
• 5ea96ac7cc Reduce one step decode for draft model. (#11561) Liangsheng Yin 2025-10-14 23:52:04 +08:00
• 56222658ec move eagle draft post process to cuda graph (#11434) yinghui 2025-10-14 16:50:53 +02:00
• dc965db0e0 make radix cache deterministic (#10721) Alex Chi Z 2025-10-14 15:01:52 +02:00
• 817e46f412 Refactor spec decoding metrics calculation into separate TokenizerManager utility function (#11586) Scott Lee 2025-10-14 05:45:49 -07:00
• 5a33c3aae7 Optimize Triton Draft Backend (#11556) Liangsheng Yin 2025-10-14 20:08:32 +08:00
• 9767a1e41b Update release-docker-dev.yml (#11603) sglang-bot 2025-10-14 03:06:48 -07:00
• 1d08653972 [AMD CI] Add image and weights caching. (#11593) Sai Enduri 2025-10-14 02:51:35 -07:00
• a04efc4933 [router] when given both local tokenizer and chat template, log all (#11601) Simo Lin 2025-10-14 05:22:58 -04:00
• 642fa966f2 [Docs] [Router]: Update sg-router doc on circuit breaker (#11449) Wenyi Xu 2025-10-14 17:18:14 +08:00
• da7fac1b75 [router] allow router launch server to use grpc mode (#11600) Simo Lin 2025-10-14 04:42:43 -04:00
• 28ad2297a0 [router] delete useless table content comment in spec (#11597) Simo Lin 2025-10-14 04:08:18 -04:00
• f7f9f8eceb Update news section in README.md (#11598) Lianmin Zheng 2025-10-14 00:49:39 -07:00
• 4b62af92ef [router] change worker api to async instead of sync (#11566) Simo Lin 2025-10-14 03:32:21 -04:00
• 0b9915c132 [router] update generate spec to align with sgl io struct (#11591) Simo Lin 2025-10-14 02:51:33 -04:00
• 27ef1459e6 [router][protocols] Add Axum validate extractor and use it for /v1/chat/completions endpoint (#11588) Chang Su 2025-10-13 22:51:15 -07:00
• e4358a4585 Add fused_moe_triton config: triton_3_4_0/E=256,N=256,device_name=NVIDIA_B200.json (#11587) Qiaolin Yu 2025-10-13 22:24:43 -07:00
• ba2ce28fe9 [Auto Sync] Update model_config.py (20251014) (#11580) Lianmin Zheng 2025-10-13 22:16:34 -07:00
• 98923880bc chore: bump sgl-kernel version to 0.3.16.post2 (#11583) sglang-bot 2025-10-13 20:52:38 -07:00
• f792e3c561 Revert "[NVIDIA] BUMP FA3 (#11444)" (#11582) Yineng Zhang 2025-10-13 20:51:45 -07:00
• 28f80b1244 Implement LRU eviction policy for LoRA adapters (#11041) Chenxi Li 2025-10-13 20:18:25 -07:00
• 88a6f9dab5 bench_serving support PD Disaggregation (#11542) Xiaoyu Zhang 2025-10-14 10:43:26 +08:00
• cb8ed2c09a Make DeepEP combine recv do not overlap (#11535) fzyzcjy 2025-10-14 09:40:42 +08:00
• 384733639a [DSv32] Use torch.compile for _get_logits_head_gate (#11565) Trevor Morris 2025-10-13 18:38:39 -07:00
• aaf7af1b17 [FEATURE] Add Profile Trace Merger for Distributed Traces (#11413) Neelabh Sinha 2025-10-13 18:20:17 -07:00
• 932e263725 Compilation Folder Reset (#11539) Yuwei An 2025-10-13 18:19:12 -07:00
• 43f80884c5 Fix accept rate in speculative decoding metrics (#11572) Qiaolin Yu 2025-10-13 16:35:50 -07:00
• 60b0503227 chore: bump sgl-kernel version to 0.3.16.post1 (#11573) sglang-bot 2025-10-13 16:26:18 -07:00
• dc48c4c0e3 [sgl-kernel][2/N]Support Expert Specialization Grouped GEMM (#11534) Qi Yuhang 2025-10-14 07:24:48 +08:00
• 6dc9ca8c85 [router] Add BRANCH_TYPE=local support to Dockerfile.router for local builds (#11571) Arthur Cheng 2025-10-13 16:10:51 -07:00
• 887c2b4575 [router][grpc] Add serve_grpc to launch_server and log id for HealthCheck (#11564) Chang Su 2025-10-13 16:07:19 -07:00
• 065ce81574 Tiny cleanup fp4 gemm calls (#11537) fzyzcjy 2025-10-14 05:48:22 +08:00
• 8e51049f56 [CI Monitor] Ci monitor only deal with main branch in default (#11538) Xiaoyu Zhang 2025-10-14 04:50:04 +08:00
• cb8f3d90d3 [NVIDIA] update pyproject.toml to support cu130 option (#11521) Johnny 2025-10-13 22:03:31 +02:00
• 4b694e7d5a [router][grpc] Add error handling to generate_tool_constraints (#11562) Chang Su 2025-10-13 12:26:09 -07:00
• 9f1f699a7a [CI] Add Basic Test for DeepSeek V3.2 (#11308) Baizhou Zhang 2025-10-13 11:41:02 -07:00
• c9cff2b984 Fix DeepSeek-v3.2 default config (ValueError: not enough values to unpack (expected 4, got 3)) (#11557) Trevor Morris 2025-10-13 11:27:40 -07:00
• b6fb5d7666 Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441) Scott Lee 2025-10-13 11:24:27 -07:00
• f4aa78801e [router] Add Rust CLI flags for queue size, timeout, and rate limit for token bucket rate limiter (#11483) Jonah Bernard 2025-10-13 14:08:48 -04:00
• 5e3f7e7fa9 Minor: improve sampler & remove unused fields from model_config.py (#11531) Lianmin Zheng 2025-10-13 11:04:44 -07:00
• 728af88781 [router] allow user to specify chat template path (#11549) Simo Lin 2025-10-13 13:47:57 -04:00
• 7b59b0b8b0 [router][grpc] Further delegate non-stream processing to processing.rs (#11553) Chang Su 2025-10-13 10:36:27 -07:00
• acc2327bbd Move deep gemm related arguments to sglang.srt.environ (#11547) Liangsheng Yin 2025-10-14 00:34:35 +08:00
• bfadb5ea5f Adjust overlap event loop (#11507) Liangsheng Yin 2025-10-14 00:33:19 +08:00
• 9cc1e065f1 [router][Fix] Include grpc reflection runtime dependency (#11419) ai-jz 2025-10-13 09:32:42 -07:00
• b8c430f1ce [NVIDIA] BUMP FA3 (#11444) Johnny 2025-10-13 18:30:57 +02:00
• f35f120d70 fix: fix video input for qwen3-vl (#11442) Mick 2025-10-14 00:30:43 +08:00
• 54a46a264d Remove tp_worker.worker (#11548) Liangsheng Yin 2025-10-13 22:38:48 +08:00
• 7c94eaeeb0 [router] allow tokenizer path to be dir (#11530) Simo Lin 2025-10-13 09:30:09 -04:00
• 13d596c93e [router][ci] Add Nightly Release Workflow for SGLang Router (#11527) Simo Lin 2025-10-13 09:28:55 -04:00
• c7867b6702 [Fix] Add per_channel_quant parameter to MoE config functions (#11201) Mohammad Miadh Angkad 2025-10-13 21:26:06 +08:00
• 516738b096 Depreate global_server_args_dict (#11528) Liangsheng Yin 2025-10-13 19:34:43 +08:00
• 0b6f535f66 [Reland] perf: optimize qwen-vl with symm mem allreduce (#11457) Yuan Luo 2025-10-13 17:51:25 +08:00
• c5fe3c0b75 Tiny fix test run estimated time (#11544) Shangming Cai 2025-10-13 17:23:13 +08:00
• 318424e2c8 [HICache]: Support 3FS-Store with page_first_direct layout (#11460) hzh0425 2025-10-13 15:47:22 +08:00
• 6806c4e63e [CI monitor] Improve CI analyzer: fix job failure tracking and add CUDA-focused filtering (#11505) Xiaoyu Zhang 2025-10-13 13:31:09 +08:00
• 0c0779d667 ci: improve nightly-ci (#11385) Mick 2025-10-13 12:19:34 +08:00
• a55cf5304a [Feature] Support mamba radix cache v0 (#11214) Yi Zhang 2025-10-13 11:57:15 +08:00
• 19ba16aa3d [Fix]: add missing device attribute to ChunkCache (#11493) Yuanhang Sun 2025-10-13 11:49:59 +08:00
• a2b3d9b90b Update DeepSeek-R1-FP4 default config on blackwell (#11512) Qiaolin Yu 2025-10-12 20:32:11 -07:00
• 9a30914e94 [sgl-kernel][1/N]Support Expert Specialization Grouped GEMM (#11432) Qi Yuhang 2025-10-13 11:19:21 +08:00
• 8e776c78a1 docs(router): add token-bucket rate limiting to the docs (#11485) Jonah Bernard 2025-10-12 23:03:27 -04:00
• 63e84352b7 [router] openai router: support grok model (#11511) Keyang Ru 2025-10-12 19:44:43 -07:00
• a20e7df8d0 Improve dp attention port assignment scheme (#5889) Yongtong Wu 2025-10-13 08:55:59 +08:00
• 1bdd010291 Revert "Deprecate global_server_args_dict" (#11520) Cheng Wan 2025-10-12 17:40:40 -07:00
• 6cd296940a [lint] Fix the lint issue (#11516) Cheng Wan 2025-10-12 16:22:46 -07:00
• 2ac46e94ef Sync changes on io_struct.py and deterministic ops (#11498) Lianmin Zheng 2025-10-12 16:03:10 -07:00
• 0aa65f94f1 [Fix] Improve longbench prompt and other logics (#11474) Binyao Jiang 2025-10-12 15:04:28 -07:00
• 0ecb42613d fix: revert temporarily remove b200 tests (#11515) Yineng Zhang 2025-10-12 15:02:37 -07:00
• 05f015f65f chore: remove flashinfer cleanup cache (#11514) Yineng Zhang 2025-10-12 14:56:33 -07:00
• 1083e7e3df Deprecate global_server_args_dict (#11331) Liangsheng Yin 2025-10-13 01:20:47 +08:00
• 2157d12ae8 [CI] fix lint (#11509) Liangsheng Yin 2025-10-13 01:07:21 +08:00
• 9f2b457cbe doc: add doc for adding new models into nightly-ci (#11443) Mick 2025-10-12 23:35:10 +08:00
• f5b34a510c Bugfix: Fix Type consistency for KV indices in SWARadixCache (#11452) hzh0425 2025-10-12 23:19:44 +08:00
• 5a6ec8f999 Fix unit tests (#11503) Lianmin Zheng 2025-10-12 07:45:57 -07:00
• 6a653bb11b temporarily remove b200 tests (#11502) Lianmin Zheng 2025-10-12 06:48:49 -07:00
• 548a57b1f3 Fix port conflicts in CI (#11497) Lianmin Zheng 2025-10-12 06:46:36 -07:00