Commit Graph

Select branches

Hide Pull Requests

cch/megamoe-rc-v0.1

Mono Color

• 88e73ed048 Temporarily remove b200 tests (#11501) Lianmin Zheng 2025-10-12 06:41:37 -07:00
• 4b15fa00f0 move fla env check position (#11500) Yi Zhang 2025-10-12 21:40:45 +08:00
• f49419061d Move args from global_config to environ (#11332) Liangsheng Yin 2025-10-12 21:29:31 +08:00
• 01e59e8247 Fix CI break by express-laned PRs. (#11499) Liangsheng Yin 2025-10-12 21:06:06 +08:00
• 99a0704a36 bailingMoE: Fix Key error of deepep_mode (#11465) Mike Qiu 2025-10-12 20:42:59 +08:00
• ec1cd90ac9 Fix the GPT function calling regex to allow dash in the name (#10577) Antoine Roux 2025-10-12 14:34:58 +02:00
• 1103dc6204 [chore][2/N] Avoid using default mutable parameters (#11479) Kai-Hsun Chen 2025-10-12 05:34:04 -07:00
• a220536f40 [ perf ] Replace json-> orjson in hot path (#11221) Vincent Zhong 2025-10-12 08:30:58 -04:00
• 7b064f04f8 [bugfix]: use correct causality condition for flashattention, flashinfer, and triton backends (#10172) Mahmoud Ashraf 2025-10-12 15:28:16 +03:00
• 43190becfa [chore][1/N] Avoid using default mutable parameters (#11478) Kai-Hsun Chen 2025-10-12 05:26:39 -07:00
• be740acdb0 [smol] [perf] Qwen3-VL in place op. (#11481) Vincent Zhong 2025-10-12 08:25:30 -04:00
• 2db2cddd12 chore: bump sgl-kernel version to 0.3.16 (#11476) sglang-bot 2025-10-11 22:04:49 -07:00
• 9b5efe3464 [Router]: Small Typo in a comment within tree.rs (#11489) Wenyi Xu 2025-10-12 12:59:48 +08:00
• 4ac8e09df0 Piecewise CUDA Graph Support & Torch Compile Backend (#10062) Yuwei An 2025-10-11 20:55:57 -07:00
• 20a6c0a63d Beta spec-overlap for EAGLE (#11398) Liangsheng Yin 2025-10-12 11:02:22 +08:00
• 47c606d3dc [Feature] support regex strings as a stopping condition (#10635) Glen Liu 2025-10-11 22:53:15 -04:00
• 9fcf73069f [CI] Add nightly builds to dockerhub (#9804) Sahithi Chigurupati 2025-10-11 18:27:46 -07:00
• 0a304870e8 fix Xeon CI (#11454) Zaili Wang 2025-10-12 05:08:28 +08:00
• 8fdcd98efe [7/n] decouple quantization impl from vllm dependency - gguf kernel (#11019) PGFLMG 2025-10-12 05:04:57 +08:00
• b5dcfd4154 Add option to disable any_whitespace for xgrammar and llguidance backends. (#8919) Lorenzo Lu 2025-10-11 16:24:58 +02:00
• 5061b8fd3e fix stop when stream (#11462) ybyang 2025-10-11 22:06:31 +08:00
• c8452551ce [Fix] Fix split prefill with fa3. (#11428) ykcombat 2025-10-11 22:03:28 +08:00
• bf3e7149be Fix enable_v2 in int8 quant (#11470) fzyzcjy 2025-10-11 21:56:30 +08:00
• f5754d1256 [Documentation][Configuration] Server args and documentation of PD-Multiplexing. (#11427) ykcombat 2025-10-11 21:36:07 +08:00
• 739daa63e4 Adjust logits metada init for target verify (#11467) Liangsheng Yin 2025-10-11 21:17:04 +08:00
• d957177a22 Super tiny delete unused openai router in sgl-router (#11448) fzyzcjy 2025-10-11 15:59:30 +08:00
• 21337b22b9 Reland [1/2] Optimizations and refactors about quant kernel (#10312) fzyzcjy 2025-10-11 15:59:03 +08:00
• 129d299278 Enable native ModelOpt quantization support (2/3) (#9991) Zhiyu 2025-10-11 00:48:14 -07:00
• 8b85926a6e Remove tilelang dependency in Dockerfile (#11455) Baizhou Zhang 2025-10-10 23:17:53 -07:00
• 451d15c44b [DPSKv3.2] Rewrite nsa tilelang act_quant kernel to triton (#11450) Binyao Jiang 2025-10-10 23:13:46 -07:00
• c80a96dae9 [BugFix] test_mla_fp8.py fails on Cublas 12.9 (#11360) Liu-congo 2025-10-11 12:14:24 +08:00
• eae9a9fb9d Fix batch invariant ops (#11368) Stefan He 2025-10-10 20:49:08 -07:00
• 2674c1d280 fix: Change dsv32 hack temporary path to use system temp directory (#11445) wxsm 2025-10-11 10:59:41 +08:00
• 61055cb309 Reorder PD disagg CI tests (#11438) Lianmin Zheng 2025-10-10 17:56:49 -07:00
• 92777135a0 [router][grpc] Consolidate parser checks for chat completions (#11439) Chang Su 2025-10-10 17:44:29 -07:00
• c495833186 [router] leverage RAII to actively cancel request during client disconnect (#11399) Simo Lin 2025-10-10 20:43:38 -04:00
• 2eeb27515a [router] disable rate limiter by default (#11435) Simo Lin 2025-10-10 20:43:07 -04:00
• b36afed4a7 Separate allocation logic from scheduler (#11313) cctry 2025-10-10 17:38:54 -07:00
• 9aa4502d11 feat(mooncake): support GB suffix for global_segment_size (#10745) JinYan Su 2025-10-11 08:38:25 +08:00
• a0835c3a62 [router] Fix ci nvcc not found error (#11411) Keyang Ru 2025-10-10 15:43:16 -07:00
• 55b14656e6 Revert "Add metrics for speculative decoding (acceptance rate, average acceptance length)" (#11433) Scott Lee 2025-10-10 12:54:57 -07:00
• b4408e6098 Revert "fix: fix video input for qwen3-vl" (#11437) Lianmin Zheng 2025-10-10 12:44:40 -07:00
• 52fcbbb8bd Revert "perf: optimize qwen-vl with symm mem allreduce" (#11436) Cheng Wan 2025-10-10 12:30:05 -07:00
• af96ca1136 [CI] Merge build-dev into workflow matrix (#11345) Sahithi Chigurupati 2025-10-10 11:13:42 -07:00
• 9082a7d323 [HiCache] feat: add multi tenant with prefix tag (#9256) Teng Ma 2025-10-11 00:23:28 +08:00
• 3b9d97f335 perf: optimize qwen-vl with symm mem allreduce (#11381) Yuan Luo 2025-10-10 22:24:45 +08:00
• a1a20b4c7c fix: fix video input for qwen3-vl (#11361) Mick 2025-10-10 19:35:35 +08:00
• 4299aebdbb chore: update pyproject (#11420) Yineng Zhang 2025-10-10 00:56:30 -07:00
• 0babd48736 Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11144) Scott Lee 2025-10-10 00:46:44 -07:00
• f19613e6c3 Dedicated toml files for CPU/XPU (#10734) Zaili Wang 2025-10-10 15:44:55 +08:00
• 8df4945559 fix file and object naming scheme in HiCacheNixl to avoid data corruption (#10969) ziruiliu 2025-10-10 15:23:10 +08:00
• ee3bd8a1c8 feat(hicache): Support passing prefix keys for l3 store. (#9045) hzh0425 2025-10-10 15:22:05 +08:00
• d8467db727 fix: reinstall torch in deps install (#11414) Yineng Zhang 2025-10-09 22:58:18 -07:00
• b5044fbf12 Replace pad with cat for better performance (#11388) Yuan Luo 2025-10-10 12:03:17 +08:00
• 70fbb3adf6 [CI] Refactor PD disaggregation test suite (#11363) Shangming Cai 2025-10-10 09:50:39 +08:00
• 9a7e7a6576 [Bug Fix] prevent lora adapter from being loaded into LoRAManager if it is already loaded (#11365) Glen Liu 2025-10-09 21:43:03 -04:00
• 0fe87213bb fix: fix gpu-proc affinity set incorrectly when pp_size > 1 (#11389) Yingchun Lai 2025-10-10 09:40:05 +08:00
• 1f106ee365 [grammar] Avoid server crash when grammar backend is None (#11401) Xinyuan Tong 2025-10-09 18:38:10 -07:00
• 9b8ebb2798 move more files under srt/utils (#11285) Lianmin Zheng 2025-10-09 16:46:15 -07:00
• 758b887ad1 chore: bump SGLang version to 0.5.3.post1 (#11324) sglang-bot 2025-10-09 15:19:59 -07:00
• eb7d9261c0 [router] conversation item API: create, retrieve and delete (#11369) Keyang Ru 2025-10-09 14:43:16 -07:00
• 44cb060785 chore: upgrade flashinfer 0.4.0 (#11364) Yineng Zhang 2025-10-09 14:17:54 -07:00
• 88bb627d0d [router] change grpc client from mutable to clone (#11394) Simo Lin 2025-10-09 14:00:24 -04:00
• b520958ec8 [router][grpc] Replace fake health check with correct ones (#11387) Chang Su 2025-10-09 09:13:57 -07:00
• fa7e2c3049 fix bench_serving mishandling of internal states (#11376) shaharmor98 2025-10-09 14:24:50 +03:00
• 8f2cd177af add code pp support for nixl (#11375) shaharmor98 2025-10-09 14:24:32 +03:00
• ab926dd697 [router][grpc] Fix streaming bugs: empty tool names, state pollution, and panics (#11373) Chang Su 2025-10-09 03:53:23 -07:00
• a4b424c632 [DeepSeek-V3.2] Include indexer kv cache when estimating kv cache size (#11309) Trevor Morris 2025-10-08 23:59:46 -07:00
• a0557642ea [router][lint] Add unused_qualifications to cargo lint warnings (#11366) Chang Su 2025-10-08 22:17:11 -07:00
• 84768d1017 [router] Refactor OpenAI router: split monolithic file and move location (#11359) Keyang Ru 2025-10-08 21:46:39 -07:00
• 368fd20622 [router][grpc] disable health check generation and increase timeout (#11353) Simo Lin 2025-10-08 22:23:08 -04:00
• 53bd00d975 [Generative Score API] Multi-Item scoring with custom attention mask. (#10979) Sundara Raman Ramachandran 2025-10-08 18:47:32 -07:00
• e22b13c569 [Auto Sync] Update scheduler.py (20251009) (#11350) Yineng Zhang 2025-10-08 17:39:04 -07:00
• a3c2ea4451 fix: fix revision for sgl-flash-attn in sgl-kernel (#11327) Mick 2025-10-09 06:50:44 +08:00
• fccac7d126 [router][grpc] Add dependencies in Cargo.toml to support chat template rendering (#11342) Chang Su 2025-10-08 15:38:37 -07:00
• 7ac6b900f4 [router] Support history management using conversation (#11339) Keyang Ru 2025-10-08 15:24:02 -07:00
• a1080b72a0 [router] Fix all unused_qualifications (#11341) Chang Su 2025-10-08 13:55:27 -07:00
• a65ca73911 [router][grpc] Cleanup debug logs in grpc_server and grpc_router (#11340) Chang Su 2025-10-08 13:26:19 -07:00
• 677aa0e25f [router] improve reasoning parser lock and reduce req cloning (#11336) Simo Lin 2025-10-08 14:18:15 -04:00
• 01c9ee1ab4 [router] refactor generate to use new pipeline arch (#11323) Simo Lin 2025-10-08 12:38:50 -04:00
• d6837aea4d model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909) Netanel Haber 2025-10-08 19:37:38 +03:00
• c882b5ae75 [CI] improve disaggregation CI. (#11264) Liangsheng Yin 2025-10-08 21:40:56 +08:00
• e3bb7f5ae6 benchmark: enhance configurable multimodal benchmarking in bench_serving (#9812) Kevin Xiang Li 2025-10-08 01:31:36 -07:00
• 92473e2e34 Support LoRA in bench_serving oai interface (#11318) Lifu Huang 2025-10-08 01:28:58 -07:00
• 6c0bb32711 fix(decode): adjust ServerArgs import to explicit module path (#11007) JinYan Su 2025-10-08 16:27:50 +08:00
• 0a7c4bded7 [Doc] Update mooncake nvlink transport doc for PD disaggregation (#11321) Shangming Cai 2025-10-08 15:59:29 +08:00
• edefab0c64 [2/2] Support MHA prefill with FlashAttention 4. (#10937) Lifu Huang 2025-10-08 00:54:20 -07:00
• 97cd38e58d Skip weight loading in deepgemm compilation (#11312) Cheng Wan 2025-10-07 21:52:46 -07:00
• 3c06b673af [8/N] MoE Refactor: deprecate EPMoE (#11211) Cheng Wan 2025-10-07 21:51:41 -07:00
• 7c3f07dbcb [Feature] Add /tokenize and /detokenize OpenAI compatible endpoints (#9545) Adarsh Shirawalmath 2025-10-08 10:08:48 +05:30
• edd86b8853 [router][grpc] Refactor chat handler in grpc/ to use centralized orchestrator (#11314) Chang Su 2025-10-07 20:50:20 -07:00
• 4b4dc132fa Rename ngram_utils -> ngram_info (#11316) Liangsheng Yin 2025-10-08 11:49:46 +08:00
• 5a9170d993 Optimize copy_kv_cache for spec decoding (#11126) YAMY 2025-10-08 02:43:30 +00:00
• c4d77774e1 update sampling_params documentation with defaults (#11315) Xinyuan Tong 2025-10-07 18:36:26 -07:00
• 832c84fba9 [Chore] Update xgrammar 0.1.24 -> 0.1.25 (#10710) DarkSharpness 2025-10-08 09:22:28 +08:00
• 64d1505c0a ci: unify the model launch method of nightly ci (#11230) Mick 2025-10-08 09:13:14 +08:00
• f3764c26a3 Clean match_prefix and prepare_for_extend for mem cache V2 (#11200) cctry 2025-10-07 17:54:18 -07:00
• 7ba3de0e92 [oai serving chat] Add argument --sampling-defaults and fix ChatCompletionRequest defaults (#11304) Chang Su 2025-10-07 17:36:05 -07:00
• fde9b96392 [router] cleanup worker health check to return early (#11310) Simo Lin 2025-10-07 19:53:10 -04:00
• f094e0a490 [router][grpc] Fix request_id extraction when n > 1 (#11311) Chang Su 2025-10-07 16:27:56 -07:00