chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity

Commit Graph

  • 1aa56cca37 [AMD] Add wheel support for sglang (#16782) YC Tseng 2026-03-10 08:42:41 +03:00
  • 5a11ae19c1 [CI] fix: notebook ci often OOM (#20199) shuwenn 2026-03-10 13:32:41 +08:00
  • 591e61245a [Doc] Add smal table for GEMM backends (#20213) Brayden Zhong 2026-03-10 01:19:57 -04:00
  • 208f1428e9 [Scheduler] Decouple maybe_send_health_check_signal from process_batch_result (#20227) Liangsheng Yin 2026-03-09 21:18:56 -07:00
  • 2e7682414b [AMD] Fix Aiter Prebuild When Releasing ROCm720 Image (#20195) Bingxu Chen 2026-03-10 12:02:38 +08:00
  • 08d37f6955 [diffusion] fix: add VAE tiling/slicing argument handling for diffusers backend (#17825) sfiisf 2026-03-10 11:38:20 +08:00
  • a6ae89fe3c Revert "chore: bump sgl-kernel version to 0.3.21.post1" (#20229) Baizhou Zhang 2026-03-09 20:32:19 -07:00
  • ea6ac1d545 Add CODEOWNERS for mooncake transfer engine (#20226) Shangming Cai 2026-03-10 11:22:06 +08:00
  • 0a43229be1 Fix mooncake store write/read bandwidth logs (#18294) huangtingwei 2026-03-10 10:54:37 +08:00
  • 9610944ae6 [Feature] Add SANA diffusion model (#19234) Mook 2026-03-09 19:09:21 -07:00
  • 254d3cee0b [HiCache] Supports Indexer layout for NSATokenToKVPoolHost (#19912) huangtingwei 2026-03-10 09:24:06 +08:00
  • 0fd9a57d80 [Doc] Verify and Modify some attention backend specs (#20210) YEJIN KIM 2026-03-10 08:05:52 +09:00
  • ca997b7ba9 Add min_p and chat-template kwargs support to run_eval (#19571) Mohammad Miadh Angkad 2026-03-10 05:53:09 +08:00
  • be63f982b7 [V32/GLM5] Control the threshold of applying dense attention with an environ (#20062) Baizhou Zhang 2026-03-09 14:36:10 -07:00
  • d39ed074cf fix: default FP4 GEMM backend to flashinfer_cudnn on SM120 (Blackwell) (#20047) Martin Vit 2026-03-09 22:13:08 +01:00
  • 61d530e8ac [CI] Fix lint (#20209) Baizhou Zhang 2026-03-09 14:09:59 -07:00
  • 3e8abc71ca [Disagg] Skip health check enqueue when PD disagg queues have backlog (#20191) ybyang 2026-03-10 03:58:10 +08:00
  • f0153ad225 [AMD][Feature] support fp4 dispatch and fp8 combine in moriep (#19757) AMD-yanfeiwang 2026-03-10 03:52:05 +08:00
  • ffb4b6f4c1 [Core] Replace server_args mutation hack with explicit MemoryPoolConfig for draft worker init (#20183) Liangsheng Yin 2026-03-09 11:45:54 -07:00
  • ecca8c553d [diffusion] fix: fix diffusers backend issues in diffusion ci gt workflow (#20173) Yuhao Yang 2026-03-10 00:51:48 +08:00
  • f947bcbd89 Move stop words to args in send one (#20193) Ke Bao 2026-03-09 23:05:47 +08:00
  • 2e444bdced Move stop words to args in send one (#20193) Ke Bao 2026-03-09 23:05:32 +08:00
  • eb4ba1bde2 Feature/support longcat flash lite (#17838) sjqgogogogo 2026-03-09 23:00:11 +08:00
  • 11b76d24dc [NPU] [DLLM]DLLM LLaDA2.x graph mode support with NPU speedup modifications (#18485) wenxuewuhd 2026-03-09 22:41:05 +08:00
  • d116a8cd94 [Bugfix] Fix load_audio: mono before resample + use torchaudio (#20054) Xinyuan Tong 2026-03-09 11:24:20 +00:00
  • 4a757990a1 [VLM] Replace decord with torchcodec for video decoding (#20055) Xinyuan Tong 2026-03-09 11:23:49 +00:00
  • 2d6eb7dff0 [AMD] Add lmsysorg/sglang-daily as A New AMD Daily Image Release Location (#20156) Bingxu Chen 2026-03-09 16:30:08 +08:00
  • b719219de9 [ROCm] Use unreg path for aiter custom all-reduce during CUDA graph capture (#20155) Yuzhen Zhou 2026-03-09 01:09:04 -07:00
  • cabe171b6c Fix qwen3.5 mtp eplb related issues (#19767) luoyuyan 2026-03-09 16:05:32 +08:00
  • c76251f70c Return intermediate Mamba states (#19716) roikoren755 2026-03-09 10:04:36 +02:00
  • 484f53c40e [Minor] Add CODEOWNERS for attention/vision.py (#20166) sglang-bot 2026-03-09 00:27:34 -07:00
  • 96724f490c Add auto bind numa node (#15678) Mike Qiu 2026-03-09 14:46:09 +08:00
  • 2ef00383ab [Core] Refactor init_memory_pool into composable resolution helpers (#20142) Liangsheng Yin 2026-03-08 21:46:27 -07:00
  • c6184b7dc0 Fix EPD OOM by offloading precomputed_embeddings during chunked prefill (#16503) siyu 2026-03-09 11:10:40 +08:00
  • 1cb86f5171 [diffusion] CI: fix CI script path and missing server arg in perf baseline generator (#20138) Yuhao Yang 2026-03-09 10:35:21 +08:00
  • fc543df289 [NPU] qwen3_vl encoder support graph cen121212 2026-03-09 10:13:35 +08:00
  • 8c5ca37aef Batch copy_ with torch._foreach_copy_ (#18558) Kaixi 2026-03-09 03:09:02 +01:00
  • 57f28fda90 [diffusion] chore: add diffusion new model skill (#19605) Yuhao Yang 2026-03-09 09:45:23 +08:00
  • 3f3eb206fa feat(grpc): add SubscribeKvEvents RPC for KV cache event streaming (#20112) Simo Lin 2026-03-08 16:00:29 -07:00
  • 7105bf3782 [Bug] Fix missing TTFT histogram for single-batch requests (#20122) Liangsheng Yin 2026-03-08 15:18:51 -07:00
  • 7662b8b919 [diffusion] feat: implement upscaling (#19723) Junhao Liu 2026-03-08 11:06:40 -07:00
  • b77dd41db0 [diffusion] fix: fix temporary resolution workaround (#20046) xingsy97 2026-03-09 02:05:35 +08:00
  • 0ac6c63ae4 [SpecV2-Mamba]: Refactor additional_ratio calculation when init mamba pool (#19660) hzh0425 2026-03-09 00:39:26 +08:00
  • 07359efce9 Fix missing clone in hicache (#20130) Ke Bao 2026-03-08 23:21:18 +08:00
  • 051427c0a3 [diffusion] benchmark: add SLO metric forinbench_serving (#18907) Junhao Liu 2026-03-08 07:35:57 -07:00
  • cc73355a1f [Feature] Add SLRU eviction policy & fix RadixCache hit_count bug (#18843) liubiyongge 2026-03-08 21:30:55 +08:00
  • 2c183350be [diffusion] fix: fix wrong dit config for qwen-image-edit-plus-2511 (#20123) Mick 2026-03-08 20:08:36 +08:00
  • 1eed219f47 add mixed chunk unit test and make small refactors (#18776) Glen Liu 2026-03-08 07:56:09 -04:00
  • ab9de886c5 [diffusion] reduce LayerwiseOffloadManager reserved GPU memory (#20042) Ratish P 2026-03-08 16:56:17 +05:30
  • 29f3a5396e [Minor] Add SessionSlot.is_holding_kv property for readability (#20120) Liangsheng Yin 2026-03-08 03:25:13 -07:00
  • 0f0c8b2f18 chore: bump sgl-kernel version to 0.3.21.post1 (#20087) sglang-bot 2026-03-08 03:03:58 -07:00
  • 36b557d2c9 Fix streaming session with paged KV cache (SWA/MLA) (#20070) Liangsheng Yin 2026-03-08 03:00:32 -07:00
  • 230fb55899 [Performance] Decode Offload improves the long texts performance 100% through dynamic block offload. (#17216) yuyu5333 2026-03-08 17:16:53 +08:00
  • 97a2a9be0f [VLM] Replace conv3d proj with linear for GLM4V (#20033) Yuan Luo 2026-03-08 14:50:47 +08:00
  • 7fb282a96f [diffusion] fix: fix bug of copy_if (#20094) Fan Lin 2026-03-08 14:27:58 +08:00
  • 7f9f85d4c8 [diffusion] feat: make QwenImageLayered resolution configurable (#20044) xingsy97 2026-03-08 14:26:05 +08:00
  • a73369c39f [diffusion] chore: ensure CFG Zero Star numerical stability for Helios model (#20091) Lancer 2026-03-08 14:25:14 +08:00
  • 72f6dfcc31 fix: add ModelScope cache lookup and speculative path support (#20098) shuwenn 2026-03-08 14:23:16 +08:00
  • d02c515ee8 Decouple scheduler log printing from metrics collection (#20107) Liangsheng Yin 2026-03-07 22:09:10 -08:00
  • 69ec15ad74 [CI] Re-enable streaming session tests with correctness and stress coverage (#20084) Liangsheng Yin 2026-03-07 18:18:11 -08:00
  • d28f35240a [V32/GLM5] Change default setting of V32 nvfp4 on TP4 (#20086) Baizhou Zhang 2026-03-07 15:13:25 -08:00
  • 0f62da6953 [CI] Show test partition assignments after checkout (#20085) Alison Shao 2026-03-07 13:50:49 -08:00
  • 7bd3dd9270 fix: image URL in notebook to use raw.githubusercontent.com (#20100) shuwenn 2026-03-08 05:28:20 +08:00
  • 45bd30e29d [NPU] make torch_native lora backend a little bit faster (#17228) VDV1985 2026-03-07 20:14:46 +03:00
  • 5867c3fa80 Support HiCache for MambaRadixCache (#19663) Ke Bao 2026-03-08 00:36:25 +08:00
  • 17721b00fd [AMD] Fix Tensor Memory Aliasing (#19928) Bingxu Chen 2026-03-08 00:06:10 +08:00
  • 7da590d4d0 [Qwen3.5] Support Qwen3.5 Pipeline Parallelism (#19670) Yuan Luo 2026-03-07 23:34:08 +08:00
  • 13bdc7bf4a [Feature][NPU]: add runtime support for AutoRound quantized models (#16699) YeChang Guo 2026-03-07 23:03:55 +08:00
  • fd79cd8d9c [Skills] Refine jit_kernel and sgl-kernel skills (#20095) Xiaoyu Zhang 2026-03-07 22:54:01 +08:00
  • 5297b02c88 [Diffusion] [NPU] Wan2.2-T2V-A14B-Diffusers modelslim quantization support (#17996) Артем Савкин 2026-03-07 17:26:44 +03:00
  • f8d4eb7022 [Docs] Add docstrings to JIT kernel include headers (#19770) xingsy97 2026-03-07 20:48:00 +08:00
  • ef6540b439 [diffusion]: add width/height passthrough for OpenAI image API (#19970) Ratish P 2026-03-07 18:13:46 +05:30
  • 19c51fe2fa fix(rope): restore K writeback in fused rope + kv store kernel (#19636) David Wang 2026-03-07 07:41:35 -05:00
  • f016738f4c fix syntax error: "&&" unexpected (#20093) kk 2026-03-07 18:06:21 +08:00
  • bd108a5971 Add workaround for aiter triton gemm config issue (#20090) kk 2026-03-07 17:21:31 +08:00
  • 1aa6ab41de [Nightly] Replace MiniMax-M2 with MiniMax-M2.5 (#20083) Alison Shao 2026-03-07 01:15:34 -08:00
  • 43d6a32045 [sgl-kernel] rebase FlashMLA 0217 (#18902) Fan Yin 2026-03-07 16:30:52 +08:00
  • c267bdb805 [AMD] Fix AMD CI - stage-b-small-1-gpu-amd (partition 7) (#20028) YC Tseng 2026-03-07 10:49:14 +03:00
  • 011806c419 [Nightly] Add Kimi K2.5 nightly test (base + Eagle3 MTP), replace Kimi K2 (#19802) Alison Shao 2026-03-06 23:44:04 -08:00
  • f8bbf56de7 Refactor NemotronHConfig to canonical layers_block_type and add MTP block-type support (#19950) danielafrimi 2026-03-07 09:22:03 +02:00
  • b91fb8393e [diffusion] fix: fix multi-prompt generation and support multiple prompts in cli (#19960) Lancer 2026-03-07 13:01:59 +08:00
  • 31e93e4486 [diffusion] fix: fix TeaCache silently fails with --enable-teacache (#19964) Eitan Turok 2026-03-07 07:00:11 +02:00
  • c584158135 [CI] Temporarily disable flaky test_priority_metrics on CUDA (#20075) Alison Shao 2026-03-06 20:34:45 -08:00
  • 925185f9ec Fix flashinfer backend with pcg (#20061) Qiaolin Yu 2026-03-06 20:01:43 -08:00
  • 8a411a9a2a [Tracing] Remove the deprecated tracing code from mini_lb (#19409) Feng Su 2026-03-07 11:19:23 +08:00
  • f88acf8780 [JIT Kernel] Reland NVFP4 kernels to JIT (#20012) Mohammad Miadh Angkad 2026-03-07 10:31:08 +08:00
  • 6ffc74efd7 [Metrics] Add overlap bubble timing, full KV usage gauge, and prefill cuda graph tracking (#19982) Yilong Zhao 2026-03-06 17:41:27 -08:00
  • 50bbdcf8e9 Relax flaky test thresholds for MLA DeepSeek V3 and AutoRound (#20068) Alison Shao 2026-03-06 17:26:28 -08:00
  • a0d085c16d Adding correct path for module not found error while collecting test (#19778) shubham singhal 2026-03-07 05:56:16 +05:30
  • e818f8219a Fix none-comparison (E711) warnings (#19745) R0CKSTAR 2026-03-07 08:15:21 +08:00
  • 0c4f98ed4e [diffusion] hardware: add set_musa_arch on MUSA (misc, 15/N) (#19381) R0CKSTAR 2026-03-07 08:14:41 +08:00
  • 069d4c577b Fix Kimi K2.5 PP layer range exposure for PD disaggregation (#19959) MARATRIX 2026-03-07 08:14:02 +08:00
  • ddcecdea49 [Core] Unify max_num_reqs dp_size division for pool sizing (#20063) Liangsheng Yin 2026-03-06 16:12:59 -08:00
  • 7a12255b6e fix: set first_token_time before computing decode_throughput for single-batch completions (#19984) Kangyan-Zhou 2026-03-06 16:11:41 -08:00
  • 5c8e28698c Add cleanup for _ATTN_TP in parallel_state.py (#19978) Aurick Qiao 2026-03-06 15:43:31 -08:00
  • 61de303f0a Fix fallback to default tactic (flashinfer autotuner) with trtllm_fp4_block_scale_moe (#19189) Shu Wang 2026-03-06 17:15:04 -06:00
  • e89069ee64 Fallback to torch.cuda.mem_get_info() when nvidia-smi is unavailable (#18957) Kangyan-Zhou 2026-03-06 15:00:08 -08:00
  • 604db4471d [Core] Clarify memory variable naming in model runner (#20060) Liangsheng Yin 2026-03-06 14:00:46 -08:00
  • ac453b253f Add Qwen3.5-397B-A17B nightly test (8-GPU) (#19906) Alison Shao 2026-03-06 13:49:28 -08:00
  • 7a6cf0e9ba [Core] Extract _calculate_mamba_ratio and _init_pools from init_memory_pool (#20058) Liangsheng Yin 2026-03-06 13:37:22 -08:00