chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Commit Graph

  • 54fdb357d3 [CI][NPU] Fix git report dubious ownership (#21162) Even Zhou 2026-03-23 14:36:35 +08:00
  • bc4aaab6a1 [Spec][Ngram] 2/N: Rename branch length to max trie depth (#21181) kpham-sgl 2026-03-22 23:35:25 -07:00
  • d6b12c401c Revert "[bugfix] Fix PPMissingLayer AttributeError when Using PP" (#21189) Cheng Wan 2026-03-22 23:28:36 -07:00
  • 13f4f010d8 HiSparse for Sparse Attention (#20343) Zhiqiang Xie 2026-03-22 23:09:31 -07:00
  • 44db0c59cf [CI] Fix cutlass import error: restore nvidia-cutlass-dsl force-reinstall (#21182) Alison Shao 2026-03-22 22:41:01 -07:00
  • 7050011dee Enable JIT clamp_position and resolve_future_token_ids on ROCm (#21116) Lianmin Zheng 2026-03-22 22:33:54 -07:00
  • 32a85ef128 [diffusion] CI: auto-skip diffusion tests when required pipeline class is missing from diffusers (#21139) Yuhao Yang 2026-03-23 12:15:21 +08:00
  • a094eb9c21 Temporarily disable flaky qwen3 cp test in CI (#21178) Shangming Cai 2026-03-23 12:13:52 +08:00
  • d8a5b1dbaf [Bugfix] Work around FlashInfer unified transport issue on GB (#20039) Mohammad Miadh Angkad 2026-03-23 12:10:25 +08:00
  • a94d67d44b [SKILL] fix(bench): Support model-specific DenoisingStage variants in… (#21137) Xiaoyu Zhang 2026-03-23 12:08:00 +08:00
  • 2b47bd3a34 [Bug Fix] Fix non-streaming request abort failure when --enable-metrics is enabled (#20625) fanghao 2026-03-23 10:58:49 +08:00
  • 889e8489e9 [diffusion] model: support FireRed-Image-Edit (#20862) yuumn 2026-03-23 10:27:07 +08:00
  • 999bad5aba Fix VRAM leak in overlap scheduling with structured output (#20640) (#20697) Cishoon 2026-03-23 08:07:39 +08:00
  • 343998865a perf: pad max-num-requests in decode cuda graph for higher coverage (#20978) Yilong Zhao 2026-03-22 17:06:16 -07:00
  • ce0541404f [FlashInfer v0.6.6][RL] Support fp8-last-n-bf16 RL for flashinfer_trtllm_routed moe backend (#20214) Ziang Li 2026-03-22 11:17:01 -07:00
  • c1fe5de69c [Diffusion] Clean up diffusion Triton kernels and modernize custom op registration (#21122) Xiaoyu Zhang 2026-03-22 22:38:57 +08:00
  • 2406ddfdb8 Add ut guide to test skills (#21130) Ke Bao 2026-03-22 20:55:37 +08:00
  • 009eee85a0 CUTLASS FP8 Blockwise GEMM improvement of SM120 (#20887) Brayden Zhong 2026-03-22 05:55:54 -04:00
  • 766d225fcc Add SGLang CUDA crash API logging inspired by FlashInfer (#20910) Xiaoyu Zhang 2026-03-22 16:39:40 +08:00
  • bb737d7a82 Support Qwen3 MoE context parallel (#18233) Shunkangz 2026-03-22 16:27:20 +08:00
  • 6d160b42bb [Spec][Ngram] 1/N: Reference based Speculative Decoding refactor (#20393) kpham-sgl 2026-03-22 00:55:10 -07:00
  • d9f5c2179c ci(slash-cmd): allow write-permission users to /rerun-ut on fork PRs (#21121) Liangsheng Yin 2026-03-22 00:45:48 -07:00
  • 1b65c0d259 [Diffusion] Fix torch.compile RMSNorm fallback for Z-Image (#20962) Xiaoyu Zhang 2026-03-22 15:38:22 +08:00
  • 1e97864d75 ci(slash-cmd): allow repo write-permission users to /rerun-ut (#21120) Liangsheng Yin 2026-03-22 00:32:29 -07:00
  • 3bc595acbc [FlashAttn] Add fused triton kernel for normal_decode_set_metadata (#20778) Bowen Li 2026-03-22 15:12:29 +08:00
  • f7fc2c8592 [diffusion] fix: fix accuracy for some image models (#20679) Mick 2026-03-22 15:11:57 +08:00
  • 47d36d73f7 Update write-sglang-test skill: CUDA-only for common tests + prefer mock (#21119) Liangsheng Yin 2026-03-21 22:54:43 -07:00
  • 3343a79466 Fix jit-kernel unit test CI dependency install in pr-test workflow (#21089) Lianmin Zheng 2026-03-21 22:13:06 -07:00
  • 2fba2bdad1 refactor: Remove dead code from utils/common.py (#20668) shuwenn 2026-03-22 12:54:17 +08:00
  • 1ff0ee95e3 Update pr-test.yml to remove the temp hack - cron: '15 8 * * *' (#21115) Lianmin Zheng 2026-03-21 21:53:31 -07:00
  • 76e4a8662c Replace clamp_position with JIT kernel + platform dispatch (#20999) Lianmin Zheng 2026-03-21 21:26:26 -07:00
  • c1794e2944 [diffusion] fix: fix Sana corrupted output by removing spurious QK norm layers (#20656) Changyi Yang 2026-03-21 21:06:49 -07:00
  • c32e35a2a5 [diffusion] CI: fix picklingerror for diffusion models using diffusers backend (#20854) Yuhao Yang 2026-03-22 11:51:03 +08:00
  • 6dfa8a40bc [diffusion] CI: make auxiliary coverage explicit and simplify testcases (#20983) Mick 2026-03-21 20:18:23 +08:00
  • a0862f00c2 dbrx instruct npu support (#17121) KnightLTC 2026-03-21 17:10:35 +08:00
  • ff921a2ed3 Update cron schedule for PR test workflow (#21090) Liangsheng Yin 2026-03-21 01:03:45 -07:00
  • 852e112ebf [Qwen3.5] Fix broken pipeline parallelism layer splitting (#21070) Alison Shao 2026-03-21 01:02:51 -07:00
  • 9ca68a5904 Remove flaky test for test_lora_update.py (#21088) Baizhou Zhang 2026-03-21 00:52:40 -07:00
  • 9b98d55ba4 Change PR test schedule time to 7:50 AM UTC (#21087) Lianmin Zheng 2026-03-21 00:36:05 -07:00
  • f2c9d5696f Change daily cron job time in pr-test.yml (#21084) Lianmin Zheng 2026-03-21 00:24:53 -07:00
  • 3f883ebf2e Fix test_qwen35_models (#21081) Qiaolin Yu 2026-03-21 00:22:38 -07:00
  • dba6fb3d30 Fix streaming logprobs corruption caused by shared mutable list reference (#21030) Lianmin Zheng 2026-03-21 00:18:48 -07:00
  • d089db0563 ci: add daily PR Test schedule at 12:18am PDT (#21083) Lianmin Zheng 2026-03-21 00:15:48 -07:00
  • 182dd20d57 ci: bypass maintenance gate for PR Test on main (#21082) Lianmin Zheng 2026-03-21 00:08:47 -07:00
  • b7a1ae4fac Fix /rerun-stage dispatch failure for non-AMD stages (#21076) Alison Shao 2026-03-20 23:48:29 -07:00
  • 507db41504 Add CI maintenance mode gate to nightly-test-nvidia.yml (#21079) Lianmin Zheng 2026-03-20 23:44:37 -07:00
  • 3f0ba021fc [AMD] Improve openai/gpt-oss performance (#21020) kk 2026-03-21 14:16:47 +08:00
  • 67cad3e69e Revert "Support CuteDSL mm_fp4 backend" (#21077) Baizhou Zhang 2026-03-20 22:47:47 -07:00
  • c076968c52 [CI] Remove obsolete AOT-only jit-kernel benchmarks after sgl-kernel 4.0 (#21075) Xiaoyu Zhang 2026-03-21 13:40:42 +08:00
  • 5f3393c04c Fix deepseek-v32-fp4 b200 ci (#21072) Baizhou Zhang 2026-03-20 22:28:40 -07:00
  • 9614271ae4 [Test] Fix flaky multi-instance memory occupation test (#21074) Liangsheng Yin 2026-03-20 22:19:03 -07:00
  • 427442304a Add CI maintenance mode gate to nightly-test-nvidia.yml (#21073) Lianmin Zheng 2026-03-20 22:07:34 -07:00
  • 50404e0d1f ci: refactor CUDA dependency install script (#21017) Lianmin Zheng 2026-03-20 21:36:58 -07:00
  • d5473f87c4 Add CI maintenance mode gate to pr-test.yml (#21069) Lianmin Zheng 2026-03-20 21:27:38 -07:00
  • 048d90e165 Revert "[AMD] Add MoE weights and scales padding" (#21067) Alison Shao 2026-03-20 20:26:17 -07:00
  • a75e74b534 Add revocation of permissions section (#21066) Lianmin Zheng 2026-03-20 20:22:24 -07:00
  • 3798a8c88d docs: add out-of-tree model integration guide (#21050) Rabinovich 2026-03-20 20:07:46 -07:00
  • 6c91590e1b [HiCache] refactor: hicache normalization flow and compatibility checks (#19669) shuwenn 2026-03-21 09:38:44 +08:00
  • 9419453713 [AMD] Add MoE weights and scales padding (#18684) mqhc2020 2026-03-21 05:55:09 +08:00
  • f97c09dac1 [AMD] Enable aiter unified attention for non-SWA models (Qwen3-VL) (#20897) YC Yen-Ching Tseng 2026-03-21 03:07:41 +08:00
  • 576e397b6e [Test] Add unit tests for srt/sampling (#20891) Zijun Gao 2026-03-20 10:38:48 -05:00
  • 146700db68 Add e2e demo test in dump comparator (#21031) fzyzcjy 2026-03-20 22:41:01 +08:00
  • 6703cc4484 Enhance output formatting in dump comparator (#21029) fzyzcjy 2026-03-20 22:04:50 +08:00
  • fdbcb8156e Refactor dp_utils to use ParallelAxis enum in dump comparator (#21028) fzyzcjy 2026-03-20 22:04:20 +08:00
  • 154395ab7d Support s≡t dimension name equivalence in dump comparator (#21027) fzyzcjy 2026-03-20 22:03:34 +08:00
  • cc22601d28 Validate replicated axes orthogonality in dump comparator (#21026) fzyzcjy 2026-03-20 22:02:40 +08:00
  • 2f01950a0e Support jointly-determined axes inference in dump comparator (#21025) fzyzcjy 2026-03-20 22:01:26 +08:00
  • ecd7e40d20 Support dependent axis auto-resolution in dump comparator (#21024) fzyzcjy 2026-03-20 21:56:39 +08:00
  • 2d7a262ca3 ci: rename 1/2-gpu-runner labels to 1/2-gpu-h100 (#21008) Lianmin Zheng 2026-03-20 06:04:15 -07:00
  • 104b10f70a refactor: consolidate is_in_ci (jit_kernel, sgl-kernel benchmarks, tests) (#21009) Lianmin Zheng 2026-03-20 05:55:36 -07:00
  • 9fbe6800aa [NPU] [Diffusion] Update CI performance baseline for Wan2.2-T2V-A14B-Diffusers-w8a8 (#20997) Артем Савкин 2026-03-20 15:54:12 +03:00
  • f41832795e Add compile-time 256-bit vector guard for pre-Blackwell (#19794) xingsy97 2026-03-20 18:25:12 +08:00
  • 2dd9196079 [JIT Kernel][Feature] Support JIT custom all reduce (rewrite as v2) (#19880) DarkSharpness 2026-03-20 18:24:07 +08:00
  • 2099943a49 Fix scale_step_k computation in the fp8_kernel (#20819) Muqi Li 2026-03-20 18:09:31 +08:00
  • ec01ef9092 Fix torch.compile/dynamo crash with Qwen3 QK-norm in piecewise CUDA g… (#19818) Jia Guo 2026-03-20 03:05:09 -07:00
  • c1da420799 ci: run Stage A CUDA tests as stage-a-test-small-1-gpu on 5090 (#20988) Lianmin Zheng 2026-03-20 02:55:16 -07:00
  • fa89d152c0 [diffusion] CI: fix hunyuan3d JIT cache (#20773) Prozac614 2026-03-20 17:51:55 +08:00
  • a0a4dae67f Revert "Fix DeepSeek V32 FP4 test" (#21003) Lianmin Zheng 2026-03-20 02:19:28 -07:00
  • 112b628227 Replace _resolve_future_token_ids with JIT kernel + platform dispatch (#20976) Lianmin Zheng 2026-03-20 01:47:03 -07:00
  • cf60c5bd15 [CI] Fix jit_kernel benchmark ci (#20990) Xiaoyu Zhang 2026-03-20 16:40:20 +08:00
  • c82d20d48e Fix DeepSeek V32 FP4 test (#20984) Baizhou Zhang 2026-03-20 01:04:32 -07:00
  • 26f709e97d misc: make prefill-delayer compatible with multiple types of mem pool (#20979) Yilong Zhao 2026-03-20 00:05:53 -07:00
  • 193bbf9b66 chore(ci): remove deprecated CI Monitor workflow (#20993) Lianmin Zheng 2026-03-20 00:05:22 -07:00
  • cea79530f8 ci: merge CPU default and stage-a-cpu-only suites (#20992) Lianmin Zheng 2026-03-20 00:04:55 -07:00
  • 95327458ee misc: add BatchTokenizerReq hook into dp controller (#20981) Yilong Zhao 2026-03-19 23:59:53 -07:00
  • 3ebe6e9894 ci: remove redundant RUNNER_LABELS from pr-test.yml (#20991) Lianmin Zheng 2026-03-19 23:59:47 -07:00
  • 712a48c5d2 ci: move metrics scripts under scripts/ci/utils (#20986) Lianmin Zheng 2026-03-19 23:47:57 -07:00
  • 0be88ac44c ci: rename pr-test workflow_call input ref to git_ref Lianmin Zheng 2026-03-19 23:45:06 -07:00
  • 46a76af97b [Bugifx] qwen3 rope parameter compatibility (#20931) lviy 2026-03-20 13:22:01 +08:00
  • 87549f8f0b perf(mamba): use Triton conv1d for non-contiguous input to avoid .contiguous() copy (#20469) Jia Guo 2026-03-19 19:38:46 -07:00
  • db995fba47 perf(kimi_linear): replace einops rearrange with native torch ops in Kimi-Linear KDA path (#20396) Vedant V Jhaveri 2026-03-19 19:38:12 -07:00
  • fa0d8f6629 perf: avoid unnecessary gpu-cpu sync in eagle_info (#20266) ehuaa 2026-03-20 10:37:29 +08:00
  • 3d749c49ca [JIT Kernel] Fix NVFP4 multi-arch compilation failure (#20874) Mohammad Miadh Angkad 2026-03-20 10:30:04 +08:00
  • 6ad78b008b Consolidate streaming session tests (4 files → 3, fewer server starts) (#20961) Liangsheng Yin 2026-03-19 19:13:28 -07:00
  • 22e378af86 Fix result writer in tuning_block_wise_kernel.py, and add FP8 kernel config for L40 (#20368) cs-cat 2026-03-20 09:28:54 +08:00
  • d9794ef9f7 [Qwen3-Next] Fuse Qwen3-Next GDN's qkvz_proj and ba_proj (#19321) Yuan Luo 2026-03-20 09:25:29 +08:00
  • 42f4b7276c Revert "feat(mm)(grpc): compute M-RoPE positions for preprocessed VL inputs" (#20956) Baizhou Zhang 2026-03-19 18:03:04 -07:00
  • 8d22efdeea [Tiny Fix] Fix IS_BLACKWELL env var empty string warning in rerun-ut workflow (#20957) Liangsheng Yin 2026-03-19 17:24:35 -07:00
  • 2b53e660de Simplify streaming session logprob handling (#20955) Liangsheng Yin 2026-03-19 17:09:40 -07:00
  • 63c38aba5e Fix token leak with logprob_start_len=0 in streaming sessions (#20557) Leon Gao 2026-03-19 15:37:27 -07:00