chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
11,116 Commits 1 Branch 0 Tags
47cb9b9d116d1c5c112e894110ec94de80f2db6b
Commit Graph

77 Commits

Author SHA1 Message Date
Liangsheng Yin
4d3976b6c5 [HiCache] Check in-flight async ops in is_fully_idle() before attach/detach (#20746) 2026-03-17 17:28:26 -07:00
Bruce Wu
70a6fb53af Enable embedding lookup/lora_a logic for chunked backend (#17692) 
Co-authored-by: Bruce Wu <mogicianwu@fb.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Ethan (Yusheng) Su <yushengsu.thu@gmail.com>
 2026-03-16 11:37:58 -07:00
Liangsheng Yin
f0458e0b49 [Utils] Move network/socket utilities from common.py to network.py (#20646) 2026-03-15 20:35:24 -07:00
Liangsheng Yin
fc7f9c1de7 Rename --stream-output to --incremental-streaming-output (#20614) 2026-03-14 23:22:33 -07:00
Qiaolin Yu
9c6f166600 tiny fix the usage of test_logprobs (#20473) 2026-03-12 15:37:45 -07:00
Pai Liu
ac1310b300 Fix wrong BaseKVCacheMethod import in test_modelopt_fp8kvcache.py (#20403) 2026-03-12 00:23:46 -07:00
Pai Liu
2c03a5c6c7 Fix global server args not set error in test_triton_moe_wna16.py (#20412) 2026-03-12 00:22:59 -07:00
BingjiaWang
006bd44cf9 [deepseekv3.2] fix get_k_and_s_triton kenel for 128K seqlen case bug (#19319) 
Co-authored-by: abing <wangbingjia.wbj@alibaba-inc.com>
 2026-03-11 12:56:33 -07:00
Yoray Zack
9991debde3 [Feature] Integrate Elastic NIXL-EP into SGLang (#19248) 
Signed-off-by: Barak Biber <bbiber@nvidia.com>
Signed-off-by: Yoray Zack <yorayz@nvidia.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Barak Biber <bbiber@nvidia.com>
 2026-03-11 17:37:43 +08:00
shubham singhal
a0d085c16d Adding correct path for module not found error while collecting test (#19778) 
Co-authored-by: sys-lpot-val <sys_lpot_val@intel.com>
 2026-03-06 16:26:16 -08:00
Xinyu Zhang
b3cfad0a80 Add Ray actor support for scheduler process management (DP=1) (#17684) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-03-05 13:21:23 -08:00
Yuwei An
c64274c746 Piecewise Cuda Graph set default (#16331) 2026-03-02 23:18:07 +08:00
Aurick Qiao
c6cb0c9649 [Session] Add streaming mode with SessionAwareCache fast path (#19171) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-02-27 16:31:08 -08:00
ympcMark
43fade5f69 [4/N] (Elastic EP) Back up Expert Weights in DRAM (#17374) 
Co-authored-by: UNIDY2002 <unidy2002@outlook.com>
 2026-02-27 15:59:13 +08:00
Feng Su
3b89302277 Refactor: observability code cleanup (#17862) 
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
 2026-02-24 18:07:29 -08:00
Yuan Luo
31c7dc9d99 [VLM] Introduce FlashInfer CUDNN Prefill as ViT Backend (#19003) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-02-24 19:49:22 +08:00
Liangsheng Yin
1f2da824dd [Benchmark] Remove re-exports from bench_serving.py (#19130) 2026-02-21 14:30:30 -08:00
Xinyuan Tong
cc451671b5 [FEAT] Add Anthropic compatible API endpoint (#18630) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-02-21 19:37:38 +08:00
SoluMilken
07a24f1a38 update pre-commit config (#18860) 2026-02-16 00:18:31 +08:00
shuwenn
3299c4f9c1 [CI] feat: add early exit to wait_for_server when process dies (#18602) 2026-02-13 16:46:09 -08:00
Teng Ma
df733c5ee5 [HiCache][PP] add test case for compatibility (#16395) 2026-02-09 18:03:04 -08:00
Baizhou Zhang
615a02dcd4 Revert "optimize get_topk_ragged by fusing get k and k_scale triton kernel" (#18471) 2026-02-09 16:37:19 +08:00
BingjiaWang
760ae933bb optimize get_topk_ragged by fusing get k and k_scale triton kernel (#16043) 
Co-authored-by: abing <wangbingjia.wbj@alibaba-inc.com>
 2026-02-04 19:59:41 +08:00
DiweiSun
495290aefd enable ut test for xpu devices (#11712) 
Co-authored-by: jundu <jun.du@intel.com>
Co-authored-by: Gao, Pengfei <pengfei.gao@intel.com>
 2026-02-03 11:15:14 -08:00
Alison Shao
56907cbcb1 Move deleted 8-GPU tests to test/manual/ (#18060) 2026-02-01 00:21:56 -08:00
Niko Ma
cbf90d70ff [PD] Support KV transfer with MORI-IO (#14626) 
Co-authored-by: cwortman-amd <cwortman@amd.com>
 2026-01-28 23:22:41 -08:00
Lianmin Zheng
bc6f0b5ce7 [Auto Sync] Update logits_processor.py, test_logprobs.py (20260124) (#17664) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: yehu-ux <yehu@x.ai>
 2026-01-23 17:57:41 -08:00
Even Zhou
69ac8b58f7 [NPU] [CI] temporarily disable mtp test (#17614) 2026-01-23 15:17:31 +08:00
Alison Shao
823a046e8f Add hybrid parallelism test to nightly CI (#17444) 2026-01-20 17:43:50 -08:00
Hudson Xing
c1282da236 fix(ci): apply MMMU retry logic to all affected test files (#17329) 2026-01-19 10:00:29 -08:00
Kartik Ramesh
5836324c55 KV Cache Events with Attention DP bug fix (#16030) (#16412) 2026-01-19 14:13:48 +08:00
Ke Bao
7f8a58fffb Refactor prefix cache type checking (#17028) 2026-01-15 11:28:13 +08:00
Артем Савкин
424a380077 [NPU] NPU quantization refactoring & more quantization formats support (#14504) 
Co-authored-by: TamirBaydasov <mr.jeijy@gmail.com>
Co-authored-by: Tamir Baydasov <41994229+TamirBaydasov@users.noreply.github.com>
Co-authored-by: Савкин Артем <savkinartem@MacBook-Air-Viktoria.local>
Co-authored-by: Edward Shogulin <edward.shogulin@gmail.com>
 2026-01-15 04:25:15 +08:00
Xun Sun
9f5cd80a8d Re-introduce the unit test of test_mooncake_ep_small (#16019) 2026-01-12 17:01:24 +08:00
Glen Liu
6327dff242 enhance LoRA tests and fix base model LoRA eviction in Scheduler (#16333) 2026-01-10 16:49:00 +08:00
fzyzcjy
1f0ea4f958 Add routing key based schedule policy (#16840) 2026-01-10 10:16:23 +08:00
Jonah Bernard
45ef834412 Add MoE Integration Tests For CUTLASS Coverage (#16280) 2026-01-05 11:26:11 -08:00
Baizhou Zhang
f07e76b229 Multiple refactors of DeepSeek V32 and context parallel (#16305) 2026-01-03 02:21:22 +08:00
Yongfei Xu
0d244116d2 [DeepSeek v3.2] opt Context Parallelism: support fused moe, multi batch and fp8 kvcache (#13959) 2026-01-02 23:49:14 +08:00
1874.
e0e5084802 Fix parse args from file(#13911) (#14085) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2026-01-01 11:37:33 +08:00
Baizhou Zhang
f35b5da521 [CI] Append test variant name to markdown report header in nightly test (#16166) 2025-12-31 00:09:24 +08:00
Cheng Wan
60f1ca6925 Refactor: Moving extend_logprob_start_len calculation out of prepare_for_extend (#16105) 2025-12-30 12:38:33 +08:00
Vladimir Serov
9e263c2162 [LoRA] Torch native backend: rework implementation and updated tests (#15187) 2025-12-30 11:48:51 +08:00
Cheng Wan
6f9d0a89a0 [scheduler] fix: correcting extend_logprob_start_len calculation (#15922) 2025-12-28 14:57:04 -08:00
Alison Shao
0e536600e8 Refactor: separate CI-specific weight validation into dedicated module (#15216) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2025-12-27 20:50:39 -08:00
shuwenn
758b9067a0 [CI] fix UT assert error in test_tokenizer_manager.py (#15646) 2025-12-23 22:24:33 +08:00
Yuan Luo
019517a356 [VLM] Support ViT Piecewise CUDA Graph for Qwen3-VL (#15320) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-12-20 21:00:07 +08:00
Hudson Xing
99cb2ed988 [refactor] Move trtllm_fp8_kv_kernel to triton_ops directory (#15044) 2025-12-14 15:22:37 -08:00
Yuan Luo
3b8a824b8b [VLM] Support VLM ViT Piecewise CUDA Graph (#14422) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: kousakawang <wanghanpei@bytedance.com>
 2025-12-13 20:49:40 +08:00
Liangsheng Yin
543d62d11a Introduce server_fixtures in sglang.test (#14899) 2025-12-11 22:30:33 +09:00