chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity

Commit Graph

  • 2ff872311b ci: adding llama4 placeholder test to nightly (#16599) Douglas Yang 2026-01-07 05:51:30 -08:00
  • fd16c91cb8 Handle Marlin weight restoration and shape recording (QAT INT4 Rollout Part1) (#15238) JiLi 2026-01-07 21:11:24 +08:00
  • 32a6540afc [Diffusion] Fix Ulysses/Ring process group construction under TP to enable correct Wan2.2 tensor parallelism (#16532) Xiaoyu Zhang 2026-01-07 20:52:36 +08:00
  • 62d0280f62 Tiny fix readme (#16654) Xiaoyu Zhang 2026-01-07 20:41:07 +08:00
  • d4b717c01e [NPU] update docs (#16651) Even Zhou 2026-01-07 20:20:01 +08:00
  • 98a107d491 Re-enable temp_prefill_info assertion after pairing fix (#16203) Hudson Xing 2026-01-07 18:05:17 +08:00
  • b86bbf841e [AMD] Add 8-GPU MX35X test running DSR1-MXFP4 model for AMD CI (#13602) Hubert Lu 2026-01-07 01:43:11 -08:00
  • 48381c3b6d [AMD] suppress warning for amd (#16620) YC Tseng 2026-01-07 17:37:40 +08:00
  • 8bce085321 [AMD] CI - add 2 pp test cases to performance-test-2-gpu-amd (#16514) YC Tseng 2026-01-07 15:52:46 +08:00
  • 6b8a9d7058 fix: update AMD CI estimated time for test_torch_compile (#16631) Alison Shao 2026-01-06 23:42:18 -08:00
  • 973116e6bb [Doc] Optimize pipeline parallelism doc (#16630) Shangming Cai 2026-01-07 14:52:42 +08:00
  • 820e97d6c9 Upgrade aiter version (#16619) Thomas Wang 2026-01-07 14:20:42 +08:00
  • 4c85f9d039 Only allocate encoder metadata for encoder-decoder models (#16527) Minglei Zhu 2026-01-06 22:17:04 -08:00
  • 7d757d6f17 Clean Some Environment Variables for DeepSeek V32 (#15938) Baizhou Zhang 2026-01-07 14:00:16 +08:00
  • 5c04088b3a fix: remove performance testing from nightly dpsk v32 cp single node (#16582) Douglas Yang 2026-01-06 21:38:31 -08:00
  • f066036c8b [diffusion] fix: fix ZImage SP sharding for 5D latents and unpad frames (#16418) Chi McIsaac 2026-01-07 00:24:04 -05:00
  • 52de807dd7 Migrate profiling tests to test/registered/profiling/ (#16459) Alison Shao 2026-01-06 21:04:48 -08:00
  • 70933f34f1 Migrate attention unit tests to test/registered/attention/ (#16465) Alison Shao 2026-01-06 20:50:54 -08:00
  • ce453fa43b Migrate backends tests to CI registration system (#16468) Alison Shao 2026-01-06 20:31:52 -08:00
  • 3be1e734ee [model-gateway] extract header extraction in policy and add (#16566) fzyzcjy 2026-01-07 12:18:44 +08:00
  • 38895a0064 ci: adjust partition counts for stage-b and unit tests (#16617) Alison Shao 2026-01-06 20:18:10 -08:00
  • d8b8198192 [smg][ci]: migrate benchmarks to e2e_test/benchmarks/, use parent conftest (#16597) Simo Lin 2026-01-06 20:15:20 -08:00
  • 913b688f21 fix: fill a meaningful tool_index (#16504) Yingchun Lai 2026-01-07 12:00:09 +08:00
  • 951d16c890 fix: adjusting vlm accuracy thresholds (#16593) Douglas Yang 2026-01-06 19:41:05 -08:00
  • 53846746bf [VLM] Fix CUDA IPC OOM (#16118) Yuan Luo 2026-01-07 11:30:35 +08:00
  • 534ac384db [HiCacheStorage & PD] fix prefill bootstrap request host memory leaks (#15439) MOHENOO 2026-01-07 11:03:57 +08:00
  • 2a8d5493f3 PCG Unit Test Adjustment (#16609) Yuwei An 2026-01-06 18:57:15 -08:00
  • 90eac38a12 Migrate FP8/TorchAO tests to test/registered/quant/ (#16453) Alison Shao 2026-01-06 18:27:43 -08:00
  • badcd02896 [diffusion] chore: automatically enable dit_layerwise_offload for Wan (#16499) Mick 2026-01-07 10:22:08 +08:00
  • d874c8bba4 Tiny support http headers in bench serving (#16606) fzyzcjy 2026-01-07 10:15:17 +08:00
  • 9a21d89c5b Tiny add metrics for prefill delayer (#16603) fzyzcjy 2026-01-07 09:53:52 +08:00
  • 4c9ac8566c [NPU] fix command in npu best practice (#16576) Hexq0210 2026-01-07 09:37:27 +08:00
  • fb5b71d015 [router][openai] Rename prepare_mcp_payload_for_streaming and patch_streaming_response_json (#16596) Chang Su 2026-01-06 16:33:29 -08:00
  • 05b54b6d7b [router][grpc] Replace Vec<(String, String, String)> with ExtractedToolCall (#16598) Chang Su 2026-01-06 16:32:59 -08:00
  • 4f443f445a [model-gateway][cleanup] Fix wrong comment in manager.rs (#16601) Chang Su 2026-01-06 16:32:37 -08:00
  • dce8b0606c refactor(e2e): keep only benchmark tests in e2e_http, remove redundant tests (#16594) Simo Lin 2026-01-06 15:05:08 -08:00
  • 399d5283f8 ci: migrate scheduler tests to test/registered/scheduler/ (#16442) Alison Shao 2026-01-06 14:55:52 -08:00
  • 2e0527dd74 ci: migrate Debug Utils, Ops, and Rotary Embedding tests to test/registered/ (#16422) Alison Shao 2026-01-06 14:35:57 -08:00
  • 6beb50d612 feat: add .dockerignore to ignore files when build images (#16223) Yingchun Lai 2026-01-07 06:34:16 +08:00
  • 18e2ef09d7 Add v1/models endpoint to diffusion model APIs so that they can be discovered by model gateway (#16425) Kangyan-Zhou 2026-01-06 14:28:24 -08:00
  • 3271e0e76d Remove dllm-test-1-gpu-amd job (followup to DLLM migration) (#16589) Alison Shao 2026-01-06 14:27:37 -08:00
  • d415d22daa refactor(e2e): remove old embedding tests migrated to e2e_test/embeddings (#16592) Simo Lin 2026-01-06 14:07:45 -08:00
  • a49b9a6420 [model-gateway] add embedding tests (#16583) Simo Lin 2026-01-06 13:24:37 -08:00
  • 5349764298 fix: kimi k2 thinking accuracy threshold change (#16585) Douglas Yang 2026-01-06 13:18:43 -08:00
  • d57d8e7e5f [smg] clean up logs in mcp (should be info instead warn) (#16591) Simo Lin 2026-01-06 12:44:32 -08:00
  • 0cbd8f3247 ci(test): migrate OpenAI server tests to registered CI system (#16326) Alison Shao 2026-01-06 11:09:37 -08:00
  • 6e3fff1352 fix: adding retries for server start and increasing hf read timeout (#16523) Douglas Yang 2026-01-06 09:53:12 -08:00
  • 2210155a45 ci: migrate DLLM tests to test/registered/dllm/ (#16420) Alison Shao 2026-01-06 09:44:26 -08:00
  • a3656cbb96 [ci] fix url strips in smg ci (#16548) Simo Lin 2026-01-06 09:23:58 -08:00
  • 21da2dc1ce [grpc] Unify ResponsesContext and HarmonyResponsesContext (#16549) Chang Su 2026-01-06 07:28:06 -08:00
  • ed307a40bf Tiny add --gsp-ordered (#16575) fzyzcjy 2026-01-06 22:43:52 +08:00
  • 02722b9113 Fix evict swa for overlap scheduler and page size > 1 (#16507) Ke Bao 2026-01-06 22:29:40 +08:00
  • f959250f76 Tiny support sglang_routing_keys_active in engine (#16570) fzyzcjy 2026-01-06 22:10:10 +08:00
  • 959343795f [test] update acc len threshold to 2.7 for eagle dp attention tests (#16463) YAMY 2026-01-06 01:38:35 -08:00
  • bc2f40bebc [test] Add mamba cache release/resume memory test (#14215) Junrong Lin 2026-01-06 16:51:10 +09:00
  • 2724b1100b fix double Unicode escape issue in streaming tool_calls parameters (#13518) lw9527 2026-01-06 15:47:26 +08:00
  • 176266f358 Migrate sampling tests to test/registered/sampling/ (#16455) Alison Shao 2026-01-05 23:43:20 -08:00
  • 5e5b1183ed [Diffusion] Ring Attention support sage backend (#16496) Xiaoyu Zhang 2026-01-06 14:45:53 +08:00
  • 9bf76c11a9 [responses API] Add list_tools_for_servers and threading server_keys in routers (#16540) Chang Su 2026-01-05 22:42:22 -08:00
  • 1d7ad4afcc [diffusion] fix: fix bench_serving always use prompt fixed prompts (#16201) jiapingW 2026-01-06 14:39:07 +08:00
  • fba785c459 use aync load for encoder_server (#15456) siyu 2026-01-06 14:31:52 +08:00
  • 5cfa901b57 ci: migrate Constrained Decoding tests to test/registered/constrained/ (#16421) Alison Shao 2026-01-05 22:29:22 -08:00
  • f27c6cdc2b Migrate metrics tests to test/registered/metrics/ (#16466) Alison Shao 2026-01-05 22:21:49 -08:00
  • 5097e1e85b fix: moving dpsk v32 cp single node to nightly (#16539) Douglas Yang 2026-01-05 22:18:59 -08:00
  • 861a35fb6e ci: migrate RL tests to test/registered/rl/ (#16417) Alison Shao 2026-01-05 22:13:13 -08:00
  • 6ffe1fc02f [Fix]Pin mooncake version to 0.3.7.post2 in grace blackwell (#16502) Baizhou Zhang 2026-01-06 14:11:40 +08:00
  • 73398e22d6 ci: migrate VLM tests to test/registered/vlm/ (#16415) Alison Shao 2026-01-05 21:25:29 -08:00
  • 17958c5f0d Migrate parsing tests to test/registered/parser/ (#16467) Alison Shao 2026-01-05 21:15:32 -08:00
  • 3aa11ca722 Remove hybrid_kvcache_ratio in server args (#16399) Ke Bao 2026-01-06 13:13:13 +08:00
  • 7be1a8c70c [diffusion] feat: support diffusers backend - run any model supported by diffusers (#14112) Adarsh Shirawalmath 2026-01-06 10:00:57 +05:30
  • 84d13c54bb feat: only add input vision tokens in bench_serving result if vision dataset is used (#15492) Raayan Dhar 2026-01-05 20:14:42 -08:00
  • c80c0e0fc0 fix: adding multi-threading for kimi weights loading in pr test (#16538) Douglas Yang 2026-01-05 20:10:13 -08:00
  • c105a3124b Support multi-round conversations in bench_serving (#6135) fzyzcjy 2026-01-06 11:59:39 +08:00
  • 4cf2bbd084 [router] Remove deadcode and add note for unused API completeness methods (#16528) Chang Su 2026-01-05 19:53:28 -08:00
  • d7b706be94 ci: migrate HiCache 1-GPU tests to test/registered/hicache/ (#16416) Alison Shao 2026-01-05 19:38:21 -08:00
  • 4a9537a495 ci: migrate Mamba/Layers tests to test/registered/layers/mamba/ (#16419) Alison Shao 2026-01-05 19:12:47 -08:00
  • ca922d4b05 [diffusion] feat: support warmup with resolutions (#16434) Mick 2026-01-06 10:32:18 +08:00
  • 402a0bd6dc [model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525) Simo Lin 2026-01-05 18:28:07 -08:00
  • 76c71d1d34 fix: unimplemented methods in BaseIndexerMetadata (#16520) Douglas Yang 2026-01-05 18:26:42 -08:00
  • 2d02c150dc [3/N][Sparse With Hicache]: Init sparse coordinator (#16086) zhangheng 2026-01-06 09:51:04 +08:00
  • b98bd9a5fb [model-gateway] Tighten visibility in modules and remove unused re-exports (#16524) Chang Su 2026-01-05 17:38:50 -08:00
  • ce694b2b9e Fix the problem where Qwen3VL raises an "object has no attribute 'mod… (#15677) ShirakSyouya 2026-01-06 08:45:13 +08:00
  • 6c0fb189f8 [Auto Sync] Update tokenizer_manager.py (20260105) (#16477) Lianmin Zheng 2026-01-05 14:06:03 -08:00
  • 9a9f996f8d [FP8] Fix weight_scale shape to match with x_scale shape for per-tensor quant under torch.compile (#16356) Binyao Jiang 2026-01-05 13:55:26 -08:00
  • 4221b7c573 [model-gateway] refactor e2e test infrastructure and add router CI (#16513) Simo Lin 2026-01-05 13:50:59 -08:00
  • c371df2f25 [AMD] Fix CI and add retry logic for git clone timeout (#15663) yctseng0211 2026-01-06 04:37:52 +08:00
  • 1751c75b5d [model-gateway] Tighten visibility across data_connector and grpc module (#16516) Chang Su 2026-01-05 12:31:32 -08:00
  • 23849eba7b [model-gateway] fix tokenizer encode in golang bindings (#16482) realWeilai 2026-01-06 03:40:09 +08:00
  • 51541404f8 [grpc] Refactor openai module (#16511) Chang Su 2026-01-05 11:39:33 -08:00
  • 45ef834412 Add MoE Integration Tests For CUTLASS Coverage (#16280) Jonah Bernard 2026-01-05 11:26:11 -08:00
  • 5a2b1ed407 [grpc] Refactor grpc/regular/responses (#16509) Chang Su 2026-01-05 10:21:34 -08:00
  • 454dc9e242 [model-gateway][grpc] Refactor harmony/responses.rs (#16508) Chang Su 2026-01-05 10:21:05 -08:00
  • 1e41069ad1 Fix age bucket rendering issue (#16492) fzyzcjy 2026-01-06 01:29:14 +08:00
  • 2b4d6d813b [model-gateway][e2e_test]: Create directory structure and backends config (#16469) Simo Lin 2026-01-05 08:01:53 -08:00
  • a3914e3b3f [Bugfix] fix some memory computation bugs for qwen3next with mtp (#16138) Yi Zhang 2026-01-05 23:24:21 +08:00
  • 130f60ee78 Add CODEOWNERS for scheduler_pp_mixin.py (#16481) Shangming Cai 2026-01-05 21:12:20 +08:00
  • 4397cda7dc feat: raise error in PD when page sizes are mismatched (#14474) Raayan Dhar 2026-01-05 03:54:01 -08:00
  • d56fd10cb6 [AMD CI] fix sglang version detection in daily docker image release and init container (#16367) Bingxu Chen 2026-01-05 19:22:39 +08:00
  • abb06be946 [NPU] Fixed link redirection issue. (#16475) Hexq0210 2026-01-05 19:03:29 +08:00
  • c35eb0fdee [Auto Sync] Update loader.py (20260105) (#16478) Lianmin Zheng 2026-01-05 01:34:30 -08:00