Commit Graph
100 Commits
Author SHA1 Message Date
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Jiayi Yuan
463baafe10 [Auto Sync] Update batch_invariant_ops.py (20260221) (#19098)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jiayi Yuan <34369239+jy-yuan@users.noreply.github.com>
2026-02-20 18:27:31 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Hanming Lu
2928dfb8fa [Auto Sync] Update bench_one_batch_server_internal.py (20260221) (#19097)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
2026-02-20 18:19:14 -08:00
Lianmin ZhengandSehoon Kim e02a9bec8d Refactor sampler: Use a better hash function for deterministic sampling and clear dispatch for probs/logprobs/logits sampling paths (#18915)
Co-authored-by: Sehoon Kim <sehoon@x.ai>
2026-02-17 15:41:23 -08:00
Lianmin Zhengandgithub-actions[bot] <github-actions[bot]@users.noreply.github.com> b33769786f [Auto Sync] Update grpc_request_manager.py, tokenizer_manag... (20260214) (#18838)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2026-02-14 18:12:32 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Jiayi Yuan
8b2020584c [Auto Sync] Update test_deterministic.py (20260214) (#18839)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jiayi Yuan <34369239+jy-yuan@users.noreply.github.com>
2026-02-14 17:19:30 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Xiuyu LiCheng Wan
008ea46af1 [Auto Sync] Update loader.py, weight_utils.py (20260213) (#18779)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Xiuyu Li <xiuyu@x.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-02-13 12:22:50 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Cheng Wan
c56a5efbaa [Auto Sync] Update grok.py (20260213) (#18765)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-02-12 18:41:41 -08:00
Lianmin Zheng d5f66fec15 Revert changes to weight_utils.py (#18759) 2026-02-12 17:15:16 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Dan Zheng
9815ee934c [Auto Sync] Update weight_utils.py (20260212) (#18692)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Dan Zheng <dzheng@x.ai>
2026-02-12 16:26:05 -08:00
Lianmin Zheng 5875ef0a34 Clean up noisy startup log messages and refactor loader.py (#18531) 2026-02-11 16:12:57 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Hanming Lugemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
b027c5aca6 [Auto Sync] Update cache_init_params.py (20260209) (#18502)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-09 14:49:41 -08:00
Lianmin Zhengandgithub-actions[bot] <github-actions[bot]@users.noreply.github.com> ce95f203b0 [Auto Sync] Update logits_processor.py (20260209) (#18503)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2026-02-09 14:33:02 -08:00
Lianmin Zheng 75997ebe8d Update author information in pyproject.toml (#18453) 2026-02-08 12:22:55 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Jiayi Yuangemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
1acae30806 [Auto Sync] Update test_deterministic.py (20260131) (#18034)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jiayi Yuan <34369239+jy-yuan@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-01 07:40:07 -08:00
Lianmin Zhengandgithub-actions[bot] <github-actions[bot]@users.noreply.github.com> fb609669ca [Auto Sync] Update elementwise.py (20260131) (#18033)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2026-02-01 07:39:37 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Byron Hsu
7412ceb4eb [Auto Sync] Update linear.py to assert shapes (20260130) (#17966)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
2026-01-31 01:01:55 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Archit Patke
0e184609d3 Add launch_command assignment in crash dump (#17967)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Archit Patke <apatke@x.ai>
2026-01-31 01:00:40 -08:00
Lianmin Zheng d4180815a4 Make the functions in logits_processor.py and sampler.py more modular (#17885) 2026-01-28 16:24:23 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Jiayi Yuan
0834f9afeb [Auto Sync] Update test_deterministic.py (20260124) (#17665)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jiayi Yuan <34369239+jy-yuan@users.noreply.github.com>
2026-01-24 02:52:47 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>yehu-ux
bc6f0b5ce7 [Auto Sync] Update logits_processor.py, test_logprobs.py (20260124) (#17664)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: yehu-ux <yehu@x.ai>
2026-01-23 17:57:41 -08:00
Lianmin Zheng 56e6652d1d Lazy import torchao (#17626) 2026-01-22 22:04:51 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Wangfan Fu
b74a57a8d9 [Auto Sync] Update detokenizer_manager.py, io_struct.py, mu... (20260120) (#17442)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Wangfan Fu <wangfan@x.ai>
2026-01-21 14:48:32 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Binyao Jiang
1fdf5cac39 [Auto Sync] Update environ.py, fp8.py (20260121) (#17486)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
2026-01-21 12:04:09 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Binyao Jiang
20ed3822bb [Auto Sync] Update piecewise_cuda_graph_runner.py (20260119) (#17313)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
2026-01-20 14:05:05 -08:00
Lianmin Zhengandgithub-actions[bot] <github-actions[bot]@users.noreply.github.com> e619f53113 [Auto Sync] Update tokenizer_manager.py (20260119) (#17317)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2026-01-18 20:32:19 -08:00
Lianmin Zheng fc4b932f4e Update code sync scripts (#17319) 2026-01-18 19:57:28 -08:00
Lianmin ZhengandLiangsheng Yin e7dc85c50b Fix grammar sync across TP ranks (#17100)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
2026-01-15 18:38:01 -08:00
Lianmin Zheng a4825ed588 Fix kernel type annotations for fp8 quant and logging (#16994) 2026-01-13 18:14:32 -08:00
Lianmin Zheng 075c5a5789 Code clean up for fp8 quantization (#16982) 2026-01-13 12:38:39 -08:00
Lianmin Zheng d56d14e566 [Docs] Improve docs for install on gb200 (#16760) 2026-01-09 03:07:13 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>cctry
fb04e7e3c8 [Auto Sync] Update schedule_batch.py, common.py, eagle_info... (20260105) (#16519)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
2026-01-08 02:35:46 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Wangfan Fu
6c0fb189f8 [Auto Sync] Update tokenizer_manager.py (20260105) (#16477)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Wangfan Fu <wangfan@x.ai>
2026-01-05 14:06:03 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>xiuyuli-xai
c35eb0fdee [Auto Sync] Update loader.py (20260105) (#16478)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: xiuyuli-xai <xiuyu@x.ai>
2026-01-05 01:34:30 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Hanming LuHanming LuJie Ren
012dc5866d [Auto Sync] Update scheduler.py (20260104) (#16424)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanming@x.ai>
Co-authored-by: Jie Ren <no-replay@github.com>
2026-01-04 23:32:56 -08:00
Lianmin Zheng ff978e7d4c Update readme (#16391) 2026-01-04 01:57:54 -08:00
Lianmin Zhengandgithub-actions[bot] <github-actions[bot]@users.noreply.github.com> 62f73a8c81 [Auto Sync] Update engine.py (20260102) (#16317)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2026-01-02 17:29:40 -08:00
Lianmin Zheng e4c1e441af Fix deprecation warning of sre_parse for python 3.13 (#16247) 2025-12-31 21:25:09 -08:00
Lianmin Zheng c58a573a40 [Docs] Improve documentation index page (#16028) 2025-12-28 18:44:52 -08:00
Lianmin Zheng e6d5a213ad Fix metrics (#15998) 2025-12-28 05:03:49 -08:00
Lianmin Zheng 183b65190a Clean up logging (#15919) 2025-12-27 15:27:12 -08:00
Lianmin Zheng a8380ded71 Add a test case for crash dump (#15905) 2025-12-26 19:39:28 -08:00
Lianmin Zheng 93495dcac9 Revert "[VLM] Refactor load_mm_data to improve performance" (#15911) 2025-12-26 13:43:18 -08:00
Lianmin Zheng 43e1bbc0d5 Revert "[feat] Init support for webui-I2I" (#15906) 2025-12-26 09:53:03 -08:00
Lianmin Zheng 8087ef126f Clean up the __init__ of TokenizerManager and DetokenizerManager (#15796) 2025-12-25 10:30:27 -08:00
Lianmin Zheng ecd2d09a6c Fix code sync scripts (#15787) 2025-12-24 16:13:23 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Stefan He
92ddc46824 [Auto Sync] Update server_args.py (20251223) (#15700)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-12-24 14:55:14 -08:00
Lianmin Zheng ff903a7eea Simplify server args (#15704) 2025-12-23 22:46:12 -08:00
Lianmin Zheng cf81737693 Add kv_transfer_total_mb to metrics (#15667) 2025-12-23 11:16:55 -08:00
Lianmin Zheng 5e1a495c65 Improve engine customization interface (#15635) 2025-12-22 14:24:16 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Hanming Lu
92e6b3c30e [Auto Sync] Update scheduler_runtime_checker_mixin.py (20251219) (#15437)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
2025-12-19 01:46:03 -08:00
Lianmin Zheng f228b662a7 Update readme (#15425) 2025-12-18 23:06:00 -08:00
Lianmin Zheng d1f0063262 Clean up __init__ function of the scheduler and event loop for PD (#15298) 2025-12-18 01:35:14 -08:00
Lianmin Zheng 9d64a7b24f Minor style fixes to the scheduler.py (#15218) 2025-12-16 17:09:44 -08:00
Lianmin Zheng 702426b06a Fix import warnings (#15144) 2025-12-14 21:25:18 -08:00
Lianmin Zheng 267170bf1d Clean up server args and engine startup processes (#15015) 2025-12-12 18:46:07 -08:00
Lianmin Zheng b737a125c5 Update ci permission (#15014) 2025-12-12 14:11:40 -08:00
Lianmin Zheng 1b5e903480 Refactor of http and engine entrypoints to allow custom override (#14869) 2025-12-12 12:01:08 -08:00
Lianmin Zheng 25e97380e3 Fix CUDA version handling in ci_install_deepep.sh (#14854) 2025-12-10 16:52:30 -08:00
Lianmin Zhengandgithub-actions[bot] <github-actions[bot]@users.noreply.github.com> 4285e99da7 [Auto Sync] Update data_parallel_controller.py, detokenizer... (20251209) (#14759)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-12-09 18:38:38 -08:00
Lianmin Zheng 18bd8e8d6d Improve CI by trying a warmup before unit tests (#14669) 2025-12-09 15:17:59 -08:00
Lianmin Zheng 036e64dafa move multi-item scoring functions in tokenizer manager into a separate file (#14740) 2025-12-09 14:47:06 -08:00
Lianmin Zheng ab0048793c Revert "[Feat] Add received_time in serving_base" (#14743) 2025-12-09 06:52:27 -08:00
Lianmin ZhengandByron Hsu ce4e836be5 Add per-request decode tp size (#14678)
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
2025-12-08 20:24:31 -08:00
Lianmin Zheng 46d7b35ec7 Move custom_ops under layers; move _custom_ops.py → custom_all_reduce_ops.py (#14326) 2025-12-03 10:33:37 -08:00
Lianmin Zheng ca52ed425f Clean up imports and move files (#14317) 2025-12-02 16:31:54 -08:00
Lianmin Zheng fc6fb550ec [Minor] update docs on CI (#14315) 2025-12-02 12:06:54 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Hanming LuHanming Lu
64092c8b55 [Auto Sync] Rename is_hybrid to is_hybrid_swa (#14252)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanming@x.ai>
2025-12-01 23:24:24 -08:00
Lianmin Zheng 8a7b1b8301 [Docs] Update CI docs (#14260) 2025-12-01 18:15:03 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Dan Zheng
796d82b107 [Auto Sync] Add max_total_num_tokens metric: Update scheduler_metrics_mixin.py, collector.py (20251202) (#14256)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Dan Zheng <dzheng@x.ai>
2025-12-01 16:34:34 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>gauravjain14
1da59e8304 [Auto Sync] optionally disable fake register in Update fp8_kernel.py (20251202) (#14255)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: gauravjain14 <41287729+gauravjain14@users.noreply.github.com>
2025-12-01 16:11:12 -08:00
Lianmin Zheng c4293f59ac Change PR test schedule to run every 6 hours (#14218) 2025-12-01 03:50:58 -08:00
Lianmin Zheng bc3d2a85af [Minor] update docs (#14212) 2025-12-01 02:33:58 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Stefan HeByron Hsu
6df1e8d628 [Auto Sync] Update backend.py (20251130) (#14153)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
2025-11-30 22:15:02 -08:00
Lianmin ZhengChang Su <chang.s.su\n@oracle.com>Xinyuan TongXinyuan Tong
155a9e7237 Fix condition for streaming output_ids in tokenizer manager (#13759)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Chang Su <chang.s.su\n@oracle.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2025-11-29 13:56:15 -08:00
Lianmin Zheng ce6b7dfce7 Add auto-tune workflow (#14124) 2025-11-28 23:23:53 -08:00
Lianmin Zheng 231df4b0d4 Cleanup server args (#14027) 2025-11-26 16:32:41 -08:00
Lianmin ZhengandStefan He 0a186924ba [Code sync] Fix registration of some ops in grok & Fix oss sync scripts (#13990)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-26 13:11:52 -08:00
Lianmin Zheng 1ab6ce0e62 [Auto Sync] Improve profilers and simplify bench_one_batch_server.py (#13866) 2025-11-25 12:13:31 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Hanming LuHanming Lu
e83bd1fadc [Auto Sync] Update schedule_batch.py, schedule_policy.py, b... (20251122) (#13763)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanming@x.ai>
2025-11-24 14:33:31 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>cctry
b41afa3754 [Auto Sync] Update evict_policy.py, radix_cache.py (20251120) (#13669)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
2025-11-21 22:07:36 -08:00
Lianmin Zhengandsglang-bot 99e13d189b Fix url: use https://roadmap.sglang.io for roadmap (#13733)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-21 05:42:32 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Zhuqi Li
90a0133515 [Auto Sync] Update http_server.py, io_struct.py, scheduler_... (20251120) (#13679)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Zhuqi Li <zhli@x.ai>
2025-11-20 23:17:15 -08:00
Lianmin Zheng a352e833c4 CI: Kill zombie diffusion processes in CI & minor code style fix on rotary embedding fallback (#13637) 2025-11-20 21:57:01 +08:00
Lianmin Zheng 7af9b88c6c Revert "[Feature] Introduce JIT Kernel in sglang (with hicache JIT kernel)" (#13644) 2025-11-20 02:11:12 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Sehoon Kim
17b24aca6e [Auto Sync] Update base_grammar_backend.py, collector.py (20251116) (#13357)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
2025-11-19 16:05:50 -08:00
Lianmin Zhengandsglang-bot 2e1dbdb258 Update docs (#13519)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-18 06:24:58 -08:00
Lianmin Zhengandsglang-bot 6d025fd35b Trigger CI retry with edit (#13516)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-18 05:42:31 -08:00
Lianmin Zhengandsglang-bot 63807079b9 Add docs on trigger ci (#13513)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-18 05:23:05 -08:00
Lianmin Zhengandsglang-bot f6cfe9f197 Use slash command to trigger CI (#13512)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-18 04:39:58 -08:00
Lianmin Zhengandsglang-bot 7bc99d4164 README.md -> FOLDER_README.md (#13510)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-18 04:10:04 -08:00
Lianmin Zhengandsglang-bot e2d6746808 Add .github/CI_PERMISSIONS.json to define the CI permissions (#13509)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-18 04:00:15 -08:00
4d59761623 [Doc] Update CI oncall list (#13396)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
2025-11-16 20:43:12 -08:00
Lianmin Zhengandsglang-bot 7e626d12b7 Update docs (#13391)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-16 19:36:33 -08:00
Lianmin Zheng db7299aa30 [Fix] Register custom ops only if they exist (#13321) 2025-11-15 17:48:17 -08:00
Lianmin ZhengandStefan He 22f641ab4f [minor] remove debug code in python/sglang/srt/compilation/weak_ref_tensor_jit.py (#13235)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-14 12:22:24 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Stefan He
7a2254b260 [Auto Sync] Update backend.py, forward_batch_info.py, piece... (20251113) (#13221)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-13 18:54:11 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
19f6a33ce9 [Auto Sync] Update pynccl_wrapper.py, environ.py, registry.... (20251111) (#13097)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-11-13 15:58:47 -08:00
Lianmin ZhengandStefan He d646cf6347 [Auto Sync] Update test_deterministic.py (20251112) (#13128)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-12 11:12:23 -08:00
Lianmin Zheng 40b26b456b Simplify the BatchMultimodalOutput in io_struct.py (#12993) 2025-11-10 13:54:56 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Stefan He
9ea2c686c7 [Auto Sync] Update batch_invariant_ops.py (20251109) (#12916)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-10 01:51:39 -08:00