Files

fzyzcjy efbc687c28 Support DeepSeek V3.2 Exp (#11061 )

Co-authored-by: Stefan He <11166516+hebiao064@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <95566987+hnyls2002@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <56809903+fridge003@users.noreply.github.com>
Co-authored-by: DarkSharpness <76582120+darksharpness@users.noreply.github.com>
Co-authored-by: ZhengdQin <46387172+zhengdqin@users.noreply.github.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

2025-10-06 00:24:15 -07:00

eval

Minor style fixes for sgl-kernel (#9289 )

2025-08-18 09:38:35 -07:00

lang

Tiny move files to utils folder (#11166 )

2025-10-03 22:40:06 +08:00

srt

Support DeepSeek V3.2 Exp (#11061 )

2025-10-06 00:24:15 -07:00

test

Support DeepSeek V3.2 Exp (#11061 )

2025-10-06 00:24:15 -07:00

__init__.py

Refactor the docs (#9031 )

2025-08-10 19:49:45 -07:00

bench_offline_throughput.py

Feature/modelscope model download (#8083 )

2025-07-31 17:29:31 -07:00

bench_one_batch_server.py

fix: show failed models in nightly ci (#10986 )

2025-09-28 12:38:29 -07:00

bench_one_batch.py

Tiny move files to utils folder (#11166 )

2025-10-03 22:40:06 +08:00

bench_serving.py

Tiny move files to utils folder (#11166 )

2025-10-03 22:40:06 +08:00

check_env.py

Revert "feat: replace Decord with video_reader-rs" (#8077 )

2025-07-15 20:04:56 -07:00

compile_deep_gemm.py

[bugfix] Add 'disaggregation_mode' parameter to warmup function when compile deep_gemm manually (#8618 )

2025-08-01 16:02:53 -07:00

global_config.py

Convert FLASHINFER_WORKSPACE_SIZE to integer (#10731 )

2025-09-22 00:26:42 -07:00

launch_server.py

move environ into sglang.srt to avoid break SRT auto sync. (#10791 )

2025-09-23 02:04:20 -07:00

profiler.py

Fix --dataset-path in bench_one_batch_server (#10475 )

2025-09-16 02:55:02 +08:00

README.md

Run tests based on labels (#10456 )

2025-09-15 00:29:20 -07:00

utils.py

Move cached kernel to srt.utils (#10776 )

2025-09-22 23:00:36 -07:00

version.py

chore: bump v0.5.3rc0 (#10468 )

2025-09-15 03:55:18 -07:00

README.md

Code Structure

eval: The evaluation utilities.
lang: The frontend language.
srt: The backend engine for running local models. (SRT = SGLang Runtime).
test: The test utilities.
api.py: The public APIs.
bench_offline_throughput.py: Benchmark the performance in the offline mode.
bench_one_batch.py: Benchmark the latency of running a single static batch without a server.
bench_one_batch_server.py: Benchmark the latency of running a single batch with a server.
bench_serving.py: Benchmark online serving with dynamic requests.
check_env.py: Check the environment variables and dependencies.
global_config.py: The global configs and constants.
launch_server.py: The entry point for launching a local server.
utils.py: Common utilities.
version.py: Version info.