chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 14 Packages Projects Releases Wiki Activity
Files
89caf7a3c6cde7a6d01f9fa1dd362885092a0a87
sglang/test/srt
T
History
…
..
configs
Add test config yamls for Deepseek v3 (#5433)
2025-04-20 17:28:52 -07:00
cpu
…
models
…
openai_server
…
double-sparsity-config-Llama-3.1-8B-Instruct.json
…
experiment_runner.py
…
kv_cache_scales_llama3_1_8b.json
…
kv_cache_scales_llama3_8b.json
…
kv_cache_scales_qwen2_1_5b.json
…
parse_results.py
…
run_suite.py
…
test_abort.py
…
test_ascend_attention_backend.py
[feature] enable NPU CI (#7935)
2025-07-20 13:12:42 -07:00
test_ascend_mla_backend.py
…
test_awq_dequant.py
…
test_awq.py
…
test_bench_one_batch.py
Add V2-lite model test (#7390)
2025-07-03 22:25:50 -07:00
test_bench_serving.py
Support overlapped lora updates (#8213)
2025-07-27 13:00:44 -07:00
test_block_int8.py
…
test_bnb.py
…
test_chunked_prefill.py
Add retry for flaky tests in CI (#4755)
2025-03-25 16:53:12 -07:00
test_create_kvindices.py
…
test_custom_allreduce.py
…
test_data_parallelism.py
Add retry for flaky tests in CI (#4755)
2025-03-25 16:53:12 -07:00
test_deepep_internode.py
Add DeepEP to CI PR Test (#5655)
2025-05-06 17:36:03 -07:00
test_deepep_intranode.py
…
test_deepep_large.py
…
test_deepep_low_latency.py
…
test_deepep_small.py
…
test_disaggregation_different_tp.py
…
test_disaggregation.py
[PD] Support decode retract and update decode.py (#7196)
2025-06-14 19:48:05 -07:00
test_double_sparsity.py
…
test_dp_attention.py
[CI] Add deepep tests to CI (#7872)
2025-07-09 01:49:47 -07:00
test_eagle_infer_a.py
…
test_eagle_infer_b.py
[EAGLE] Refactor code for page size > 1 & more simplifications (#7213)
2025-06-16 03:04:29 -07:00
test_ebnf_constrained.py
…
test_eplb.py
…
test_eval_accuracy_large.py
…
test_eval_fp8_accuracy.py
…
test_expert_distribution.py
…
test_expert_location_updater.py
…
test_fa3.py
…
test_fim_completion.py
…
test_flashmla.py
Add V2-lite model test (#7390)
2025-07-03 22:25:50 -07:00
test_forward_split_prefill.py
…
test_fp8_kernel.py
Clean up imports (#5467)
2025-04-16 15:26:49 -07:00
test_fp8_kvcache.py
…
test_full_deepseek_v3.py
…
test_function_call_parser.py
…
test_fused_moe.py
…
test_get_weights_by_name.py
…
test_gguf.py
…
test_gptqmodel_dynamic.py
…
test_health_check.py
…
test_hicache_mla.py
…
test_hicache_page.py
…
test_hicache_storage.py
…
test_hicache.py
…
test_hidden_states.py
…
test_hybrid_attn_backend.py
…
test_hybrid_dp_ep_tp_mtp.py
…
test_input_embeddings.py
Add retry for flaky tests in CI (#4755)
2025-03-25 16:53:12 -07:00
test_int8_kernel.py
…
test_intel_amx_attention_backend.py
…
test_io_struct.py
…
test_jinja_template_utils.py
…
test_kv_events.py
feat: add dp-rank to KV events (#6852)
2025-06-04 15:29:34 -07:00
test_local_attn.py
…
test_metrics.py
…
test_mla_deepseek_v3.py
…
test_mla_flashinfer.py
…
test_mla_fp8.py
…
test_mla_int8_deepseek_v3.py
…
test_mla_tp.py
…
test_mla.py
…
test_modelopt_fp8kvcache.py
Add retry for flaky tests in CI (#4755)
2025-03-25 16:53:12 -07:00
test_modelopt.py
…
test_models_from_modelscope.py
…
test_moe_deepep_eval_accuracy_large.py
[5/N] MoE Refactor: Update MoE parallelism arguments (#8658)
2025-08-01 01:20:03 -07:00
test_moe_deepep.py
…
test_moe_ep.py
…
test_moe_eval_accuracy_large.py
Add retry for flaky tests in CI (#4755)
2025-03-25 16:53:12 -07:00
test_mscclpp.py
…
test_multi_instance_release_memory_occupation.py
Add e2e test for multi instance multi stage memory release/resume occupuation (#7208)
2025-06-26 17:40:38 -07:00
test_nightly_gsm8k_eval_amd.py
…
test_nightly_gsm8k_eval.py
[CI] Fix ci tests (#5769)
2025-04-27 07:18:10 -07:00
test_no_chunked_prefill.py
…
test_no_overlap_scheduler.py
Add retry for flaky tests in CI (#4755)
2025-03-25 16:53:12 -07:00
test_page_size.py
…
test_patch_torch.py
…
test_penalty.py
Add retry for flaky tests in CI (#4755)
2025-03-25 16:53:12 -07:00
test_pp_single_node.py
…
test_pytorch_sampling_backend.py
…
test_quick_allreduce.py
[Feature] Integrate quick allreduce and select the best allreduce implementation (#6619)
2025-07-24 20:48:42 -07:00
test_radix_attention.py
…
test_reasoning_parser.py
…
test_regex_constrained.py
…
test_release_memory_occupation.py
…
test_request_queue_validation.py
…
test_retract_decode.py
…
test_rope_rocm.py
[AMD] Add test_fused_moe.py and test_rope_rocm.py to AMD CI (#5246)
2025-07-06 01:47:16 -07:00
test_sagemaker_server.py
…
test_schedule_policy.py
…
test_score_api.py
…
test_server_args.py
…
test_session_control.py
…
test_skip_tokenizer_init.py
…
test_srt_endpoint.py
[Feature] Add Logit Bias (#6579)
2025-06-10 15:39:25 -07:00
test_srt_engine_with_quant_args.py
…
test_srt_engine.py
…
test_start_profile.py
…
test_swa_unittest.py
…
test_torch_compile_moe.py
Fix throughput threshold for amd ci test (#6414)
2025-05-19 14:17:41 -07:00
test_torch_compile.py
…
test_torch_native_attention_backend.py
…
test_torch_tp.py
…
test_torchao.py
…
test_triton_attention_backend.py
…
test_triton_attention_kernels.py
Revert "fix some typos" (#6244)
2025-05-12 12:53:26 -07:00
test_triton_attention_rocm_mla.py
Add retry for flaky tests in CI (#4755)
2025-03-25 16:53:12 -07:00
test_triton_fused_moe.py
…
test_triton_moe_channel_fp8_kernel.py
…
test_triton_moe_wna16.py
[1/N] MoE Refactor: refactor select_experts (#7966)
2025-07-19 00:51:15 -07:00
test_triton_sliding_window.py
…
test_two_batch_overlap.py
…
test_update_weights_from_disk.py
Support updating weights at once by stopping all requests (#6698)
2025-07-02 22:26:06 -07:00
test_update_weights_from_distributed.py
…
test_update_weights_from_tensor.py
…
test_utils_update_weights.py
Extract update_weights from RL Engine to SGLang to keep simplicity and fix torch reduce (#8267)
2025-07-26 02:00:59 -07:00
test_verl_engine_2_gpu.py
…
test_verl_engine_4_gpu.py
Multi-Stage Awake: Support Resume and Pause KV Cache and Weights separately (#7099)
2025-06-19 00:56:37 -07:00
test_vertex_endpoint.py
…
test_vision_chunked_prefill.py
Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)
2025-06-29 23:16:19 -07:00
test_vision_openai_server_a.py
…
test_vision_openai_server_b.py
…
test_vision_openai_server_common.py
…
test_vllm_dependency.py
…
test_vlm_accuracy.py
refactor: unify names of the feature field of MultimodalDataItem (#8075)
2025-07-16 17:52:38 -07:00
test_vlm_input_format.py
bring back kimi vl ci (#8537)
2025-07-29 13:14:18 -07:00
test_w8a8_quantization.py
…