chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
11,256 Commits 1 Branch 0 Tags
cch/megamoe-rc-v0.1
Commit Graph

322 Commits

Author SHA1 Message Date
Liangsheng Yin
f0458e0b49 [Utils] Move network/socket utilities from common.py to network.py (#20646) 2026-03-15 20:35:24 -07:00
Simo Lin
a16f03c1e3 Revert "feat: add banner to sgl-model-gateway (#20471)" (#20536) 2026-03-13 09:20:32 -07:00
Simo Lin
b227e53ebf feat: add banner to sgl-model-gateway (#20471) 
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
 2026-03-12 14:25:27 -07:00
Feng Su
8a411a9a2a [Tracing] Remove the deprecated tracing code from mini_lb (#19409) 2026-03-07 11:19:23 +08:00
Jonathan Lee
e58391dd7d Add --json-log flag to enable structured JSON logging (#19968) 
Co-authored-by: github_username <github_email>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-05 11:24:12 -08:00
Kangyan-Zhou
0eb64c1e72 [smg] Extract tokenizer_path from /model_info into discovered labels (#19905) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-04 17:12:20 -08:00
Eric Zhang
e6411ba315 Increase max_concurrent_jobs in job queue (#19797) 2026-03-03 15:54:51 -08:00
Duyi-Wang
98e433e305 [PD-Disagg][Fix] Remove 'test_external_dp_routing' from Rust Router constructor parameters. (#19492) 2026-02-27 02:40:01 -08:00
Liangsheng Yin
539f772f54 [PD-Disagg] Fully support external DP dispatch w/ PD-disaggregation mode. (#19268) 
Co-authored-by: Ratish P <114130421+ratish1@users.noreply.github.com>
 2026-02-24 19:58:01 -08:00
Simo Lin
b2166a2f33 fix(gateway): pin internal crate dependencies to exact versions (#19224) 
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
 2026-02-23 22:35:47 -08:00
Blake Ledden
f759960ac2 feat: expose consistent_hashing policy in Python router CLI args (#17972) 2026-02-16 00:33:24 +08:00
Bingxu Chen
38473f8ee0 [AMD] Fix sgl-model-gateway Build Errors in ROCm Docker Release (#18836) 2026-02-14 00:07:26 -08:00
Simo Lin
0236522214 refactor: remove crate re-export aliases from lib.rs (#18737) 2026-02-12 09:17:24 -08:00
Simo Lin
2f283d8152 refactor: consolidate gRPC client into shared crate dependency (#18730) 2026-02-12 06:43:24 -08:00
Simo Lin
ac16d4450e [smg][mesh] extract mesh to mesh crate to reduce compile time (#17907) 2026-01-28 17:58:42 -08:00
Praneth Paruchuri
6f009961bb [model-gateway] Optimize HashRing construction to reduce heap allocations (#17575) 2026-01-27 22:46:40 -08:00
Praneth Paruchuri
897c35b457 [model-gateway] Optimize consistent hashing hot path to eliminate allocations (#17467) 2026-01-27 22:46:11 -08:00
shuwenn
a723d1c5ef [model-gateway] ignore error for embeddings/classify in PD router (#15931) 2026-01-26 22:49:14 -05:00
Simo Lin
6756cf18c6 remove multimodal as this is completely dead code (#17750) 2026-01-26 00:07:40 -08:00
Simo Lin
d4adff31aa update wasm endpoint (#17748) 2026-01-25 23:43:29 -08:00
Simo Lin
ed75136e85 remove self managed wasm as it has been replaced with official smg wa… (#17746) 2026-01-25 22:56:33 -08:00
Praneth Paruchuri
8c2d8b51e9 [model-gateway] fix wasm example2 (#17244) 2026-01-25 22:45:36 -08:00
Praneth Paruchuri
02c1dabf5d [model-gateway] fix wasm example3 (#17277) 2026-01-25 22:45:21 -08:00
Praneth Paruchuri
511961870f [model-gateway] Optimize WASM cache lookups using SHA-256 (#17344) 2026-01-25 22:44:55 -08:00
Simo Lin
7890a96f97 remove self managed mcp as it has been replaced with official rmcp crate (#17740) 2026-01-25 22:17:06 -08:00
Simo Lin
46bc53a81b [smg] import db crate to replace self managed one (#17727) 2026-01-25 16:54:52 -08:00
Simo Lin
52d0ca944b [smg] import official wfaas crate to replace self managed one (#17724) 2026-01-25 15:20:58 -08:00
Simo Lin
bf139af37a [smg] use already published auth crate for better compilation speed (#17723) 2026-01-25 14:52:42 -08:00
Simo Lin
97a36a72b7 [smg] remove dead tokenizer code (#17722) 2026-01-25 14:04:48 -08:00
Praneth Paruchuri
fc7096f80b [model-gateway] Optimize special token search using Aho-Corasick (#17387) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-25 13:54:15 -08:00
Simo Lin
f5ac1ca10b [smg] use official tokenizer crate instead of manually built one (#17721) 2026-01-25 13:35:16 -08:00
Simo Lin
2c1e2674cc [misc] replace existing tool call code with new crate package (#17720) 2026-01-25 13:07:39 -08:00
Simo Lin
86c7bc6431 [smg] update crate for tools (#17717) 2026-01-25 12:56:42 -08:00
Simo Lin
7a1d7ab47b remove self managed protocols as it has been replaced with official oai spec (#17711) 2026-01-25 06:38:13 -08:00
Simo Lin
8db2802b2d update to use official openai protocol crate (#17710) 2026-01-25 06:35:59 -08:00
Simo Lin
6af22f8dbf use published reasoning parser crate (#17709) 2026-01-25 06:15:03 -08:00
Jacob Gordon
42523d0364 ci(pre-commit): avoids extraneous codespell exclusions (#17590) 2026-01-22 09:55:23 -05:00
fzyzcjy
9c2530642c Change routing policy API to be async to support more policies (#17048) 2026-01-17 17:12:51 +08:00
fzyzcjy
a7b5f75d88 Support integration tests with Redis binary (#17045) 2026-01-17 11:59:04 +08:00
fzyzcjy
305c1a575a Tiny remove unused code (#17047) 2026-01-17 11:58:43 +08:00
fzyzcjy
c824ddd581 Fix imbalancedness for manual policy min group mode for requests without routing id (#17044) 2026-01-17 11:58:35 +08:00
Chang Su
4229de3b13 [model-gateway] Refine TokenizerRegisty.load() to handle duplication (#17230) 2026-01-16 13:53:21 -08:00
Chang Su
a7f5677abe refactor: unify registration through tokenizer_registration workflow (#17187) 2026-01-16 10:53:36 -08:00
Chang Su
669d309a8b [model-gateway] Consolidate "unknown" model id usage (#17186) 2026-01-15 21:02:40 -08:00
Simo Lin
3f44268fe5 [smg] release 0.3.2 (#17168) 2026-01-15 11:22:18 -08:00
Simo Lin
f7ec8174db [smg][ci] add make cmd to patch versions (#17167) 2026-01-15 11:00:53 -08:00
jeff.ye
c020d30045 [Model-Gateway: grpc]: create tokenizer with chat template (#17052) 
Signed-off-by: jeff.ye <jeff.ye@novita.ai>
 2026-01-14 17:56:08 -08:00
Simo Lin
f091858304 [gRPC] Add GetLoads RPC for comprehensive load metrics (#17087) 2026-01-14 12:05:10 -08:00
Ziwen Zhao
cf25852a1d [model-gateway] add --disable-health-check option to skip worker health probes (#17002) 2026-01-13 17:28:32 -08:00
Tony Lu
5938c3b06a [model-gateway] HA - Lightweight State Layer + gRPC Mesh (#14108) 
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Tony Lu <tonylu@linux.alibaba.com>
Co-authored-by: Kun(llfl) <i@imux.top>
 2026-01-13 17:03:39 -08:00