Simo Lin
|
d415d22daa
|
refactor(e2e): remove old embedding tests migrated to e2e_test/embeddings (#16592)
|
2026-01-06 14:07:45 -08:00 |
|
Simo Lin
|
a49b9a6420
|
[model-gateway] add embedding tests (#16583)
|
2026-01-06 13:24:37 -08:00 |
|
Simo Lin
|
d57d8e7e5f
|
[smg] clean up logs in mcp (should be info instead warn) (#16591)
|
2026-01-06 12:44:32 -08:00 |
|
Simo Lin
|
a3656cbb96
|
[ci] fix url strips in smg ci (#16548)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2026-01-06 09:23:58 -08:00 |
|
Chang Su
|
21da2dc1ce
|
[grpc] Unify ResponsesContext and HarmonyResponsesContext (#16549)
|
2026-01-06 07:28:06 -08:00 |
|
Chang Su
|
9bf76c11a9
|
[responses API] Add list_tools_for_servers and threading server_keys in routers (#16540)
|
2026-01-05 22:42:22 -08:00 |
|
Chang Su
|
4cf2bbd084
|
[router] Remove deadcode and add note for unused API completeness methods (#16528)
|
2026-01-05 19:53:28 -08:00 |
|
Simo Lin
|
402a0bd6dc
|
[model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525)
|
2026-01-05 18:28:07 -08:00 |
|
Chang Su
|
b98bd9a5fb
|
[model-gateway] Tighten visibility in modules and remove unused re-exports (#16524)
|
2026-01-05 17:38:50 -08:00 |
|
Simo Lin
|
4221b7c573
|
[model-gateway] refactor e2e test infrastructure and add router CI (#16513)
|
2026-01-05 13:50:59 -08:00 |
|
Chang Su
|
1751c75b5d
|
[model-gateway] Tighten visibility across data_connector and grpc module (#16516)
|
2026-01-05 12:31:32 -08:00 |
|
realWeilai
|
23849eba7b
|
[model-gateway] fix tokenizer encode in golang bindings (#16482)
|
2026-01-05 11:40:09 -08:00 |
|
Chang Su
|
51541404f8
|
[grpc] Refactor openai module (#16511)
|
2026-01-05 11:39:33 -08:00 |
|
Chang Su
|
5a2b1ed407
|
[grpc] Refactor grpc/regular/responses (#16509)
|
2026-01-05 10:21:34 -08:00 |
|
Chang Su
|
454dc9e242
|
[model-gateway][grpc] Refactor harmony/responses.rs (#16508)
|
2026-01-05 10:21:05 -08:00 |
|
fzyzcjy
|
1e41069ad1
|
Fix age bucket rendering issue (#16492)
|
2026-01-05 09:29:14 -08:00 |
|
Simo Lin
|
2b4d6d813b
|
[model-gateway][e2e_test]: Create directory structure and backends config (#16469)
|
2026-01-05 08:01:53 -08:00 |
|
Praneth Paruchuri
|
b12258bfaa
|
[model-gateway] Optimize HTTP Router Fan-out: Replace Serial Execution with Concurrent Streams (#16042)
|
2026-01-04 23:38:45 -08:00 |
|
Simo Lin
|
7f6a678f8f
|
[model-gateway] add GPU allocator and model pool infrastructure for parallel E2E tests (#16460)
|
2026-01-04 23:30:32 -08:00 |
|
Simo Lin
|
e6fe092dcc
|
[model-gateway] rename py_test to e2e_test (#16454)
|
2026-01-04 22:24:34 -08:00 |
|
Ratish P
|
f02d82211a
|
[model-gateway]: move PD configuration conflict checks to model gateway (#16088)
|
2026-01-05 14:16:07 +08:00 |
|
Simo Lin
|
e53160bb31
|
[model-gateway] reorganize integration tests into logical subdirectories (#16451)
|
2026-01-04 21:49:20 -08:00 |
|
Simo Lin
|
2181bc9e51
|
[model-gateway] Delete Python integration_mock tests (#16448)
|
2026-01-04 21:34:06 -08:00 |
|
Simo Lin
|
f84487af59
|
[model-gateway] : Rust integration tests for integration_mock replacement (#16441)
|
2026-01-04 21:01:47 -08:00 |
|
Simo Lin
|
0ff3747ca1
|
[model-gateway]: move unit tests to bindings/python/tests/ (#16430)
|
2026-01-04 18:10:35 -08:00 |
|
Simo Lin
|
4436dc0f6c
|
[model-gateway] improve lock contention and allocation in middleware (#16405)
|
2026-01-04 10:40:07 -08:00 |
|
Simo Lin
|
cf6800f6cc
|
[model-gateway] optimize Vec and HashMap allocations in responses api (#16406)
|
2026-01-04 10:07:55 -08:00 |
|
fzyzcjy
|
f16606d6f6
|
Super tiny code cleanup (#16401)
|
2026-01-04 23:00:09 +08:00 |
|
fzyzcjy
|
27a0830593
|
Tiny add manual policy benchmark to CI (#16392)
|
2026-01-04 19:10:35 +08:00 |
|
Chang Su
|
8d58b3dcdd
|
[model-gateway] Clear architectual debt in responses API (#16359)
|
2026-01-03 21:35:28 -08:00 |
|
fzyzcjy
|
216ea910ad
|
Tiny support forwarding SMG routing key to engine for dumping and avoid string allocation (#16352)
|
2026-01-04 08:33:35 +08:00 |
|
fzyzcjy
|
c88aaf22c7
|
Support in-flight request age metrics for router (#16341)
|
2026-01-04 07:38:53 +08:00 |
|
fzyzcjy
|
877c8e3a96
|
Tiny refactor router test contexts (#16340)
|
2026-01-03 09:44:10 -08:00 |
|
fzyzcjy
|
66dfb8c156
|
Tiny fix non-PD router http header missing whitelist (#16339)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-01-03 09:43:02 -08:00 |
|
Simo Lin
|
65b0b5b248
|
fix(logging): use Display format for model_id instead of Debug (#16337)
|
2026-01-03 00:21:39 -08:00 |
|
Chang Su
|
d8ac5eecf7
|
[model-gateway] bug fix on module name (#16332)
|
2026-01-02 21:56:18 -08:00 |
|
Chang Su
|
b23e7ed13c
|
refactor(gateway): shorten logging targets from sgl_model_gateway to smg (#16328)
|
2026-01-02 21:12:33 -08:00 |
|
Simo Lin
|
31ed68e7c1
|
[model-gateway] address embedding similarity threshold in ut (#16321)
|
2026-01-02 16:46:55 -08:00 |
|
Chang Su
|
24c91001cf
|
[model-gateway] code clean up in tokenizer register step workflow (#16316)
|
2026-01-02 16:05:10 -08:00 |
|
Chang Su
|
c4edcac6d7
|
refactor(core): remove get_by_model_fast alias in worker_registry (#16313)
|
2026-01-02 16:04:23 -08:00 |
|
Chang Su
|
e93433892b
|
refactor(steps): consolidate duplicate strip_protocol function (#16318)
|
2026-01-02 16:02:42 -08:00 |
|
Chang Su
|
a2d4f58a96
|
fix(http): use 504 Gateway Timeout for upstream timeouts (#16320)
|
2026-01-02 16:01:44 -08:00 |
|
Chang Su
|
f66b091699
|
refactor(http): improve pd_types.rs documentation and style (#16319)
|
2026-01-02 16:01:11 -08:00 |
|
Chang Su
|
2f623368ab
|
refactor(core): use idiomatic .min() in calculate_delay (#16314)
|
2026-01-02 15:46:13 -08:00 |
|
Chang Su
|
bd9a2ced47
|
refactor(core): use thiserror for WorkerError (#16315)
|
2026-01-02 15:33:07 -08:00 |
|
Chang Su
|
0ca417d9ae
|
chore(core): remove unused serde_json import in worker.rs (#16312)
|
2026-01-02 15:31:41 -08:00 |
|
Simo Lin
|
d401d23876
|
[model-gateway] Add embedding correctness test comparing against HuggingFace (#16092)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2026-01-02 10:58:20 -08:00 |
|
fzyzcjy
|
00562ee14a
|
Support cache eviction for Manual Policy (#16263)
|
2026-01-02 08:52:01 +08:00 |
|
Simo Lin
|
851845579c
|
perf(tree): optimize input_char_count calculation (#16238)
|
2025-12-31 15:29:37 -08:00 |
|
Simo Lin
|
ace6f3005f
|
ci(benchmark): disable sccache summary annotations and fix tree output (#16233)
|
2025-12-31 11:05:21 -08:00 |
|