Simo Lin 3f3eb206fa feat(grpc): add SubscribeKvEvents RPC for KV cache event streaming (#20112) ...

Co-authored-by: Chang Su <chang.s.su@oracle.com>

2026-03-08 16:00:29 -07:00

..

anthropic

[Anthropic API] Preserve image content in tool_result conversion (#19233)

2026-02-28 12:07:22 -08:00

ollama

Add Ollama-compatible API endpoints + Smart Router (#14376)

2025-12-16 20:43:38 -08:00

openai

rename nemotron reasoning parser (#19865)

2026-03-05 11:27:07 -08:00

context.py

Fix condition for streaming output_ids in tokenizer manager (#13759)

2025-11-29 13:56:15 -08:00

engine.py

Add Ray actor support for scheduler process management (DP=1) (#17684)

2026-03-05 13:21:23 -08:00

EngineBase.py

[PD-Disagg] Fully support external DP dispatch w/ PD-disaggregation mode. (#19268)

2026-02-24 19:58:01 -08:00

grpc_server.py

feat(grpc): add SubscribeKvEvents RPC for KV cache event streaming (#20112)

2026-03-08 16:00:29 -07:00

harmony_utils.py

Fix condition for streaming output_ids in tokenizer manager (#13759)

2025-11-29 13:56:15 -08:00

http_server_engine.py

Add SSL/TLS support for HTTP and gRPC servers (#18973)

2026-03-04 19:27:16 -08:00

http_server.py

Add Ray actor support for scheduler process management (DP=1) (#17684)

2026-03-05 13:21:23 -08:00

ssl_utils.py

Add SSL/TLS support for HTTP and gRPC servers (#18973)

2026-03-04 19:27:16 -08:00

tool.py

bugfix for undefined logging functions in HarmonyBrowserTool & HarmonyPythonTool (#9229)

2025-08-25 00:10:35 -07:00

v1_loads.py

[API] Add /v1/loads endpoint for load metrics (#16976)

2026-01-14 09:13:20 -08:00

warmup.py

Clean up imports and move files (#14317)

2025-12-02 16:31:54 -08:00