Mohammad Miadh Angkad 6822941514 [FlashInfer] Bump FlashInfer version from 0.6.3 to 0.6.4 (#19005)

2026-03-02 16:12:09 -08:00

..

anthropic

[Anthropic API] Preserve image content in tool_result conversion (#19233)

2026-02-28 12:07:22 -08:00

ollama

Add Ollama-compatible API endpoints + Smart Router (#14376)

2025-12-16 20:43:38 -08:00

openai

[Bugfix] Fix KeyError: 'prompt_tokens' when streaming requests are aborted (#19514)

2026-02-28 20:21:35 -08:00

context.py

Fix condition for streaming output_ids in tokenizer manager (#13759)

2025-11-29 13:56:15 -08:00

engine.py

[FlashInfer] Bump FlashInfer version from 0.6.3 to 0.6.4 (#19005)

2026-03-02 16:12:09 -08:00

EngineBase.py

[PD-Disagg] Fully support external DP dispatch w/ PD-disaggregation mode. (#19268)

2026-02-24 19:58:01 -08:00

grpc_server.py

feat(grpc): add multimodal TensorData parsing for vision inference (#19535)

2026-02-27 19:29:43 -08:00

harmony_utils.py

Fix condition for streaming output_ids in tokenizer manager (#13759)

2025-11-29 13:56:15 -08:00

http_server_engine.py

Expose priority parameter in Engine.generate() and Engine.async_generate() (#18944)

2026-02-17 19:14:22 -08:00

http_server.py

feat: TTL-based prefix pinning with refresh-on-hit for HiRadixCache (#18941)

2026-03-01 23:27:22 -08:00

tool.py

bugfix for undefined logging functions in HarmonyBrowserTool & HarmonyPythonTool (#9229)

2025-08-25 00:10:35 -07:00

v1_loads.py

[API] Add /v1/loads endpoint for load metrics (#16976)

2026-01-14 09:13:20 -08:00

warmup.py

Clean up imports and move files (#14317)

2025-12-02 16:31:54 -08:00