mlmz bac414ab53 [Feature] integrate Structural Tag in xgrammar backend for function calling (#3566) ...

Co-authored-by: shuaills <shishuaiuoe@gmail.com>

2025-02-27 23:33:41 -08:00

..

cache_controller.py

Hierarchical Caching for SGLang (#2693)

2025-02-23 21:56:30 -08:00

configure_logging.py

Fix the request loggings to make it fully able to be easily replayed (#2973)

2025-01-18 21:45:00 -08:00

data_parallel_controller.py

[Feature] Support minicpmv v2.6 (#2785)

2025-01-18 14:14:19 -08:00

detokenizer_manager.py

Improve: Use TypeBasedDispatcher in DetokenizerManager (#3117)

2025-02-21 19:50:46 -08:00

image_processor.py

Revert "Rename TokenizerManager to StdOrchestrator" (#3828)

2025-02-24 14:47:59 -08:00

io_struct.py

[feat] Add Vertex AI compatible prediction route for /generate (#3866)

2025-02-27 19:42:15 -08:00

schedule_batch.py

Add return hidden state in the native API (#3897)

2025-02-26 22:06:54 -08:00

schedule_policy.py

Query remaining memory dynamically for PrefillAdder (#2941)

2025-01-17 20:20:26 -08:00

scheduler.py

[Feature] integrate Structural Tag in xgrammar backend for function calling (#3566)

2025-02-27 23:33:41 -08:00

session_controller.py

[Feature] Add sampler custom logits processor (#2396)

2025-01-19 14:46:53 -08:00

tokenizer_manager.py

Fix CI and install docs (#3821)

2025-02-24 16:17:38 -08:00

tp_worker_overlap_thread.py

[Feat] Return hidden states (experimental) (#3364)

2025-02-10 15:54:37 -08:00

tp_worker.py

fix missing revision arg when loading tokenizer (#2982)

2025-01-19 11:36:07 -08:00

utils.py

Frontend: better error message handling for FINISH_ABORT in scheduler.py (#2956)

2025-01-18 19:37:30 -08:00