|
d4e68ead1d
|
[quant] Ignore FP8 quantization layers (#20340)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-03-13 13:59:39 +08:00 |
|
|
StonyPortandqiuxuan.lzw
|
806d41ab65
|
[quant] fix fp32 downcasting (#19844)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
|
2026-03-05 17:54:59 +08:00 |
|
|
StonyPortandqiuxuan.lzw
|
2b3408ff14
|
feat: add forward timeout (#17831)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
|
2026-01-30 08:52:29 +08:00 |
|
|
|
3355b6e21b
|
feat: add request queued timeout (#17143)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-01-16 17:55:09 +08:00 |
|
|
|
b6702d72cf
|
feat: log request when e2e latency exceeds the specified value (#15759)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2025-12-25 23:12:35 +08:00 |
|
|
StonyPortandqiuxuan.lzw
|
540d6fee20
|
Support piecewise CUDA graph for embedding models (#13852)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
|
2025-11-26 15:29:46 +08:00 |
|
|
StonyPortandqiuxuan.lzw
|
1dd9a6ae4d
|
Fix TorchAO quant in VLM (#13508)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
|
2025-11-24 22:15:40 +08:00 |
|
|
|
48ca9f7518
|
feat: support external custom models (#13429)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-20 11:16:58 +08:00 |
|
|
StonyPortandqiuxuan.lzw
|
fd389df96e
|
Reduce the image processing latency in VLM (#11541)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
|
2025-10-16 15:00:03 -07:00 |
|