 Scott Lee
|
c59b9223e6
|
Add spec_accept_histogram request statistic (#18332)
|
2026-02-12 21:09:21 +08:00 |
|
|
Scott Lee
|
169a75dfb8
|
Add request-level timestamp for when prefill finishes (#14860)
|
2025-12-17 13:34:46 -08:00 |
|
|
Scott Lee
|
c94564912e
|
Add RequestMetricsExporter utility to export request-level metrics (#10973)
|
2025-11-12 16:33:37 -08:00 |
|
|
Scott Lee
|
bf8f7a944f
|
Add per-request retraction count (#11177)
|
2025-10-27 23:22:34 -07:00 |
|
|
Scott Lee
|
817e46f412
|
Refactor spec decoding metrics calculation into separate TokenizerManager utility function (#11586)
|
2025-10-14 20:45:49 +08:00 |
|
|
Scott Lee
|
b6fb5d7666
|
Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441)
|
2025-10-13 11:24:27 -07:00 |
|
|
Scott Lee
|
55b14656e6
|
Revert "Add metrics for speculative decoding (acceptance rate, average acceptance length)" (#11433)
|
2025-10-10 12:54:57 -07:00 |
|
|
Scott Lee
|
0babd48736
|
Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11144)
|
2025-10-10 00:46:44 -07:00 |
|