Commit Graph
15 Commits
Author SHA1 Message Date
Johnsonms 7cf0551014 Migrate norm kernels to FlashInfer JIT implementation (#18871) 2026-03-10 14:56:07 +08:00
Johnsonms 2d266c73ea Migrate renorm kernels from sgl-kernel to FlashInfer JIT (#18854) 2026-03-06 22:53:28 +08:00
Johnsonmsandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> bc79a64d3a [Diff]: support SGLANG_TORCH_PROFILER_DIR environment variable for profiler log directory (#18454)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-16 12:47:29 +08:00
Johnsonms 34132d6da5 Kernel: optimize decoding metadata in NSA multi-spec backend with fused kernels (#17554) 2026-02-14 16:40:15 +08:00
Johnsonms e0026f7c92 [Performance] optimize NSA backend metadata computation for multi-step speculative decoding (#14781) 2025-12-18 13:48:27 -08:00
JohnsonmsandJohnsonms 043f13171f [Performance] Optimize NSA Indexer K/S Buffer Access with Fused Triton Kernels (#13812)
Co-authored-by: Johnsonms <johnson@together.ai>
2025-12-02 18:53:06 -08:00
Johnsonms 6448b4cd2c Fix NSA indexer nightly test failed issues (#13298) 2025-11-14 13:14:57 -08:00
Johnsonms 63728b1154 [Bug] Login shell error: bash: /root/.cargo/env: No such file or directory (#12941) 2025-11-12 00:52:02 +08:00
Johnsonms e3b38d7194 [Bug] TypeError: maybe_executor_submit() (#13050) 2025-11-11 00:55:13 -08:00
Johnsonms 125f76ea44 [Test] Add DeepSeekV3.2 NSA Indexer Test Suite (#12520) 2025-11-06 21:28:43 -08:00
Johnsonms 1cfbbc42d8 [Bug] Fix NSA Backend KV-Buffer Shape Mismatch in DeepSeek-V3.2 (#12645) 2025-11-04 13:57:32 -08:00
Johnsonms 9434a0e50f [Refact] Remove hardcoded KV cache dimension in MLATokenToKVPool (#12502) 2025-11-02 19:49:53 -08:00
Johnsonms 6f858930c8 [Bug] test_flashattn_mla_backend errors in Hopper #12487 (#12488) 2025-11-01 18:28:06 -07:00
Johnsonms 662725b936 [DeepSeekV32] Bug fix to ensure page_table and result in same type (#12300) 2025-10-30 18:56:51 -07:00
Johnsonms b72f9f08c1 [Test] Add dsv3.2 nsa backend testing (#11936) 2025-10-25 17:07:37 -07:00