Commit Graph
14 Commits
Author SHA1 Message Date
Serge Panev 466ff20e51 [Model] Fix NemotronH OOM on unified-mem systems: stream weights + safetensors cleanup (#20580)
Signed-off-by: Serge Panev <spanev@nvidia.com>
2026-03-17 09:47:58 -07:00
Vedant V Jhaveri 25bd83033d Enable Piecewise CUDA Graph for NemotronH Hybrid (Mamba+Attention) Models (#19903) 2026-03-12 09:16:38 +08:00
danielafrimi 33c33a7de9 [Quantization] Support config.json quantization_config format, fix exclude_modules matching, and fix KV cache scale loading for Nemotron (#18546)
Signed-off-by: root <dafrimi@nvidia.com>
2026-02-21 16:14:29 +08:00
danielafrimi 0ff24159a5 Fix modelopt FP8 create weights (#18447)
Signed-off-by: root <dafrimi@nvidia.com>
2026-02-17 00:59:50 +08:00
roikoren755 72bacc88c8 [NemotronH] Use ReplicatedLinear for fc1_latent_proj (#16569)
Signed-off-by: Roi Koren <roik@nvidia.com>
2026-01-14 17:08:27 +08:00
shaharmor98 ba625c2d90 Feat/support nemotron h mtp (#17013)
Signed-off-by: Shahar Mor <smor@nvidia.com>
2026-01-14 16:30:35 +08:00
roikoren755 b021332339 [NemotronH] Add latent MoE support (#16227)
Signed-off-by: Roi Koren <roik@nvidia.com>
2026-01-02 22:08:58 +08:00
roikoren755 47a660d5b9 [NemotronH] PP support (#16172)
Signed-off-by: Roi Koren <roik@nvidia.com>
2025-12-31 11:16:15 +08:00
Netanel Haber 082b54c689 Support nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 (and nvidia/C-RADIOv2-H) (#12277) 2025-11-26 16:28:52 -07:00
roikoren755 1b48e1b974 Feat/nemotron nano v3 support (#12690) 2025-11-21 13:53:05 -08:00
Netanel Haber a98496834b Feature/nano v2 offline modelopt fp8 and nvfp4 (#12018)
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
2025-10-23 11:16:46 -07:00
Liangsheng Yin 6c18addb6f Revert "Support nvidia/NVIDIA-Nemotron-Nano-9B-v2-FP8/NVFP4" (#12015) 2025-10-23 21:27:58 +08:00
Netanel Haber d6fee73d1f Support nvidia/NVIDIA-Nemotron-Nano-9B-v2-FP8/NVFP4 (#11866) 2025-10-23 17:29:02 +08:00
Netanel Haber d6837aea4d model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909)
Signed-off-by: Netanel Haber <nhaber@nvidia.com>
2025-10-09 00:37:38 +08:00