|
d1e95af282
|
Upgrade transformers==5.3.0 (#17784)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
Co-authored-by: Alison Shao <alisonshao@mac.lan>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-03-18 13:50:43 -07:00 |
|
|
danielafrimi
|
33c33a7de9
|
[Quantization] Support config.json quantization_config format, fix exclude_modules matching, and fix KV cache scale loading for Nemotron (#18546)
Signed-off-by: root <dafrimi@nvidia.com>
|
2026-02-21 16:14:29 +08:00 |
|
|
SoluMilken
|
07a24f1a38
|
update pre-commit config (#18860)
|
2026-02-16 00:18:31 +08:00 |
|
|
|
008ea46af1
|
[Auto Sync] Update loader.py, weight_utils.py (20260213) (#18779)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Xiuyu Li <xiuyu@x.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-02-13 12:22:50 -08:00 |
|
|
Lianmin Zheng
|
d5f66fec15
|
Revert changes to weight_utils.py (#18759)
|
2026-02-12 17:15:16 -08:00 |
|
|
|
9815ee934c
|
[Auto Sync] Update weight_utils.py (20260212) (#18692)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Dan Zheng <dzheng@x.ai>
|
2026-02-12 16:26:05 -08:00 |
|
|
Zhiyu
|
7e262b6496
|
Update modelopt quantization config parsing (#13919)
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
|
2026-02-12 11:08:29 +08:00 |
|
|
Mohammad Miadh Angkad
|
6f6b9c6e42
|
[Perf] Use safetensors load_file in multithread loader (#18124)
|
2026-02-02 23:21:13 -08:00 |
|
|
|
336dc4579e
|
[CPU] Optimize Qwen3-next model on CPU (#12525)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: Fan Yin <1106310035@qq.com>
|
2026-01-29 22:03:58 -08:00 |
|
|
Ziang Li
|
3c9cc44ff5
|
Add mxfp8 support for online quantization, Triton dense linear, and CUTLASS MoE (#17449)
|
2026-01-29 21:33:57 +08:00 |
|
|
b8zhong
|
2ff0880a0e
|
[Fix] GLM 4.7 + NVFP4 + MTP (#17166)
|
2026-01-21 21:34:18 +08:00 |
|
|
|
5af84c8af5
|
[AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392)
Co-authored-by: Dehua Tang <dehtang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: YC Tseng <yctseng@amd.com>
|
2026-01-14 01:44:40 -08:00 |
|
|
Alison Shao
|
63cc97f4ef
|
ci: migrate 2-GPU tests to test/registered/ (#16529)
|
2026-01-07 20:28:16 -08:00 |
|
|
Kangyan-Zhou
|
fc643ffbc9
|
Download missing shards in model weights files when not in CI (#16211)
|
2025-12-31 20:42:34 +08:00 |
|
|
Lianmin Zheng
|
e6d5a213ad
|
Fix metrics (#15998)
|
2025-12-28 05:03:49 -08:00 |
|
|
Alison ShaoandKangyan-Zhou
|
0e536600e8
|
Refactor: separate CI-specific weight validation into dedicated module (#15216)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2025-12-27 20:50:39 -08:00 |
|
|
Teng MaandXuchun Shang
|
d7301c89ba
|
[Feature] support fastsafetensors (#15091)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Xuchun Shang <xuchun.shang@gmail.com>
|
2025-12-23 22:33:56 +08:00 |
|
|
Alison Shao
|
f85460fb19
|
Avoid deleting entire cache for missing shards (#14754 follow-up) (#14853)
|
2025-12-11 01:17:04 -08:00 |
|
|
Alison Shao
|
b6523a4f72
|
fix: restrict cache validation behaviors to CI only (#14849)
|
2025-12-10 16:03:53 -08:00 |
|
|
Alison Shao
|
01835998e1
|
fix: race condition between validation and download locks (#14761)
|
2025-12-09 20:36:54 -08:00 |
|
|
Alison Shao
|
b988c18eae
|
Fix safetensors validation to catch corruption after download (#14465)
|
2025-12-05 16:04:00 -08:00 |
|
|
Alison Shao
|
662809874c
|
Add Mistral Large 3 to nightly CI tests (#14459)
|
2025-12-05 23:16:27 +08:00 |
|
|
Xinyuan TongandYueming Yuan
|
6d37e70883
|
ministral3 (#14251)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Yueming Yuan <yy28@illinois.edu>
|
2025-12-04 14:31:26 -08:00 |
|
|
alisonshao
|
25a6be4930
|
Fix duplicate download log messages in multi-process environment (#14299)
|
2025-12-02 09:33:18 -08:00 |
|
|
alisonshao
|
a223402ffb
|
Add adapter_model.safetensors to corruption validation for LoRA (#14022)
|
2025-11-26 14:52:46 -08:00 |
|
|
alisonshao
|
94ae816f29
|
Fix model weights validation with automatic cache cleanup (#13729)
|
2025-11-22 11:40:00 +08:00 |
|
|
Binyao Jiang
|
90c18a16cb
|
[GLM4.6v] Required changes for bumping up to transformer 5.x (#13229)
|
2025-11-18 10:58:00 +08:00 |
|
|
b8zhong
|
77225d602a
|
Use Flashinfer TRT-LLM as Llama 4 compatible MoE backend (#11928)
|
2025-10-28 10:39:43 -07:00 |
|
|
Netanel Haber
|
a98496834b
|
Feature/nano v2 offline modelopt fp8 and nvfp4 (#12018)
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
|
2025-10-23 11:16:46 -07:00 |
|
|
Liangsheng Yin
|
6c18addb6f
|
Revert "Support nvidia/NVIDIA-Nemotron-Nano-9B-v2-FP8/NVFP4" (#12015)
|
2025-10-23 21:27:58 +08:00 |
|
|
Netanel Haber
|
d6fee73d1f
|
Support nvidia/NVIDIA-Nemotron-Nano-9B-v2-FP8/NVFP4 (#11866)
|
2025-10-23 17:29:02 +08:00 |
|
|
Liangsheng YinandXiaoyu Zhang
|
9d61205dac
|
[lint] improve ruff check (#11922)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2025-10-22 11:32:50 +08:00 |
|
|
Lianmin Zheng
|
cd7e1bd591
|
Sync code and test CI; rename some env vars (#11686)
|
2025-10-15 18:37:03 -07:00 |
|
|
Zhiyu
|
155cbb51f0
|
Enable native ModelOpt quantization support (1/3) (#7149)
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
|
2025-10-06 13:24:15 -07:00 |
|
|
Mick
|
97d966a7f8
|
ci: make find_local_hf_snapshot_dir more robust (#11248)
|
2025-10-05 19:50:11 -07:00 |
|
|
Lianmin Zhengandsglang-bot
|
a17e70f5cc
|
Use more general heuristics to set the default value of --mem-fraction-static (#10975)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
|
2025-09-29 10:11:03 -07:00 |
|
|
Mick
|
43fa9f22bd
|
fix: check if weights are already local before downloading (#11015)
|
2025-09-28 20:11:33 -07:00 |
|
|
|
30c6e1f569
|
Qwen3-Next support (#10233)
Co-authored-by: cao1zhg <114661107+cao1zhg@users.noreply.github.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>
Co-authored-by: qingquansong <ustcsqq@gmail.com>
Co-authored-by: Yaoyao Ding <dingyaoyao.cs@gmail.com>
Co-authored-by: Ke Bao <ISPObaoke@163.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
|
2025-09-11 04:11:49 -07:00 |
|
|
|
d4bf5a8524
|
Support OCP MXFP4 quantization on AMD GPUs (#8255)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
|
2025-08-04 18:14:52 -07:00 |
|
|
Even Zhouandronnie_zheng
|
99795d61e6
|
[Bugfix] fix w8a8_int8 load issue (#8308)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2025-07-31 17:30:16 -07:00 |
|
|
Chunyuan WU
|
1dce6c480f
|
[CPU] support the case where num_attention_heads or intermediate_size is not divisible by the TP size (#6771)
|
2025-07-03 09:51:38 -07:00 |
|
|
Simon_CQK
|
a7efbb2757
|
fix(model loader): use safe_open to prevent file handle leaks. (#7684)
|
2025-07-01 13:18:35 -07:00 |
|
|
|
886d344964
|
support llama4 eagle3 (#6985)
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
Co-authored-by: Shenggui Li <somerlee.9@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2025-06-30 22:34:10 -07:00 |
|
|
xianzhiT
|
9f1787fa60
|
Support multi-thread model weight loading (#7277)
|
2025-06-24 10:39:10 -07:00 |
|
|
Yuhong Guo
|
e5afb88b1c
|
Support weight loading without mmap (#7469)
|
2025-06-23 15:13:59 -07:00 |
|
|
Charles Chen
|
8c16da334e
|
Fix Deepseek R1 0528 FP4 tensor name mismatch issue during weights loading. (#7164)
|
2025-06-17 11:26:23 -07:00 |
|
|
|
4065248214
|
Support Llama4 fp8 inference (#5194)
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-04-09 20:14:34 +08:00 |
|
|
DangKaianddangkai.dk
|
cc88d98ab8
|
fix empty_cache error in pt_weights_iterator (#5151)
Co-authored-by: dangkai.dk <dangkai.dk@alibaba-inc.com>
|
2025-04-08 01:22:10 -07:00 |
|
|
Brayden Zhong
|
e84f4ba0ab
|
[Misc] Fix issues reported by torchfix (#4837)
|
2025-03-27 20:10:32 -07:00 |
|
|
Juwan Yoo
|
188105a21b
|
deps: lazy import optional dependencies gguf and torchvision (#4826)
|
2025-03-27 14:35:36 -07:00 |
|