魅影
14abb75126
[model] enable using FA in npu ( #9397 )
...
Co-authored-by: frozenleaves <frozen@Mac.local >
2025-11-04 19:32:30 +08:00
한송민
5a9939050e
[model] add deepstack_merger_list to Qwen3-VL vision_model_keys ( #9399 )
2025-11-04 19:27:34 +08:00
Peilin Li
934b3084ee
[train] KTransformers SFT as backend engine for LLaMA-Factory ( #9400 )
...
Co-authored-by: jimmy128 <jimmy128@noreply.gitcode.com >
Co-authored-by: Yaowei Zheng <hiyouga@buaa.edu.cn >
2025-11-04 15:54:12 +08:00
魅影
767b344fb4
[model] remove npu sdpa patch ( #9368 )
...
Co-authored-by: frozenleaves <frozen@Mac.local >
2025-10-30 16:26:35 +08:00
Yaowei Zheng
d9d67ba62d
[misc] fix import error ( #9299 )
2025-10-17 17:46:27 +08:00
Yaowei Zheng
a442fa90ad
[misc] fix import error ( #9296 )
2025-10-17 10:54:30 +08:00
Ximing Xing
c867e28093
[model] adds semantic initialization support for special tokens ( #9267 )
...
Co-authored-by: ximingxing <ximingxing@tencent.com >
2025-10-14 17:00:48 +08:00
Jiayi Mao
48974783da
[model]: add ernie4_5_moe support for DeepSpeed Zero3 training ( #9262 )
2025-10-13 13:13:31 +08:00
Yaowei Zheng
40d3691e9e
[misc] fix moe models ( #9230 )
2025-10-05 02:41:02 +08:00
h7878778h
09dedf144f
[npu] Redirect SDPA to torch_npu.npu_fusion_attention (opt-in, ZeRO-3 safe, no impact off NPU) ( #8972 )
2025-09-30 18:11:31 +08:00
Yaowei Zheng
6ffebe5ff7
[data] fix qwen omni plugin ( #9204 )
...
Co-authored-by: kingsley <kingsleydodonow@gmail.com >
2025-09-28 01:02:29 +08:00
xvxuopop
0761a4448f
[model] add qwen3-vl/qwen3-omni ( #9196 )
...
Co-authored-by: kingsley <kingsleydodonow@gmail.com >
2025-09-27 01:21:47 +08:00
Yaowei Zheng
80fe3a172d
[model] add dots ocr ( #9176 )
2025-09-21 23:34:19 +08:00
Yaowei Zheng
db223e3975
[misc] update readme ( #9071 )
2025-09-03 17:22:54 +08:00
Kingsley
185f0556d4
[model] support Internvl3_5 ( #9028 )
2025-08-28 17:12:00 +08:00
Kingsley
9c433f6b41
[model] fix kimivl ( #9018 )
2025-08-25 16:32:23 +08:00
Haian Huang(深度眸)
1664657d80
[model] Support Intern-S1-mini ( #8976 )
2025-08-20 23:52:51 +08:00
Kingsley
022a326ca4
[misc] update glm4v ligerkernel ( #8978 )
2025-08-20 23:39:56 +08:00
Kingsley
893edb26d0
[model] support GLM4.5V ( #8876 )
2025-08-11 21:45:14 +08:00
Yaowei Zheng
b523543994
[data] fix template ( #8827 )
2025-08-06 06:58:09 +08:00
davidlightmysterion
c709c0378d
[train] fix adjusting logits size after adding special tokens ( #8823 )
2025-08-05 20:35:07 +08:00
Kingsley
52882d01c3
[model] support keye-vl-8b ( #8776 )
2025-07-29 21:24:08 +08:00
Kingsley
d6767f355a
[model] add glm4moe ( #8689 )
2025-07-25 19:53:45 +08:00
Vivek Iyer
e0dfdb7dbb
Revert "[model] add lora dropout to unsloth" - requested feature already exists ( #8554 )
...
Co-authored-by: viyer <vivek_iyer2@apple.com >
2025-07-05 11:25:31 +08:00
Vivek Iyer
0686206020
[model] add lora dropout to unsloth ( #8548 )
...
Co-authored-by: viyer <vivek_iyer2@apple.com >
2025-07-04 14:56:36 +08:00
Kingsley
e9f70daabe
[model] add gemma3n ( #8509 )
2025-07-01 22:37:24 +08:00
Kingsley
d17a672251
[model] add GLM-4.1V ( #8462 )
2025-06-30 01:09:41 +08:00
Yaowei Zheng
2c26ce6ac4
Merge commit from fork
2025-06-26 13:55:42 +08:00
Yaowei Zheng
9af7915f7b
[model] add kimi vl 2506 ( #8432 )
2025-06-23 17:56:48 +08:00
Vivek Iyer
7b252b2368
[model] unsloth resume from checkpoint bug ( #8423 )
...
Co-authored-by: viyer <vivek_iyer2@apple.com >
2025-06-23 16:43:54 +08:00
Yaowei Zheng
ca75f1edf3
[model] fix vlm utils ( #8388 )
2025-06-17 01:08:49 +08:00
Yaowei Zheng
3a3bae1cfe
[data] fix qwen2vl pos ids ( #8387 )
2025-06-17 00:48:54 +08:00
Yaowei Zheng
31874e4f62
[version] release v0.9.3 ( #8386 )
2025-06-16 19:21:32 +08:00
Kingsley
31bca4d172
[model] support Mistral3.1 small 2503 ( #8335 )
2025-06-09 10:37:42 +08:00
Vivek Iyer
32b4574094
[model] pushing FFT with unsloth ( #8325 )
...
Co-authored-by: viyer <vivek_iyer2@apple.com >
2025-06-07 08:20:58 +08:00
hoshi-hiyouga
9ae17cd173
[deps] update to transformers 4.52 ( #8125 )
2025-05-21 05:16:18 +08:00
hoshi-hiyouga
45030ff803
[model] switch to gptqmodel ( #8108 )
2025-05-19 22:25:40 +08:00
piamo
bc7f00f2c7
[model] update rope kwargs for yarn ( #8101 )
2025-05-19 20:07:54 +08:00
hoshi-hiyouga
994ab6424a
[misc] update liger kernel patch ( #7966 )
2025-05-06 20:32:16 +02:00
hoshi-hiyouga
3ae5da2a04
[model] fix dsv3 leaf node ( #7879 )
2025-04-28 18:11:09 +08:00
Kingsley
1157f4e246
fix attn patch for kimivl ( #7867 )
2025-04-27 23:12:28 +08:00
hoshi-hiyouga
2233b739fa
[model] fix vit gradient checkpointing ( #7830 )
2025-04-23 22:48:48 +08:00
hoshi-hiyouga
c1a7f2ebb2
[model] fix moe zero3 ( #7826 )
2025-04-23 15:30:49 +08:00
hoshi-hiyouga
b07628dea5
[example] add bash usage ( #7794 )
2025-04-22 00:25:51 +08:00
ddddng
c5ba9106ec
[model] fix gemma3 export ( #7786 )
...
Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn >
2025-04-21 23:07:11 +08:00
hoshi-hiyouga
39169986ef
[trainer] fix pt loss ( #7748 )
...
* fix pt loss
* robust
* fix
* test
2025-04-17 03:15:35 +08:00
hoshi-hiyouga
86ebb219d6
[breaking] bump transformers to 4.45.0 & improve ci ( #7746 )
...
* update ci
* fix
* fix
* fix
* fix
* fix
2025-04-17 02:36:48 +08:00
Kingsley
2e518f255f
[model] support intern-VL 2.5-3 series ( #7258 )
...
* add internvl and rebase
* fix for internvl2&3
* remove lines
* fix video_inputs & lint
* nit
* add constants
* remove lines
* fix
* fix error
* pass ci
* pass ci
* skip internvl & nit
2025-04-17 00:31:30 +08:00
Kingsley
2101399c94
[model] Support Kimi_VL thinking/instruct ( #7719 )
...
* add kimi_vl
* patch config
* check version
* Update mm_plugin.py
* Update mm_plugin.py
---------
Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn >
2025-04-15 00:21:58 +08:00
Dain Kim
1c436c9f25
[bugfix] enable_gemma_liger_kernel ( #7660 )
...
- The `enable_liger_kernel` function for the Gemma model series was not executed due to the existing `if` statement in the code.
- Changed the line to an `elif` statement so that the `apply_liger_kernel` function is executed properly.
resolved : #7628
2025-04-10 11:27:30 +08:00
