ros/LlamaFactory
1
0
Fork 0
mirror of https://github.com/hiyouga/LlamaFactory.git synced 2026-02-01 20:23:37 +00:00
Code Issues Packages Projects Releases Wiki Activity

[data] fix qwen2.5 omni plugin (#7573)

Browse Source 
* align key with qwen2vl

* nit && change scripts
This commit is contained in:
Kingsley
2025-04-02 21:28:52 +08:00
committed by GitHub
parent 7b9deb9410
commit d32c6c014d
4 changed files with 47 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
src/llamafactory/data/collator.py
View File

@@ -203,7 +203,6 @@ class MultiModalDataCollatorForSeq2Seq(DataCollatorForSeq2Seq):
delta0 = (1 - rope_index_kwargs["attention_mask"]).sum(dim=-1).unsqueeze(1)
# avoid conflict
rope_index_kwargs["second_per_grids"] = mm_inputs.get("video_second_per_grid", None)
new_position_ids, rope_deltas = self.model.get_rope_index(**rope_index_kwargs)
features["position_ids"], features["rope_deltas"] = (
new_position_ids.clone(),