ros/LlamaFactory
1
0
Fork 0
mirror of https://github.com/hiyouga/LlamaFactory.git synced 2026-02-03 08:53:38 +00:00
Code Issues Packages Projects Releases Wiki Activity

optimize predict vram

Browse Source 
Former-commit-id: a577e44eee351b3ed8011a33ae01cd713354ff97
This commit is contained in:
hiyouga
2024-08-30 23:08:45 +08:00
parent 66a1abac6a
commit d789b667d7
5 changed files with 10 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
src/llamafactory/train/sft/metric.py
View File

@@ -54,7 +54,7 @@ def eval_logit_processor(logits: "torch.Tensor", labels: "torch.Tensor") -> "tor
if logits.dim() != 3:
raise ValueError("Cannot process the logits.")
return torch.argmax(logits, dim=-1)
return torch.argmax(logits, dim=-1).cpu()
@dataclass