fix ppo in trl 0.8.6

Former-commit-id: 5e0d66a0d80b4bd4a8506e2317209d8fb9d25ff6
This commit is contained in:
hiyouga
2024-06-07 04:48:29 +08:00
parent d0edcde4ea
commit 8692796c9b
4 changed files with 37 additions and 25 deletions

View File

@@ -298,7 +298,7 @@ huggingface-cli login
| datasets | 2.16.0 | 2.19.2 |
| accelerate | 0.30.1 | 0.30.1 |
| peft | 0.11.1 | 0.11.1 |
| trl | 0.8.6 | 0.9.3 |
| trl | 0.8.6 | 0.9.4 |
| Optional | Minimum | Recommend |
| ------------ | ------- | --------- |