ros/LLaMA-Factory
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

tiny fix

Browse Source 
Former-commit-id: f7f440986b0ae3b38ea9f2da80789629d4f79ea1
This commit is contained in:
hiyouga
2024-06-16 01:06:41 +08:00
parent 14f7bfc545
commit 05f3a3c944
22 changed files with 27 additions and 25 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
src/llamafactory/model/model_utils/longlora.py
View File

@@ -1,7 +1,9 @@
# Copyright 2024 EleutherAI, HuggingFace Inc., and the LlamaFactory team.
# Copyright 2024 EleutherAI, HuggingFace Inc., Yukang Chen, and the LlamaFactory team.
#
# This code is based on the EleutherAI's GPT-NeoX and HuggingFace's Transformers libraries.
# This code is based on the EleutherAI's GPT-NeoX and the HuggingFace's Transformers libraries.
# https://github.com/huggingface/transformers/blob/v4.40.0/src/transformers/models/llama/modeling_llama.py
# This code is also inspired by the original LongLoRA implementation.
# https://github.com/dvlab-research/LongLoRA/blob/main/llama_attn_replace.py
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.