hoshi-hiyouga
|
86ebb219d6
|
[breaking] bump transformers to 4.45.0 & improve ci (#7746)
* update ci
* fix
* fix
* fix
* fix
* fix
|
2025-04-17 02:36:48 +08:00 |
|
Qiaolin Yu
|
a44a53ebec
|
[inference] support sglang backend (#7278)
* Mimic SGLang offline Engine
* Add more tests and args
* Pass all current tests
* Clean Code
* fix sample_params
* clean code
* Fix Stream Chat
* change sglang from engine mode to server mode
* fix
* Fix Review Issues
* Use SGLang Built-In Utilities
* Fix test SGLang
* Some Doc Issue
* fix sglang engine
* add readme
---------
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
|
2025-03-15 04:37:58 +08:00 |
|
hoshi-hiyouga
|
650a9a9057
|
[misc] update format (#7277)
|
2025-03-13 02:53:08 +08:00 |
|
hoshi-hiyouga
|
264538cb26
|
[misc] upgrade format to py39 (#7256)
|
2025-03-12 00:08:41 +08:00 |
|
hoshi-hiyouga
|
71a1c1321a
|
[config] update args (#7231)
Former-commit-id: f71a901840811bf560df671ec63a146ff99140c6
|
2025-03-10 23:04:43 +08:00 |
|
hoshi-hiyouga
|
2635794727
|
[webui] support escape html (#7190)
Former-commit-id: cf9840374f171359c828b0d6f7a2aa9893c8f701
|
2025-03-06 16:52:21 +08:00 |
|
hoshi-hiyouga
|
585c475f71
|
[inference] fix hf_engine (#7120)
Former-commit-id: f8cf5319cb5d6e06a1b0d8b8db2b678627f2271e
|
2025-03-01 05:22:49 +08:00 |
|
Zhangchi Feng
|
8f401e37f8
|
[model] support audio (#6701)
* support qwen2_audio
* improve code
* lint
* fix
* fix
* fix
---------
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
Former-commit-id: 5eacb5629e4d7733cd992a63747a1335f2c6a929
|
2025-02-05 04:59:09 +08:00 |
|
hoshi-hiyouga
|
c2022431aa
|
[misc] update license year & fix llama pro (#6814)
* fix llamapro script
* change year
Former-commit-id: d9ae594178796994d400a5f207d6499712816f89
|
2025-02-05 01:53:33 +08:00 |
|
hoshi-hiyouga
|
a28261a866
|
[model] add mistral small models (#6786)
Former-commit-id: e5e95c39bc4199fa89c67e34f9adaaa987058744
|
2025-02-01 04:31:38 +08:00 |
|
hoshi-hiyouga
|
800de98dc8
|
[model] add qwen2.5 vl models (#6779)
Former-commit-id: ed46fb4f6194c30060b908092464dded12e5787c
|
2025-01-31 03:00:29 +08:00 |
|
hoshi-hiyouga
|
41a9e231cb
|
lint (#6641)
Former-commit-id: 79731ae13ecd17eb8646fb53162c81dddfef3b00
|
2025-01-14 18:40:07 +08:00 |
|
Zhangchi Feng
|
f7857c83e1
|
Support Inference of MiniCPM-V-2.6 and MiniCPM-o-2.6 (#6631)
* fix template name
* tiny fix
* support minicpm-o-2.6
* support inference of minicpmv
Former-commit-id: 7f3c64e853a7cdd49d02bf85e237611941ac7fa8
|
2025-01-14 17:34:58 +08:00 |
|
hoshi-hiyouga
|
2a05941b14
|
[inference] fix stop token for object detection (#6624)
* fix stop token
* update minicpm data pipeline
* fix npu qlora examples
Former-commit-id: 844919fadaa8a61dfae47020971ea80730b2346f
|
2025-01-13 21:34:20 +08:00 |
|
hiyouga
|
647c51a772
|
imporve log
Former-commit-id: a6abf375975ffea3d51e1b944c9855b5f62ffac8
|
2025-01-08 09:56:10 +00:00 |
|
hiyouga
|
f8f05a883b
|
fix #6482
Former-commit-id: 8577f52b4152efe6cc7a8b5f6d37b4f9ba6684e7
|
2024-12-30 06:03:07 +00:00 |
|
hiyouga
|
a897d46049
|
support report custom args
Former-commit-id: d41254c40a1c5cacf9377096adb27efa9bdb79ea
|
2024-12-21 21:42:45 +00:00 |
|
hiyouga
|
adff887659
|
fix paligemma infer
Former-commit-id: d272455d6118c1d670c70cfe3458d8dab111da6c
|
2024-12-21 20:24:32 +00:00 |
|
hiyouga
|
19ebc0e7a2
|
support control eos, fix #6345
Former-commit-id: cb0f8399356bf372f3b7963f2565c3d504be0923
|
2024-12-17 10:42:05 +00:00 |
|
hiyouga
|
5003820a6a
|
fix inputs
Former-commit-id: 7d535bb8cdf7e81edda81152e63c8cfe6c9dcc9f
|
2024-11-23 18:26:02 +00:00 |
|
hiyouga
|
87d6d7dc61
|
fix chat engines
Former-commit-id: 3a220b7992d265c77d9a1a406ef86eefbc699cfe
|
2024-11-04 08:18:12 +00:00 |
|
hiyouga
|
093eda2ad6
|
support rank0 logger
Former-commit-id: 84528eabe560091bfd866b6a0ca864085af7529b
|
2024-11-02 18:31:04 +08:00 |
|
hiyouga
|
df8ac15ef0
|
add examples
Former-commit-id: 9eff9625adba643263bc6cba480f30edc6bb086a
|
2024-11-01 08:41:54 +00:00 |
|
hiyouga
|
8cea5cd967
|
support multiimage inference
Former-commit-id: 8083e4607549e805eb308c4e93c8aa256202f438
|
2024-11-01 07:25:20 +00:00 |
|
hoshi-hiyouga
|
f0181a41ff
|
fix bug
Former-commit-id: e69665746d9fcd17a92ace7d5d9c8de1fc0c29b7
|
2024-10-29 22:19:04 +08:00 |
|
hoshi-hiyouga
|
a9afffa246
|
Update hf_engine.py
Former-commit-id: 7412a8b95678ca6827a8c42c9f4d38115fede897
|
2024-10-29 22:00:59 +08:00 |
|
KUANGDD
|
d0889012c2
|
modify style & little change
Former-commit-id: c988477d14dc656450d5fec31895781b7f9f7dce
|
2024-10-23 15:24:07 +08:00 |
|
Kingsley
|
8fd84c375e
|
fix some errors due to inconsistency of model cards
Former-commit-id: dd83265b9b8768eb8732f59ace128dfe4aac1c47
|
2024-09-30 19:58:34 +08:00 |
|
Kingsley
|
e4c57f54f8
|
remove some unnecessary if conditions
Former-commit-id: 482d3e5ff3338385da664475fee88c7dc623c993
|
2024-09-28 02:14:06 +08:00 |
|
hiyouga
|
7fd0d2fc2f
|
fix #5411
Former-commit-id: 392bdaf1ea9e5baf6289f2d4415a175dd55a479d
|
2024-09-11 17:36:42 +08:00 |
|
hiyouga
|
eb5af3d90b
|
support vllm 0.6.0
Former-commit-id: e39470ec51a9c74ad901871eb816df10e851f351
|
2024-09-08 02:26:20 +08:00 |
|
hiyouga
|
7f71276ad8
|
add docstrings, refactor logger
Former-commit-id: c34e489d71f8f539028543ccf8ee92cecedd6276
|
2024-09-08 00:56:56 +08:00 |
|
hiyouga
|
1874d579c5
|
video datasets
Former-commit-id: 33f28ce82d9e44d2615909250dc56d6a4a03cd99
|
2024-09-05 02:04:17 +08:00 |
|
hiyouga
|
af178cbcd1
|
update get template
Former-commit-id: 21ea0d0786f91c0bce79630963e66b815a6792a0
|
2024-09-04 22:36:20 +08:00 |
|
hiyouga
|
7056087e92
|
lazy image load
Former-commit-id: cdd733b575411e003bc5ffd6560dd8eff8aa09cf
|
2024-09-04 02:27:08 +08:00 |
|
hiyouga
|
a7fbae47d5
|
fix mm inference
Former-commit-id: fa782c15a07ed40f8a6381acdf2da395377efd04
|
2024-09-02 01:47:40 +08:00 |
|
hiyouga
|
7e4c5d4bb3
|
fix mixed mm inputs and rlhf-v
Former-commit-id: 7c248fac20bf85d57a91132ce7a793c7f84e9218
|
2024-09-01 20:52:47 +08:00 |
|
hiyouga
|
c62a6ca59d
|
refactor mm training
Former-commit-id: 179c0558699e287cbf38a2d73bff47e86d589c5a
|
2024-08-30 02:14:31 +08:00 |
|
hiyouga
|
ee1c786a12
|
fix #4674
Former-commit-id: c4f35627b4f0aeb6d4337c3d0e58318c46449f65
|
2024-07-05 00:41:03 +08:00 |
|
mMrBun
|
43a065bb07
|
Add tool_format to overwrite tool formatter template
Former-commit-id: af08971ca50443fd5597e5e4412a3aa17214502f
|
2024-06-22 02:13:23 +08:00 |
|
hiyouga
|
4bc0bea0e9
|
fix #4357
Former-commit-id: a6741bba8cebd16a6a3f97a2dc81057d0e27eb39
|
2024-06-18 22:42:45 +08:00 |
|
hiyouga
|
372da52d4a
|
fix #4335
Former-commit-id: 2ab449adbb160f339a0586edeb846fa311ad8382
|
2024-06-18 22:08:56 +08:00 |
|
hiyouga
|
bb88536166
|
add license
Former-commit-id: 69cfc98d7c81756a5ab6bf962240e393e449fef0
|
2024-06-15 17:54:33 +08:00 |
|
hiyouga
|
aa6c3766de
|
fix #3873
Former-commit-id: 1ac325b4d682bb493573c18bb0b67ceae8d0d372
|
2024-06-04 00:21:50 +08:00 |
|
hiyouga
|
81a61134b8
|
fix hf chat engine
Former-commit-id: 76ce52911690ab0dd8ffa5587127afb4ec942abe
|
2024-05-29 01:20:07 +08:00 |
|
hiyouga
|
97a23e1cbe
|
update readme
Former-commit-id: b8d0170fe0d094acce85dcb5f91775e4685ee055
|
2024-05-27 18:14:02 +08:00 |
|
hiyouga
|
bf59383783
|
refactor data preprocessing, fix mllm rlhf
Former-commit-id: 53ff2dd24f9121ea30c95063bb72e49a9b31e980
|
2024-05-24 04:08:25 +08:00 |
|
hiyouga
|
b31d808655
|
fix paligemma inference
Former-commit-id: 46357b7a677e8ba2e0a7c9d4ec1974abd061569c
|
2024-05-20 23:36:43 +08:00 |
|
hiyouga
|
ab48653e63
|
fix chat engines
do not use pop(key, default) since api assigns None to dict values
Former-commit-id: 3ebbd0b55ea07de2897c27ca54eeab5c3b319419
|
2024-05-20 00:36:43 +08:00 |
|
hoshi-hiyouga
|
b103a121f0
|
Update hf_engine.py
Former-commit-id: ce8b902e538c69d89f207db8a43c85072cd70265
|
2024-05-20 00:30:45 +08:00 |
|