 oobabooga
|
2583bc5840
Simplify deepspeed implementation (#40)
|
il y a 3 ans |
|
oobabooga
|
f38c9bf428
Fix deepspeed (oops)
|
il y a 3 ans |
|
oobabooga
|
90f1067598
Move deepspeed parameters to another file
|
il y a 3 ans |
 81300
|
248ec4fa21
Merge branch 'oobabooga:main' into ds
|
il y a 3 ans |
|
81300
|
a6f4760772
Add arg for bfloat16
|
il y a 3 ans |
|
81300
|
c515282f5c
no_split_module_classes not needed
|
il y a 3 ans |
|
81300
|
0a0d289537
Fix issue with generating on multiple GPUs
|
il y a 3 ans |
|
81300
|
a97afa6965
Add DeepSpeed ZeRO-3 integration
|
il y a 3 ans |
|
oobabooga
|
6b13816c47
Change default --disk behavior
|
il y a 3 ans |
|
oobabooga
|
119be56390
Add back low_cpu_mem_usage=True
|
il y a 3 ans |
|
oobabooga
|
d4a0b377ab
Allow standalone --cpu-memory
|
il y a 3 ans |
|
oobabooga
|
8ef89df746
Try to leave at least 1GiB free to prevent oom errors
|
il y a 3 ans |
|
oobabooga
|
bb77f20a6c
Don't use low_cpu_mem_usage and device_map together
|
il y a 3 ans |
|
oobabooga
|
001ecf95b2
Update server.py
|
il y a 3 ans |
 Silver267
|
a85bb5e9a2
Fix an error
|
il y a 3 ans |
|
oobabooga
|
5b0bbfa6e8
Clean up
|
il y a 3 ans |
|
oobabooga
|
2dadf42cb5
Print the tokenized example dialogue in a prettier way
|
il y a 3 ans |
|
oobabooga
|
161cae001b
I needed this
|
il y a 3 ans |
|
oobabooga
|
3ebca480f6
Minor fix
|
il y a 3 ans |
|
oobabooga
|
00707a0b3b
Add "Impersonate" button
|
il y a 3 ans |
|
oobabooga
|
de72e83508
Reorganize things
|
il y a 3 ans |
|
oobabooga
|
6fbfee9e6d
Remove some bloat
|
il y a 3 ans |
|
oobabooga
|
9c9bd1074f
Add option to replace the bot's last reply
|
il y a 3 ans |
|
oobabooga
|
e5ff4ddfc8
Add bot prefix modifier option in extensions
|
il y a 3 ans |
|
oobabooga
|
b6d01bb704
Enable extensions in all modes, not just chat
|
il y a 3 ans |
|
oobabooga
|
1a139664f5
Grammar
|
il y a 3 ans |
|
oobabooga
|
2d134031ca
Apply extensions to character greeting
|
il y a 3 ans |
|
oobabooga
|
e349b52256
Read extensions parameters from settings file
|
il y a 3 ans |
|
oobabooga
|
2239be2351
Support for number/bool extension parameters
|
il y a 3 ans |
|
oobabooga
|
6da94e358c
Add support for extensions parameters
|
il y a 3 ans |
