 oobabooga
|
a28f0d8bd7
Show it/s in the same units with or without streaming
|
3 éve |
|
oobabooga
|
4e4cd67223
Save chat history with name/date in filename
|
3 éve |
|
oobabooga
|
3af3ffeb90
Make --help output more readable
|
3 éve |
|
oobabooga
|
638495b633
Simplify generate() function
|
3 éve |
|
oobabooga
|
3f05cf5ddd
Simplify encode() function
|
3 éve |
|
oobabooga
|
2583bc5840
Simplify deepspeed implementation (#40)
|
3 éve |
|
oobabooga
|
f38c9bf428
Fix deepspeed (oops)
|
3 éve |
|
oobabooga
|
90f1067598
Move deepspeed parameters to another file
|
3 éve |
 81300
|
248ec4fa21
Merge branch 'oobabooga:main' into ds
|
3 éve |
|
81300
|
a6f4760772
Add arg for bfloat16
|
3 éve |
|
81300
|
c515282f5c
no_split_module_classes not needed
|
3 éve |
|
81300
|
0a0d289537
Fix issue with generating on multiple GPUs
|
3 éve |
|
81300
|
a97afa6965
Add DeepSpeed ZeRO-3 integration
|
3 éve |
|
oobabooga
|
6b13816c47
Change default --disk behavior
|
3 éve |
|
oobabooga
|
119be56390
Add back low_cpu_mem_usage=True
|
3 éve |
|
oobabooga
|
d4a0b377ab
Allow standalone --cpu-memory
|
3 éve |
|
oobabooga
|
8ef89df746
Try to leave at least 1GiB free to prevent oom errors
|
3 éve |
|
oobabooga
|
bb77f20a6c
Don't use low_cpu_mem_usage and device_map together
|
3 éve |
|
oobabooga
|
001ecf95b2
Update server.py
|
3 éve |
 Silver267
|
a85bb5e9a2
Fix an error
|
3 éve |
|
oobabooga
|
5b0bbfa6e8
Clean up
|
3 éve |
|
oobabooga
|
2dadf42cb5
Print the tokenized example dialogue in a prettier way
|
3 éve |
|
oobabooga
|
161cae001b
I needed this
|
3 éve |
|
oobabooga
|
3ebca480f6
Minor fix
|
3 éve |
|
oobabooga
|
00707a0b3b
Add "Impersonate" button
|
3 éve |
|
oobabooga
|
de72e83508
Reorganize things
|
3 éve |
|
oobabooga
|
6fbfee9e6d
Remove some bloat
|
3 éve |
|
oobabooga
|
9c9bd1074f
Add option to replace the bot's last reply
|
3 éve |
|
oobabooga
|
e5ff4ddfc8
Add bot prefix modifier option in extensions
|
3 éve |
|
oobabooga
|
b6d01bb704
Enable extensions in all modes, not just chat
|
3 éve |
