zhengjl/text-generation-webui
Public Access
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Add --auto-devices and --load-in-8bit options for #4

Browse Source
This commit is contained in:
oobabooga
2023-01-10 23:16:33 -03:00
parent 3aefcfd963
commit a236b24d24
2 changed files with 46 additions and 20 deletions
Download Patch File Download Diff File Expand all files Collapse all files

16
README.md
View File

@@ -85,13 +85,15 @@ Then browse to
Optionally, you can use the following command-line flags:
```
-h, --help show this help message and exit
--model MODEL Name of the model to load by default.
--notebook Launch the webui in notebook mode, where the output is written
to the same text box as the input.
--chat Launch the webui in chat mode.
--cpu Use the CPU to generate text.
--listen Make the webui reachable from your local network.
-h, --help show this help message and exit
--model MODEL Name of the model to load by default.
--notebook Launch the webui in notebook mode, where the output is written to the same text
box as the input.
--chat Launch the webui in chat mode.
--cpu Use the CPU to generate text.
--auto-devices Automatically split the model across the available GPU(s) and CPU.
--load-in-8bit Load the model with 8-bit precision.
--listen Make the webui reachable from your local network.
```
## Presets