 oobabooga
|
8e706df20e
Fix a memory leak when text streaming is on
|
2 лет назад |
|
oobabooga
|
5492e2e9f8
Add sentencepiece
|
2 лет назад |
|
oobabooga
|
90206204aa
Merge pull request #163 from oobabooga/hf_llama
|
2 лет назад |
|
oobabooga
|
c33715ad5b
Move towards HF LLaMA implementation
|
2 лет назад |
|
oobabooga
|
bd8aac8fa4
Add LLaMA 8-bit support
|
2 лет назад |
|
oobabooga
|
c93f1fa99b
Count the tokens more conservatively
|
2 лет назад |
|
oobabooga
|
736f61610b
Update README
|
2 лет назад |
|
oobabooga
|
ed8b35efd2
Add --pin-weight parameter for FlexGen
|
2 лет назад |
|
oobabooga
|
05e703b4a4
Print the performance information more reliably
|
2 лет назад |
|
oobabooga
|
5a79863df3
Increase the sequence length, decrease batch size
|
2 лет назад |
|
oobabooga
|
e62b9b1074
Revamp the "Default" preset with HF defaults
|
2 лет назад |
|
oobabooga
|
a345a2acd2
Add a tokenizer placeholder
|
2 лет назад |
|
oobabooga
|
4cc36dc434
Tweak the Naive preset (for LLaMA/RWKV)
|
2 лет назад |
|
oobabooga
|
5b354817f6
Make chat minimally work with LLaMA
|
2 лет назад |
|
oobabooga
|
ea5c5eb3da
Add LLaMA support
|
2 лет назад |
|
oobabooga
|
2bff646130
Stop chat from flashing dark when processing
|
2 лет назад |
|
oobabooga
|
7c70e0e2a6
Fix the download script (sort of)
|
2 лет назад |
|
oobabooga
|
bcea196c9d
Bump flexgen version
|
2 лет назад |
|
oobabooga
|
76378c6cc2
Update README
|
2 лет назад |
|
oobabooga
|
169209805d
Model-aware prompts and presets
|
2 лет назад |
|
oobabooga
|
024d30d1b4
Reorder imports
|
2 лет назад |
|
oobabooga
|
7bbe32f618
Don't return a value in an iterator function
|
2 лет назад |
|
oobabooga
|
ff9f649c0c
Remove some unused imports
|
2 лет назад |
|
oobabooga
|
1a05860ca3
Ensure proper no-streaming with generation_attempts > 1
|
2 лет назад |
|
oobabooga
|
a2a3e8f797
Add --rwkv-strategy parameter
|
2 лет назад |
|
oobabooga
|
99dc95e14e
Minor aesthetic change
|
2 лет назад |
|
oobabooga
|
449116a510
Fix RWKV paths on Windows (attempt)
|
2 лет назад |
|
oobabooga
|
955cf431e8
Minor consistency fix
|
2 лет назад |
|
oobabooga
|
7a9b4407b0
Settle for 0.0.6 for now
|
2 лет назад |
|
oobabooga
|
f351dce032
Keep rwkv up to date
|
2 лет назад |
