Explorar o código

Increase the sequence length, decrease batch size

I have no idea what I am doing
oobabooga %!s(int64=2) %!d(string=hai) anos
pai
achega
5a79863df3
Modificáronse 1 ficheiros con 1 adicións e 1 borrados
  1. 1 1
      modules/LLaMA.py

+ 1 - 1
modules/LLaMA.py

@@ -70,7 +70,7 @@ class LLaMAModel:
         pass
 
     @classmethod
-    def from_pretrained(self, path, max_seq_len=512, max_batch_size=32):
+    def from_pretrained(self, path, max_seq_len=2048, max_batch_size=1):
         tokenizer_path = path / "tokenizer.model"
         path = os.path.abspath(path)
         tokenizer_path = os.path.abspath(tokenizer_path)