Explorar el Código

Add back low_cpu_mem_usage=True

Removing it didn't help with anything, so I am adding it bad on a purely
superstiticious basis.
oobabooga hace 3 años
padre
commit
119be56390
Se han modificado 1 ficheros con 1 adiciones y 1 borrados
  1. 1 1
      server.py

+ 1 - 1
server.py

@@ -88,7 +88,7 @@ def load_model(model_name):
     # Custom
     # Custom
     else:
     else:
         command = "AutoModelForCausalLM.from_pretrained"
         command = "AutoModelForCausalLM.from_pretrained"
-        settings = []
+        settings = ["low_cpu_mem_usage=True"]
 
 
         if args.cpu:
         if args.cpu:
             settings.append("low_cpu_mem_usage=True")
             settings.append("low_cpu_mem_usage=True")