Selaa lähdekoodia

Explain the dialogue tokenization output

oobabooga 3 vuotta sitten
vanhempi
commit
833a1138fa
1 muutettua tiedostoa jossa 1 lisäystä ja 1 poistoa
  1. 1 1
      server.py

+ 1 - 1
server.py

@@ -446,7 +446,7 @@ if args.chat or args.cai_chat:
                     _history.append(entry)
                     _history.append(entry)
                 entry = ['', '']
                 entry = ['', '']
 
 
-        print(f"\nDialogue tokenized to:\n\n", end='')
+        print(f"\nDialogue tokenized to (formatted as [question, reply]):\n\n", end='')
         for i in _history:
         for i in _history:
             print(i)
             print(i)
         print("--------------------\n", end='')
         print("--------------------\n", end='')