zhengjl/text-generation-webui
Public Access
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Explain the dialogue tokenization output

Browse Source
This commit is contained in:
oobabooga
2023-01-28 20:41:02 -03:00
parent 89c862b179
commit 833a1138fa
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
server.py
View File

@@ -446,7 +446,7 @@ if args.chat or args.cai_chat:
_history.append(entry) _history.append(entry)
entry = ['', ''] entry = ['', '']
print(f"\nDialogue tokenized to:\n\n", end='') print(f"\nDialogue tokenized to (formatted as [question, reply]):\n\n", end='')
for i in _history: for i in _history:
print(i) print(i)
print("--------------------\n", end='') print("--------------------\n", end='')