瀏覽代碼

Add display of context when input was generated

Not sure if I did this right but it does move with the conversation and seems to match value.
Forkoz 2 年之前
父節點
當前提交
b740c5b284
共有 1 個文件被更改,包括 1 次插入1 次删除
  1. 1 1
      modules/text_generation.py

+ 1 - 1
modules/text_generation.py

@@ -270,5 +270,5 @@ def generate_reply(question, max_new_tokens, do_sample, temperature, top_p, typi
         traceback.print_exc()
     finally:
         t1 = time.time()
-        print(f"Output generated in {(t1-t0):.2f} seconds ({(len(output)-len(original_input_ids[0]))/(t1-t0):.2f} tokens/s, {len(output)-len(original_input_ids[0])} tokens)")
+        print(f"Output generated in {(t1-t0):.2f} seconds ({(len(output)-len(original_input_ids[0]))/(t1-t0):.2f} tokens/s, {len(output)-len(original_input_ids[0])} tokens, context {len(original_input_ids[0])})")
         return