Browse Source

New NovelAI/KoboldAI preset selection

oobabooga 3 năm trước cách đây
mục cha
commit
6c40f7eeb4

+ 2 - 0
README.md

@@ -140,6 +140,8 @@ Out of memory errors? [Check this guide](https://github.com/oobabooga/text-gener
 
 Inference settings presets can be created under `presets/` as text files. These files are detected automatically at startup.
 
+By default, 10 presets by NovelAI and KoboldAI are included. These were selected out of a sample of 43 presets after applying a K-Means clustering algorithm and selecting the elements closest to the average of each cluster.
+
 ## System requirements
 
 Check the [wiki](https://github.com/oobabooga/text-generation-webui/wiki/System-requirements) for some examples of VRAM and RAM usage in both GPU and CPU mode.

+ 2 - 2
presets/KoboldAI-Good Winds (Skein 6B).txt → presets/Kobold-Godlike.txt

@@ -1,7 +1,7 @@
 do_sample=True,
 max_new_tokens=tokens,
-top_p=1.0,
+top_p=0.5,
 top_k=0,
 temperature=0.7,
 repetition_penalty=1.1,
-typical_p=1.0,
+typical_p=0.19,

+ 7 - 0
presets/Kobold-Liminal Drift.txt

@@ -0,0 +1,7 @@
+do_sample=True,
+max_new_tokens=tokens,
+top_p=1.0,
+top_k=0,
+temperature=0.66,
+repetition_penalty=1.1,
+typical_p=0.6,

+ 7 - 0
presets/NovelAI-Best Guess.txt

@@ -0,0 +1,7 @@
+do_sample=True,
+max_new_tokens=tokens,
+top_p=0.9,
+top_k=100,
+temperature=0.8,
+repetition_penalty=1.15,
+typical_p=1.0,

+ 7 - 0
presets/NovelAI-Decadence.txt

@@ -0,0 +1,7 @@
+do_sample=True,
+max_new_tokens=tokens,
+top_p=1.0,
+top_k=100,
+temperature=2,
+repetition_penalty=1,
+typical_p=0.97,

+ 3 - 3
presets/NovelAI-All-Nighter.txt → presets/NovelAI-Genesis.txt

@@ -1,7 +1,7 @@
 do_sample=True,
 max_new_tokens=tokens,
-top_p=1.0,
-top_k=13,
-temperature=1.33,
+top_p=0.98,
+top_k=0,
+temperature=0.63,
 repetition_penalty=1.05,
 typical_p=1.0,

+ 7 - 0
presets/NovelAI-Lycaenidae.txt

@@ -0,0 +1,7 @@
+do_sample=True,
+max_new_tokens=tokens,
+top_p=0.85,
+top_k=12,
+temperature=2,
+repetition_penalty=1.15,
+typical_p=1.0,

+ 1 - 1
presets/NovelAI-Mothra (13B).txt → presets/NovelAI-Ouroboros.txt

@@ -2,6 +2,6 @@ do_sample=True,
 max_new_tokens=tokens,
 top_p=1.0,
 top_k=100,
-temperature=1.25,
+temperature=1.07,
 repetition_penalty=1.05,
 typical_p=1.0,

+ 7 - 0
presets/NovelAI-Pleasing Results.txt

@@ -0,0 +1,7 @@
+do_sample=True,
+max_new_tokens=tokens,
+top_p=1.0,
+top_k=0,
+temperature=0.44,
+repetition_penalty=1.15,
+typical_p=1.0,

+ 3 - 3
presets/NovelAI-Luna Moth.txt → presets/NovelAI-Storywriter.txt

@@ -1,7 +1,7 @@
 do_sample=True,
 max_new_tokens=tokens,
-top_p=0.24,
-top_k=85,
-temperature=2.0,
+top_p=0.73,
+top_k=0,
+temperature=0.72,
 repetition_penalty=1.1,
 typical_p=1.0,