text-generation-webui/docs/Generation-parameters.md

# Generation parameters

For a description of the generation parameters provided by the transformers library, see this link: https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.GenerationConfig

### llama.cpp

llama.cpp only uses the following parameters:

* temperature
* top_p
* top_k
* repetition_penalty
* mirostat_mode
* mirostat_tau
* mirostat_eta

### RWKV

RWKV only uses the following parameters when loaded through the old .pth weights:

* temperature
* top_p
* top_k
Add mirostat parameters for llama.cpp (#2287) 2023-05-23 00:37:24 +02:00			`# Generation parameters`

			`For a description of the generation parameters provided by the transformers library, see this link: https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.GenerationConfig`

			`### llama.cpp`

			`llama.cpp only uses the following parameters:`

			`* temperature`
			`* top_p`
			`* top_k`
			`* repetition_penalty`
			`* mirostat_mode`
			`* mirostat_tau`
			`* mirostat_eta`

			`### RWKV`

Update Generation-parameters.md 2023-05-23 07:11:28 +02:00			`RWKV only uses the following parameters when loaded through the old .pth weights:`
Add mirostat parameters for llama.cpp (#2287) 2023-05-23 00:37:24 +02:00
			`* temperature`
			`* top_p`
			`* top_k`