Temperature

The temperature parameter influences the randomness of the LLM’s response. The outputs are not deterministic; instead, probabilities for various responses are calculated. The temperature, typically ranging from 0 to 1, regulates this probability distribution. A higher temperature value (close to 1) increases randomness, leading to more diverse and creative responses. A lower value (close to 0) makes the output more deterministic and tends toward predictable responses. In summary: the higher the temperature, the more creative and diverse the response.