Temperature affects the probability distribution over next tokens. Key for balancing creativity and consistency.
Values
- 0: Deterministic (always most likely)
- 0.7: Balanced (common default)
- 1.0+: Creative/varied
When to Adjust
- Lower for factual tasks
- Higher for creative tasks
- Consider task requirements