Mode collapse reduces agent usefulness by eliminating response diversity. Common in fine-tuned models.
Symptoms
- Same answer to different questions
- Repetitive phrasing
- Lack of creativity
- Ignoring nuance in inputs
Causes
- Overfit fine-tuning
- Narrow training data
- Reward hacking