Temperature Zero, Fixed Seed, Different Answers
I was discussing reliability in AI agents when a familiar question came up: if you set an LLM’s temperature to zero, doesn’t that make it deterministic? It sounds reasonable. Remove random sampling, always pick the most likely next token, and you get the same answer every time. So I tried it on my laptop. Same model. Same prompt. Temperature zero. Fixed seed. Five identical responses, then a different story on request six....