Your LLM Needs Regression Tests, Not Better Prompts
When an LLM feature gives me an inconsistent answer, my first instinct is to tweak the prompt. Add an example. Make a warning louder. Move a sentence closer to the top. That can change a response, but it does not…