Changing a prompt can alter tool selection even when ordinary chat examples still look correct. Treat prompts, model settings and retrieval rules as deployable artifacts with review history. https://ai-software-development.net 公仔箱論壇/ G* x; u6 I4 _3 U
* C" C5 n$ t+ \5 p/ J4 v- f公仔箱論壇Before wider exposure, compare the candidate against a fixed evaluation set and inspect failures by workflow. An LLMOps release process should block promotion when a protected behavior regresses, even if the average score improves. tvb now,tvbnow,bttvb2 E8 b# D! `/ _5 v& {7 z& G% n
6 o1 y: o2 B/ @( ?) j2 r+ y' _An <a href="https://ai-software-development.net">AI deployment workflow</a> needs a tested rollback path for application code and model configuration. Compatibility matters during a partial rollback. An older prompt may depend on a tool schema that a newer application no longer provides. |