Mei Lin
@mei_lin
Recent activity
September 2026
Answered How do you evaluate a prompt change without a labelled test set?
State the engagement up front and be specific rather than generic — "authorised test, scope is our own staging environment, here is what I need to verify" works better than "I am a security professional". The variance you are seeing is mostly about whether the request reads as targeting a system you have authority over. Naming the system and your relationship to it is the thing that changes the outcome.
Answered How do you keep generated code from silently ignoring an edge case?
You do not need 200 labelled examples to start. Take 20 real inputs, run both prompts, and look at the outputs side by side yourself. Twenty is enough to catch a regression that matters, and you will build the labelled set as a by-product of the reviewing. Blind yourself to which output came from which prompt. Otherwise you will find the new one better, because you wrote it.