How I benchmark an agent guardrail without lying to myselftranslating…

It would be easy to write a benchmark for Doberman that makes Doberman look good: pick the attacks it already stops, skip the ones it doesn't, round up. I've tried to build the opposite of that - a methodology that reports the numbers whether they're flattering or not, and a…

Sign in to join the discussion.

Loading comments…