Introducing the unsafe-eval Leaderboard: comparing models for AI safety
We're introducing the unsafe-eval leaderboard to help compare models for AI safety tasks. Our first results examine frontier models and dedicated classifiers as safety guardrails. Several achieve similar accuracy, but differ substantially in cost, latency and how often they refuse to classify a request. We explore what those differences mean when choosing a model for an application.