Updates & insights

News

The latest news, updates, and insights from our team on our mission to build AI systems that are safe, transparent, and aligned with human values.

4 posts tagged Open-Source

Articles

Guardrails

Introducing unsafe-eval: a framework for AI safety evaluation

When OpenAI, Anthropic, Google, or others release a new LLM, we're curious whether it makes sense to use it as a safety guardrail. Trying a few prompts out usually gives us a first impression; however, a proper comparison with other models takes more work. We built unsafe-eval to make those comparisons easier to run, and we're now sharing it.

11 min read
Guardrails

Introducing ScopeGuard-2

Sometimes your AI assistant should use a reply you've already written, or leave a request to someone on your team. Following feedback from our users, we built ScopeGuard-2 to recognize when each is needed. We're releasing it with more control over what each prediction returns, and new models that match frontier models on accuracy in our evaluations while responding much faster.

8 min read