A team develops and manages a conversational assistant by using Microsoft Foundry.

The Content Safety evaluator in Microsoft Foundry is specifically designed to detect hate speech, violence, sexual content, and self-harm content in model outputs, making it the most direct evaluator for the requirement of preventing hateful responses. It uses Azure AI Content Safety service under the hood, which is trained to classify content across these harmful categories with high accuracy. Protected Material (option A) evaluates whether outputs contain copyrighted or licensed material — not hate speech. Groundedness (option B) measures factual accuracy against a source context — completely irrelevant to hate detection. Indirect Attacks (option C) evaluates whether the model was manipulated via prompt injection to produce harmful content — this is a robustness metric, not a direct output quality measure. Content Safety must be configured first because detecting hate is the primary safety concern explicitly identified in the requirement.

Microsoft Learn Reference Topic: Content safety evaluators in Microsoft Foundry – Detect harmful content in AI model outputs