A company is creating an internal tool that summarizes long meeting transcripts and extracts action...

For a tool that must process text inputs up to 200k tokens long, generate concise summaries in seconds, and support interactive testing, the configuration must address three requirements. The large token context window points to GPT-4o, which supports up to 128k tokens and is among the largest-context Azure OpenAI models available in Foundry, making it suitable for long documents such as meeting transcripts. Low latency with the need to generate responses in seconds rules out batch deployment types; Data Zone Standard provides the best latency for single-tenant enterprise use cases with zone-level routing. Interactive testing before integration points directly to Microsoft Foundry ' s built-in Chat Playground or Prompt Playground, where you can paste transcripts, adjust system prompts, and evaluate outputs interactively before writing any application integration code.

Microsoft Learn Reference Topic: Deploy and test models in Microsoft Foundry – Model selection for long-context summarization