Azure Updates: AI agent governance; Magic Quadrant; Infrastructure resiliency

Microsoft VP Steve Sweetman explored how AI agent governance can control costs and prove ROI. AI agent governance is an important part of the rollout of AI agents across enterprises. It involves knowing which agents exist, what they are able to access, and how they are controlled. Sometimes there can be a mismatch between traditional billing paid cost estimation and agents programmed to retry a task regardless of billing. He wrote: 

Effective cost governance therefore depends on three things: seeing the spend, bounding it, and proving the return…AI costs become difficult to manage when they arrive as one aggregate number. One deployment may serve several agents; one agent may use several models and tools; and one outcome may require many turns. By the time that appears on an invoice, the business context has disappeared.

Instead of this monolithic approach to budgeting details, he recommended cost management capabilities in Foundry together with Microsoft Cost Management. Together these services offer project-level cost attribution, with options to allocate spending on the business unit, workload, or team. Tools like API Management AI Gateway can further assist traceability with token metrics. 

Microsoft partner Meena Gowdar noted that Microsoft was named a Leader in Gartner’s Magic Quadrant for Distributed Hybrid Infrastructure. Gartner grouped Microsoft highest for “ability to execute,” among a group of Leaders including AWS, Broadcom, Nutanix, and Oracle. Azure Arc extends management and governance to resources running in datacenters, while Azure Local offers a similar approach for locally-managed cloud services and AI workloads. According to Gowdar, Microsoft achieved its position in the ranking in-part because of its Sovereign Private Cloud built on Azure Local.