A regional healthcare group had Azure OpenAI private endpoints in both development and production, and its architecture diagrams showed AI traffic staying inside the virtual network. In practice, every API call from those networks was going to a public IP address. A private endpoint only makes traffic private if DNS sends clients to it, and in this estate two separate DNS mistakes meant it did not.
Read More