BT Group’s Digital Unit has launched the GenAI Gateway, a new platform to harness large language models (LLMs) from providers like Anthropic, Meta, Cohere, and Amazon. Built in collaboration with AWS, the platform uses Amazon Bedrock, Amazon SageMaker, and AWS Professional Services to offer secure, private access to natural-language processing tools. BT Group is embedding AI across its operations, aiming to improve efficiency and control costs by centralizing LLM use.
The GenAI Gateway addresses common issues with large-scale LLM deployment, such as managing costs, security, privacy, and monitoring model performance. It includes protections against vendor lock-in and supports budget tracking for each use case. This platform allows BT Group engineers to select the best model for their specific needs while minimizing duplication of effort and reducing overall costs.
The system integrates with BT Group’s existing digital architecture via secure APIs, managing privacy and compliance through centralized control. Key features include prompt security, FinOps billing, and filters for personal identifiable information (PII). Initial use cases include automating engineering notes for Openreach and contract analysis for legal and procurement teams.
• Built in collaboration with AWS using Amazon Bedrock and SageMaker.
• Centralized platform manages LLM use, costs, and privacy controls.
• First use cases: engineering notes for Openreach and contract analysis.
• Platform provides security, performance, and flexibility.
Fabio Cerone, GM EMEA Telco at AWS, said: “The BT Group GenAI Gateway is showcasing how enterprises can effectively deploy generative AI at scale and speed. It’s been a brilliant, pioneering opportunity to collaborate and work backwards from the customer to provide a way to accelerate deployment of generative AI use cases into production with embedded security and compliance. The GenAI Gateway will trigger the flywheel effect in the adoption of generative AI, delivering quicker results for BT Group and its customers.”
Deepika Adusumilli, Managing Director, Data & AI, BT Group’s Digital Unit said: “AI is helping us reimagine the future of our company. We believe that where our data is a constant, we need flexibility with our LLMs. GenAI Gateway allows us to tap into this powerful new set of technologies at scale, in a way that is safe, responsible, flexible and scalable, delivering the ambition we have for AI to unlock the human potential within BT Group, today and in the future.”
