Red Hat has acquired Neural Magic, a specialist in generative AI inference performance engineering and model optimization. Financial terms are not disclosed. This strategic move aims to enhance Red Hat AI, the company’s suite of open-source AI platforms, by integrating Neural Magic’s expertise in optimizing large language models (LLMs) for hybrid cloud environments. The collaboration addresses the resource-intensive nature of modern generative AI workloads by emphasizing smaller, open-source models optimized for efficiency across multiple compute architectures and deployment environments.
Neural Magic’s technology will empower Red Hat AI customers to better manage and fine-tune LLMs with enhanced performance, security, and flexibility for data center, cloud, and edge deployments. Additionally, Neural Magic’s contributions to open-source projects like vLLM, developed at UC Berkeley for open model serving, will expand Red Hat’s focus on cost-efficient, accessible AI infrastructure.
• AI Optimization Expertise: Neural Magic’s technology enhances LLM performance while reducing resource consumption.
• Expanded Red Hat AI Portfolio: Integration with RHEL AI, Red Hat OpenShift AI, and InstructLab for scalable AI development and deployment.
• Hybrid Cloud Focus: Optimized models capable of running across data centers, public clouds, and edge environments.
• Open-Source Leadership: Red Hat reinforces its commitment to open-source AI development and collaboration.
• AI Efficiency: The acquisition enables fine-tuning and inference acceleration for cost-effective AI workloads.
Matt Hicks, CEO of Red Hat, emphasized that “by adding Neural Magic’s expertise in generative AI performance engineering, we’re empowering our customers to run optimized AI workloads across any infrastructure while maintaining choice and efficiency.”
- Neural Magic, founded in 2018 and headquartered in Somerville, Massachusetts, specializes in software and algorithms that enhance the performance of AI inference workloads on standard hardware. The company was co-founded by Nir Shavit, a professor at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL), and Alexander Matveev.
- Neural Magic secured approximately $50 million in venture capital funding from investors including Andreessen Horowitz, New Enterprise Associates, Amdocs, Comcast Ventures, Pillar VC, and Ridgeline Ventures.