Red Hat agreed to acquire Neural Magic, an MIT spinout working on generative AI (gen AI) inference performance engineering. Financial terms were not disclosed. The acquisition is part of Red Hat’s strategy to extend its hybrid cloud portfolio with scalable, flexible, and open-source-based AI solutions. Neural Magic, founded in 2018, specializes in accelerating AI inference workloads and optimizing large language model (LLM) deployments across diverse hardware environments, aligning with Red Hat’s vision for adaptable AI across on-premises, public cloud, and edge deployments.
The growing computational demands of LLMs highlight the need for efficient, open platforms that can integrate into diverse enterprise environments. Red Hat intends to leverage Neural Magic’s expertise in the vLLM project, a UC Berkeley open-source initiative, to support all major model families across hybrid cloud infrastructures. This collaboration will enable Red Hat to enhance its AI portfolio, including OpenShift AI and Red Hat Enterprise Linux AI (RHEL AI), giving enterprises more flexibility to deploy tailored AI workloads in any environment, with significant improvements in efficiency and control.
Key features of the Red Hat-Neural Magic collaboration include an optimized inference stack, fine-tuning capabilities for private data, and cost-effective model deployment across hybrid clouds. Red Hat also plans to integrate Neural Magic’s model optimization research to reduce the skill and cost barriers to enterprise AI adoption.
• Neural Magic specializes in gen AI inference and model optimization
• Red Hat plans to integrate Neural Magic’s vLLM project contributions
• Collaboration supports AI deployment across hybrid, on-premises, and edge environments
• Red Hat aims to lower costs and streamline the use of LLMs for enterprises
• Key products include RHEL AI, OpenShift AI, and InstructLab
“AI workloads need to run wherever customer data lives across the hybrid cloud; this makes flexible, standardized and open platforms and tools a necessity,” said Matt Hicks, President and CEO of Red Hat.
