Pink Hat, the IBM-owned open-source software program large, has accomplished its acquisition of Neural Magic, a pioneering synthetic intelligence (AI) optimization startup. Initially introduced in November 2024, the deal closed on January 13, 2025, marking a big step in Pink Hat's technique to reinforce its AI capabilities throughout hybrid cloud environments.
Whereas the value was not disclosed, Neural Magic had beforehand raised $50 million in enterprise capital funding from varied buyers, together with Andreessen Horowitz, New Enterprise Associates, Amdocs, and Comcast Ventures. We are able to safely assume that the deal wasn't made for peanuts. The trigger in all probability wasn't harm, I'm certain, by the truth that Neural Magic's CEO earlier than the deal closed was Brian Stevens, Pink Hat's former CTO and government VP.
Additionally: The most effective open-source AI fashions: All of your free-to-use choices defined
When the merger was first introduced, Stevens mentioned: "At Neural Magic, our imaginative and prescient is that the way forward for AI is open, and we’ve been on a mission to allow enterprises to seize the highly effective innovation from AI whereas on the similar time being freed from friction and restriction. Open-source fashions, optimization algorithms, and inferencing methods are the guts of this — enabling enterprises to personal their very own AI fashions, privately customise them to their datasets, and deploy them on their personal multi-vendor infrastructure — cloud, knowledge heart, or edge."
Neural Magic, an MIT spinoff based in 2018, has developed revolutionary software program and algorithms that speed up generative AI inference workloads.
The corporate's expertise permits advanced AI fashions to run effectively on commodity {hardware}, together with normal CPUs and GPUs, doubtlessly decreasing the necessity for costly, specialised AI accelerators.
Additionally: Practically half of Gen AI adopters need it open supply — right here's why
So, what does that functionality imply? Nicely, Neural Magic introduced a number of key applied sciences to Pink Hat via the acquisition:
- vLLM Experience: Neural Magic is a number one contributor to vLLM, an open-source mission for environment friendly giant language mannequin (LLM) serving. Particularly, vLLM is already Pink Hat Enterprise Linux (RHEL) AI and Pink Hat OpenShift AI's inference engine. This transfer clearly advantages Pink Hat's current AI packages.
- DeepSparse: An inference runtime that delivers GPU-class efficiency on commodity CPUs via algorithms that cut back computation and reminiscence wants for neural community execution. Particularly, moreover LLMs, DeepSparse can be helpful for pc imaginative and prescient (CV) and pure language processing (NLP).
- SparseZoo: In case you use DeepSparse, Neural Magic already gives a repository of pre-optimized CV, NLP, and LLM fashions.
- Mannequin Compression Strategies: Neural Magic has developed superior strategies for mannequin quantization and sparsification, which might considerably cut back mannequin dimension and computational necessities with out substantial loss in accuracy.
- Cross-platform Optimization: Neural Magic's expertise permits AI mannequin optimization for deployment throughout cloud, knowledge heart, and edge environments.
These applied sciences align with Pink Hat's imaginative and prescient of constructing AI workloads extra accessible, environment friendly, and deployable throughout hybrid cloud environments, doubtlessly decreasing the necessity for specialised and costly AI {hardware}. In a nutshell, Neural Magic's expertise permits its customers to do AI on a budget. It's additionally, at its vLLM coronary heart, an open-source AI strategy.
Additionally: Wished: People to construct robots for OpenAI — and never everyone seems to be thrilled
For Pink Hat, as the corporate's CEO Matt Hicks mentioned in a press release: "We're thrilled to enrich our hybrid cloud-focused AI portfolio with Neural Magic's groundbreaking AI innovation, furthering our drive to not solely be the 'Pink Hat' of open supply, however the 'Pink Hat' of AI as nicely."
On X, Hicks wrote: "At @RedHat, we imagine the way forward for AI is open. That's why I'm extremely enthusiastic about our acquisition of @NeuralMagic. Collectively, we're furthering our dedication to our clients and the open-source neighborhood to ship on the way forward for AI — and that begins right this moment."
Strategically, Pink Hat hopes its Neural Magic acquisition will bolster Pink Hat's place in its means to deploy AI workloads throughout various computing environments, from on-premises knowledge facilities to public clouds, and to enhance the effectivity of AI workloads already operating on RHEL AI, OpenShift AI, and InstructLab, an open-source Pink Hat and IBM AI neighborhood mission to enhance open source-licensed IBM Granite LLMs.
Additionally: 15 methods AI saved me time at work in 2024 — and the way I plan to make use of it in 2025
So, will this strategy work out? Dave McCarthy, IDC's Cloud and Edge Providers analysis vice chairman, thinks so: "Pink Hat's acquisition of Neural Magic is a strategic enhancement to its AI capabilities, facilitating AI deployment throughout hybrid clouds by leveraging Neural Magic's experience in mannequin optimization and inference acceleration. This transfer aligns with Pink Hat's dedication to open-source innovation and positions the corporate to supply less expensive, scalable AI options that cut back dependency on specialised {hardware}."