This AI infrastructure partnership brings optimized NVIDIA GB200, H100 and H200 clusters delivering accelerated AI improvement via quicker coaching, inference and enhanced price effectivity
Collectively AI, the main AI acceleration cloud, a pioneer in open-source AI analysis and high-performance GPU Clusters, has partnered with Hypertec Cloud, a large-scale AI and high-performance computing IaaS resolution supplier. This partnership combines Collectively AI’s high-performance GPU Clusters and deep AI analysis experience with Hypertec Cloud’s infrastructure compute and knowledge heart capabilities to ship subsequent era infrastructure to speed up coaching, fine-tuning, and inference of huge generative AI fashions, surpassing the AI {industry}’s demand for efficiency, scale, and reliability.
Additionally Learn: AI in Analysis: Remodeling Processes and Outcomes
The partnership has the capability to deploy a cluster of 36,000+ NVIDIA GB200 NVL72 GPUs beginning Q1 2025, complementing 1000’s of present H100 and H200 GPUs throughout North America. This growth goals to serve the rising computational calls for of frontier mannequin builders, AI resolution suppliers, and enterprises in expertise, finance, and healthcare.
This partnership will ship sustainable AI infrastructure options with superior cluster efficiency, uptime, and scale at industry-best deployment occasions. With near-term knowledge heart capability already secured throughout North America and Europe, Collectively AI and Hypertec Cloud can deploy greater than 100,000 GPUs inside 2025.
“We’re thrilled to announce this strategic partnership with Collectively AI and convey collectively our distinct experience to ship next-generation high-performance AI options which can be as environment friendly as they’re highly effective,” stated Jonathan Ahdoot, President of Hypertec Cloud. “Our GPU clusters, large-scale secured knowledge heart capability, and dedication to sustainability mixed with Collectively AI’s experience and mannequin optimization capabilities be sure that our joint clients can quickly entry extremely optimized giant AI clusters with unmatched service ranges at scale whereas minimizing the affect on our planet.”
Collectively AI brings deep experience in AI methods analysis and an built-in platform that helps the whole AI lifecycle — from pre-training via fine-tuning to inference. Collectively GPU Clusters, powered by NVIDIA H100, H200, and shortly GB200 GPUs, are uniquely optimized with the Collectively Kernel Assortment (TKC), a collection of distinctive software program enhancements that speed up the most important AI workloads. Developed by a staff of main AI researchers, together with Collectively AI’s co-founder and Chief Scientist and FlashAttention creator, Tri Dao, Collectively GPU Clusters ship as much as a 24% velocity improve for high-frequency coaching operations and as much as a 75% enhance in FP8 inference duties, decreasing GPU hours and decreasing prices. This permits clients to attain industry-leading efficiency and cost-efficiency in coaching and inference at scale.
Additionally Learn: AI helps Information Engineers be Distinguished Information Engineers
With Hypertec Cloud’s skill to ship large-scale knowledge heart and GPU compute capability at scale with industry-best deployment occasions and uptime, Collectively AI can now quickly scale its infrastructure to assist the most important and most advanced AI fashions.
“We’re excited to associate with Hypertec Cloud to broaden our extremely performant and dependable Collectively GPU Cluster footprint, serving the exponentially rising computational wants of our world clients,” stated Vipul Ved Prakash, CEO of Collectively AI. “By Hypertec’s strategically situated knowledge facilities and Collectively AI’s fleet of GPU Clusters — that includes improvements like Collectively Kernel Assortment — clients can now obtain industry-leading efficiency and cost-efficiency in coaching frontier fashions and operating inference at scale.”
[To share your insights with us as part of editorial or sponsored content, please write to psen@itechseries.com]
