Microsoft has unveiled its personal line of AI chips as the corporate struggles to maintain up with the demand for its Bing Chat AI.
AI chips have turn into a few of the most generally sought elements within the tech trade, with corporations of all sizes counting on them to energy their AI purposes and platforms. Microsoft just lately inked a deal with Oracle to make use of Oracle Cloud Infrastructure (OCI) to assist energy Bing Chat.
In a weblog publish, Microsoft revealed its new Cobalt line of AI chips:
We’re introducing our first customized in-house central processing unit collection, Azure Cobalt, constructed on Arm structure for optimum efficiency or watt effectivity, powering frequent cloud workloads for the Microsoft Cloud. From in-house silicon to programs, Microsoft now optimizes and innovates at each layer within the infrastructure stack. Cobalt 100, the primary technology within the collection, is a 64-bit 128-core chip that delivers as much as 40 % efficiency enchancment over present generations of Azure Arm chips and is powering providers corresponding to Microsoft Groups and Azure SQL.
The corporate additionally emphasised its relationships with different trade leaders:
We proceed to construct our AI infrastructure in shut collaboration with silicon suppliers and trade leaders, incorporating the newest improvements in software program, energy, fashions, and silicon. Azure works intently with NVIDIA to supply NVIDIA H100 Tensor Core (GPU) graphics processing unit-based digital machines (VMs) for mid to large-scale AI workloads, together with Azure Confidential VMs. On prime of that, we’re including the newest NVIDIA H200 Tensor Core GPU to our fleet subsequent yr to assist bigger mannequin inferencing with no discount in latency.
As we increase our partnership with AMD, clients can entry AI-optimized VMs powered by AMD’s new MI300 accelerator early subsequent yr. This demonstrates our dedication to including optionality for patrons in worth, efficiency, and energy for all of their distinctive enterprise wants.
Microsoft is clearly all-in on its AI investments and pulling out all of the stops to proceed scaling as cost-effectively as it could possibly.
