May 21, 2023
1 min read

Meta working on new AI chip

The company also plans a new AI-optimised data centre design and the second phase of its 16,000 GPU supercomputer for AI research…reports Asian Lite News

Meta (formerly Facebook) is building its first-generation custom silicon chip for running artificial intelligence (AI) models, saying its AI compute needs will grow dramatically over the next decade as we break new ground in AI research.

Called MTIA (Meta Training and Inference Accelerator), the in-house, custom accelerator chip will provide greater compute power and efficiency than CPUs, and is customised for internal workloads.

“By deploying both MTIA chips and GPUs, we’ll deliver better performance, decreased latency and greater efficiency for each workload,” said Santosh Janardhan, VP and Head of Infrastructure at Meta.

The company also plans a new AI-optimised data centre design and the second phase of its 16,000 GPU supercomputer for AI research.

“These efforts — and additional projects still underway — will enable us to develop larger, more sophisticated AI models and then deploy them efficiently at scale,” Janardhan added.

The next-generation data centre will be an AI-optimised design, supporting liquid-cooled AI hardware and a high-performance AI network connecting thousands of AI chips together for data centre-scale AI training clusters.

“It will also be faster and more cost-effective to build, and it will complement other new hardware such as our first in-house-developed ASIC solution, MSVP (Meta Scalable Video Processor), which is designed to power the constantly growing video workloads at Meta,” Janardhan informed.

Meta’s Research SuperCluster (RSC) AI supercomputer, which the company believes is one of the fastest AI supercomputers in the world, was built to train the next generation of large AI models to power new augmented reality tools, content understanding systems, real-time translation technology and more.

It features 16,000 GPUs, all accessible across the 3-level Clos network fabric that provides full bandwidth to each of the 2,000 training systems.

“Custom-designing much of our infrastructure enables us to optimize an end-to-end experience from the physical layer to the virtual layer to the software layer to the actual user experience,” said Meta.

ALSO READ-Senior Meta India executive Manish Chopra quits

Previous Story

China pips Japan in car exports

Next Story

New AI voice coach may help treat depression, anxiety

Latest from Tech Lite

AI Meets Ghibli: Copyright Debate Sparks Controversy

The digital art and retouching technology has helped movies reach a greater audience during the marketing leg of films. Standees, posters, flyers, billboards (creative and interactive billboards included), that little digital album

AI Detects Risk of Fatal Arrhythmias, Saving Lives

Sudden cardiac death, which occurs when the heart unexpectedly stops beating, is responsible for more than 5 million deaths globally each year Artificial intelligence (AI) is advancing in ways that could transform

Modi, Gates Discuss Innovation, AI, and 2047 Vision 

PM Modi described his meeting with the Microsoft co-founder as “excellent,” highlighting conversations on advancements in health, agriculture, artificial intelligence (AI), and other sectors that are shaping the future.  Prime Minister Narendra
Go toTop

Don't Miss

SMBs hit hard by rising inflation: Meta

The proportion of SMBs that are closed was 33 per

Meta’s Threads may bring X-like trending topics feature

These screenshots showed a numbered list of trending topics plus