May 17, 2023
1 min read

Qualcomm bets big on Hybrid AI

In a white paper, the company said that hybrid processing is more important than ever…reports Asian Lite News

As generative artificial intelligence (AI) and chatbots like Microsoft-backed OpenAIs ChatGPT and Google Bard take the world by storm, Hybrid AI will allow generative AI developers and providers to take advantage of the compute capabilities available in edge devices to reduce costs, chip maker Qualcomm has said.

In a white paper, the company said that hybrid processing is more important than ever.

“A hybrid AI architecture distributes and coordinates AI workloads among cloud and edge devices, rather than processing in the cloud alone,” said the chip maker.

The cloud and edge devices — smartphones, cars, personal computers, and Internet of Things (IoT) devices — work together to deliver more powerful, efficient and highly optimised AI.

“The main motivation is cost savings. For instance, generative AI-based search cost per query is estimated to increase by 10 times compared to traditional search methods — and this is just one of many generative AI applications,” Qualcomm stressed.

Hybrid AI even allows for devices and cloud to run models concurrently — with devices running light versions of the model while the cloud processes multiple tokens of the full model in parallel and corrects the device answers if needed.

AI models with more than 1 billion parameters are already running on phones with performance and accuracy levels similar to those of the cloud, and models with 10 billion parameters or more are slated to run on devices in the near future.

“The hybrid AI approach is applicable to virtually all generative AI applications and device segments — including phones, laptops, extended reality headsets, cars and IoT,” according to Qualcomm.

ALSO READ: Binance exits Canada market

Previous Story

Experion Technologies widens global footprint

Next Story

Most Indians prefer big corporates jobs over startups

Latest from Business

Microsoft Cuts Deep

The fresh job cuts come less than two months after Microsoft announced it was laying off more than 6,000 employees…reports Asian Lite News Microsoft is set to cut around 9,000 jobs —

Northeast Is Growth Engine

Scindia also provided updates on the government’s efforts to facilitate the entry of SpaceX’s Starlink service into India. “All due diligence from the Ministry’s side is complete Union Minister for Communications and

India to Empower Global South

India is emerging as a pivotal force in the global transition to clean energy, with Union Minister for New and Renewable Energy, Pralhad Joshi, asserting that the country is empowering the Global

Maruti’s Global Push Breaks Record

June shipments hit 37,842 units, signalling robust global demand Maruti Suzuki India recorded its highest-ever monthly exports in June, shipping 37,842 units and marking a new milestone that highlights the company’s expanding

India Bats for Fairer Global Finance: FM Sitharaman

FM Sitharaman stated that we believe that optimal regulation fosters innovation and stability….reports Asian Lite News India supports reforms to the international financial architecture to enhance inclusivity and equity, including Multilateral Development
Go toTop

Don't Miss

Chip giant Qualcomm begins layoffs

The reports came as Qualcomm struggles to close its purchase

Qualcomm’s M1 rival coming soon

The company is likely working on several chipsets, but the