Top

Podcast #70: Qualcomm Driving On-device Generative AI to Power Intelligent Experiences at the Edge

Generative AI like ChatGPT and Google’s Bard have disrupted the industry. However, they are still limited to browser windows and smartphone apps, where the processing is done through cloud computing. That is about to change soon as Qualcomm Snapdragon-powered devices will soon be able to run on-device generative AI.

At MWC 2023, Qualcomm showcased Stable Diffusion on a Snapdragon 8 Gen 2-powered Android smartphone. The demo showed how a smartphone can generate a new image with text commands or even change the background, without connecting to the internet. Running generative AI apps directly on a device offers several advantages, including lower operational costs, better privacy, security, and reliability of working without internet connectivity.

ALSO LISTEN: Podcast #69: ChatGPT and Generative AI: Differences, Ecosystem, Challenges, Opportunities

In the latest episode of ‘The Counterpoint Podcast’, host Peter Richardson is joined by Qualcomm’s Senior Vice President of Product Management Ziad Asghar to talk about on-device generative AI. The discussion covers a range of topics from day-to-day use cases to scaling issues for computing resources and working with partners and the community to unlock new generative AI experiences across the Snapdragon product line.

Click the play button to listen to the podcast

You can read the transcript here.

Podcast Chapter Markers

01:35: Ziad starts by defining generative AI and comparing it with machine learning and other types of AI.

03:56: Ziad talks about AI experiences that are already present in Snapdragon-powered devices.

06:24: Ziad addresses the scaling issue for computing resources used to train large language models.

09:46: Ziad deep dives into the types of day-to-day applications for generative AI on devices like a smartphone.

13:34: Ziad talks about the hybrid AI model, involving both cloud interaction and edge.

15:43: Ziad on how Qualcomm is leveraging its silicon chip capabilities to unlock generative AI experiences.

19:20: Ziad on how Qualcomm is working with its ecosystem and the developer community.

21:57: Ziad touches on the privacy and security aspect with respect to on-device generative AI.

Also available for listening/download on:

 

Ritesh is a Global Content Manager with Counterpoint Technology Market Research. With over 10 years of experience, he is joining Counterpoint from BGR India where he was the Head of Features. At BGR, Ritesh also used to cover tech news, product launches, and review consumer tech. Ritesh is a science graduate from Mumbai University, with major in Physics. He followed his passion for tech, took up writing as a career and is also a well-known tech journalist in the industry.

Term of Use and Privacy Policy

Counterpoint Technology Market Research Limited

Registration

In order to access Counterpoint Technology Market Research Limited (Company or We hereafter) Web sites, you may be asked to complete a registration form. You are required to provide contact information which is used to enhance the user experience and determine whether you are a paid subscriber or not.
Personal Information When you register on we ask you for personal information. We use this information to provide you with the best advice and highest-quality service as well as with offers that we think are relevant to you. We may also contact you regarding a Web site problem or other customer service-related issues. We do not sell, share or rent personal information about you collected on Company Web sites.

How to unsubscribe and Termination

You may request to terminate your account or unsubscribe to any email subscriptions or mailing lists at any time. In accessing and using this Website, User agrees to comply with all applicable laws and agrees not to take any action that would compromise the security or viability of this Website. The Company may terminate User’s access to this Website at any time for any reason. The terms hereunder regarding Accuracy of Information and Third Party Rights shall survive termination.

Website Content and Copyright

This Website is the property of Counterpoint and is protected by international copyright law and conventions. We grant users the right to access and use the Website, so long as such use is for internal information purposes, and User does not alter, copy, disseminate, redistribute or republish any content or feature of this Website. User acknowledges that access to and use of this Website is subject to these TERMS OF USE and any expanded access or use must be approved in writing by the Company.
– Passwords are for user’s individual use
– Passwords may not be shared with others
– Users may not store documents in shared folders.
– Users may not redistribute documents to non-users unless otherwise stated in their contract terms.

Changes or Updates to the Website

The Company reserves the right to change, update or discontinue any aspect of this Website at any time without notice. Your continued use of the Website after any such change constitutes your agreement to these TERMS OF USE, as modified.
Accuracy of Information: While the information contained on this Website has been obtained from sources believed to be reliable, We disclaims all warranties as to the accuracy, completeness or adequacy of such information. User assumes sole responsibility for the use it makes of this Website to achieve his/her intended results.

Third Party Links: This Website may contain links to other third party websites, which are provided as additional resources for the convenience of Users. We do not endorse, sponsor or accept any responsibility for these third party websites, User agrees to direct any concerns relating to these third party websites to the relevant website administrator.

Cookies and Tracking

We may monitor how you use our Web sites. It is used solely for purposes of enabling us to provide you with a personalized Web site experience.
This data may also be used in the aggregate, to identify appropriate product offerings and subscription plans.
Cookies may be set in order to identify you and determine your access privileges. Cookies are simply identifiers. You have the ability to delete cookie files from your hard disk drive.