Qualcomm Snapdragon to Feature Meta’s AI Model Llama 3 for On-Device AI Capabilities

Highlights

• Meta and Qualcomm partner to integrate Llama 3 AI model into Snapdragon processors.
• Snapdragon 8 Gen 3 processors to support AI capabilities with dedicated NPUs.
• Qualcomm’s AI Hub to offer tools for optimizing Llama 3 on Snapdragon devices.
• Future Snapdragon 8 Gen 4 expected to include native support for Llama 3.

There’s a high chance that your next smartphone or gadget will be powered by a Qualcomm Snapdragon chipset, and soon, these processors could also enable on-device AI capabilities.

How?

Well, the announcement comes from two highly unlikely sources but also pretty likely if you think about it: Meta and Qualcomm.

The tech giants are teaming up to integrate Meta’s latest AI model, Llama 3, into upcoming Snapdragon platforms.

Enabling On-Device AI

What is Llama 3 though?

In the most basic terms, it is a custom AI model developed by Meta.

Similar to GPT models from OpenAI and Gemini from Google, it provides APIs that can be utilized by applications to run AI features.

While these AI models typically run on cloud servers due to their high computing demands, Qualcomm’s latest flagship processors, like the Snapdragon 8 Gen 3, feature dedicated NPUs (Neural Processing Units) capable of running AI models on a smaller scale, suitable for individual users.

Democratizing Generative AI

The Qualcomm-Meta collaboration is there to provide a somewhat easy access to generative AI capabilities.

OEMs and developers can integrate Llama 3 into devices powered by upcoming flagship Snapdragon platforms.

They will have access to resources and tools to optimize Llama 3 on Snapdragon platforms through Qualcomm’s AI Hub, which offers approximately 100 optimized AI models.

Future Snapdragon Integration

While Qualcomm has not released the exact list of compatible chipsets supporting Llama 3, it’s expected that the upcoming Snapdragon 8 Gen 4 processor, likely to be released around October 2024 based on Qualcomm’s past launch timelines, will have native support for Meta’s AI model.

Let’s see what the AI future holds, but Meta certainly is going to play a big role in it.

FAQs

What is Llama 3 and why is it important for Snapdragon processors?

Llama 3 is a custom AI model developed by Meta, designed to run AI applications directly on devices.

Its integration into Snapdragon chipsets allows for advanced on-device AI functionalities without needing cloud computing.

How does the integration of Llama 3 into Snapdragon processors benefit users?

By enabling AI processing directly on devices, users can enjoy faster, more efficient AI features such as language models and other generative AI applications, enhancing the overall user experience.

What are the capabilities of Qualcomm’s NPUs in the new Snapdragon processors?

Qualcomm’s dedicated Neural Processing Units (NPUs) are engineered to handle demanding AI tasks locally on the smartphone, which reduces latency and improves privacy for AI-driven applications.

Can developers access tools for integrating Llama 3 into Snapdragon-powered devices?

Yes, Qualcomm’s AI Hub provides developers with resources and tools to effectively optimize Llama 3 on Snapdragon platforms, ensuring smooth integration and functionality.

What should we expect from future Snapdragon processors regarding AI capabilities?

The upcoming Snapdragon 8 Gen 4 processor is anticipated to have native support for Meta’s Llama 3, suggesting a significant leap in the AI capabilities of future mobile devices powered by Qualcomm.

Also Read: Microsoft Set to Unveil Windows on ARM Strategy with New Qualcomm Snapdragon X Plus Chip

Also Read: Qualcomm Snapdragon 8s Gen 3 vs Snapdragon 8 Gen 3: A Detailed Comparison

Also Read: Meta AI on WhatsApp and Instagram: How to Use it