Snapchat Introduces Real-Time AR with Generative AI Technology

Highlights

• Snapchat’s new AI model enables lifelike special effects in augmented reality (AR).
• Users can create real-time AR experiences by typing ideas for transformations.
• AR developers gain new generative AI tools in Lens Studio for creating realistic lenses.
• Partnership with London’s National Portrait Gallery brings iconic portrait-style lenses to Snapchat.

Snap Inc, the parent company of Snapchat, has announced that it is introducing generative AI technology to help people create more realistic special effects when recording videos with their phone cameras.

Next-generation AI model will be available on Snapchat in the near future.

We’re previewing Snap’s real-time image model that can instantly bring your imagination to life in AR. This early prototype makes it possible to type in an idea for a transformation and generate vivid AR experiences in real time – Snap, June 2024.

Bobby Murphy, Snap’s chief technology officer says the enhanced Lens Studio would reduce the time it takes to create AR effects from weeks to hours and produce more complex work.

“What’s fun for us is that these tools both stretch the creative space in which people can work, but they’re also easy to use, so newcomers can build something unique very quickly,” Murphy said in an interview.

“This and future real time on device generative ML models speak to an exciting new direction for augmented reality, and is giving us space to reconsider how we imagine rendering and creating AR experiences altogether,” Murphy said.

According to Snap “This milestone of running GenAI models in real-time on mobile devices is made possible by our team’s breakthroughs to optimize faster, more performant GenAI techniques. Our team of researchers and engineers is constantly innovating to make GenAI faster and lighter, so our Snapchat community can create and communicate with their friends on the go.”

“The rebuilt Lens Studio is designed for productivity, modularity, and speed. Lens Studio now features a plugin system that enables developers to extend Editor capabilities to fit their needs. It’s also a more supportive platform for team development and advanced creation, with extensive support for JavaScript, TypeScript, Version Control, and package management.”

Snapchat Gen AI in AR

Snap is previewing a real-time image model capable of bringing imagination into augmented reality (AR) in an instant.

Currently, this very early prototype allows a user to type in an idea for a transformation and vivid AR experiences will come alive real time.

With Snap’s newest updates, users of Snapchat can now add AI-powered Lenses created by AR developers into their content.

Lens Studio has been equipped with new generative AI tools, including an AI assistant to help developers with questions.

Another tool lets artists enter a prompt and automatically generate a three-dimensional image, saving effort in developing a 3D model for their AR lens.

Previously, Snap’s AR tech could only handle simple effects like placing a hat on someone’s head in a video.

Now, AR developers can craft more realistic lenses.

For example, making the hat move naturally with the person’s head and adjust to lighting seamlessly.

Snap Partnering with National Portrait Gallery

Snap has partnered with London’s National Portrait Gallery to develop lenses inspired by iconic portrait styles using the GenAI Suite.

Snapchat users can select portrait-style lenses, snap a photo, and share it on the museum’s “Living Portrait” projection wall.

Launching this new AI suite is a strategic move for Snapchat, enhancing its competitive edge against rivals like Meta’s Instagram and TikTok, and potentially attracting more users.

Both competitors are integrating AI into their platforms: TikTok has launched AI-generated digital avatars, while Meta has invested heavily in AI and AR technologies.

FAQs

What new technology has Snapchat introduced?

Snapchat has introduced generative AI technology that enhances lifelike special effects in augmented reality (AR), allowing users to create vivid AR experiences in real-time.

How can users utilize the new AI features on Snapchat?

Users can type in an idea for a transformation, and the AI model will generate real-time AR effects. Additionally, AR developers can use new generative AI tools in Lens Studio to create realistic lenses.

What is Snap’s partnership with the National Portrait Gallery about?

Snap has partnered with London’s National Portrait Gallery to develop lenses inspired by iconic portrait styles. Users can snap photos with these portrait-style lenses and share them on the museum’s “Living Portrait” projection wall.

How does the new generative AI model benefit AR developers?

The new AI tools in Lens Studio include an AI assistant to help developers with questions and a tool for generating three-dimensional images from prompts, streamlining the development of realistic AR lenses.

Why is Snapchat focusing on generative AI technology?

Launching the new AI suite is a strategic move to enhance Snapchat’s competitive edge against rivals like Meta’s Instagram and TikTok, both of which are integrating AI into their platforms.

Also Read: Red Heart on Snapchat: What Is It And How to Unlock This Symbol of Best Friendship

Also Read: Snapchat 2023: Here’s How To Block Someone On The Platform And Other Alternatives