Lens Fest, Snap’s Global AR Festival


This year, Lens Fest was a global, virtual event exploring the current AR Lenscape. The multi-day event focused on highlighting new dimensions of augmented reality and celebrating you, our Lens Creator community shaping the future of AR!

Spanning three days, the AR festival was hosted in an immersive and interactive online environment where attendees watched session content, chatted with other creators, explored a library of tutorials and a gallery of some of the top Lens Creators, and much more. During Lens Fest we announced:

  • An investment of $3.5 million to expand our support to Lens creators and developers who are pushing what’s possible in AR through Lens Studio’s most advanced capabilities.
  • Strong AR engagement in our community – over 180 million Snapchatters engage with Lenses every day, and community Lenses have been viewed by Snapchatters more than 1 trillion times.¹
  • Lens Studio 3.3, bringing you powerful new tools and features to help you make even more impressive Lenses, more efficiently.


Thousands of Lens Creators tuned into Lens Fest to explore the virtual event space and watch the session content, which featured guides on building innovative Lenses with SnapML, Visual Scripting, Depth Tech and Material Editor, and tips on how to unlock and discover new experiences with Lens Studio. Watch the main sessions, Lens Studio demos, and more here!

Creator and Partner Spotlights

In between the core sessions we highlighted some of the most innovative creators and partners who are part of our AR ecosystem. We featured three partners who were looking for creators to build AR experiences or educate underserved communities with them, and a series of creators who have been including cutting-edge AR tech in their Lenses this year.

Check out the short vignettes below to learn more about the opportunities to work with our partners and to learn more about our creators:

Partner Spotlights

  • Verizon - Verizon will be sponsoring an Innovation Studio for Lens Creators to build experiences optimized for 5G experiences for Verizon. Submit interest here.
  • LACMA - Calling all Lens Creators who want to build AR monuments and murals  in collaboration with LACMA. Submit interest here.
  • iDTech - Snap and  iDTech have built a Lens Studio course for students to begin experimenting in AR, and have opened opportunities for Lens Creators to mentor young creators. If interested in volunteering, sign up here.


Creator Spotlights

Lens Fest 2020 Call for Creation

The week before Lens Fest began we put out a call to creators to build utility-based Lenses along the theme of “AR for Good”. Over 100 creators participated in building Lenses in teams and we received many great submissions.


Check out the 5 Lenses we were most impressed with and the creators behind them:

Overall, we are so impressed with all of the Lenses you have made this past year. The rapid growth of our AR ecosystem is because of your innovation. You are the future of AR and we can’t wait to see what our community of Lens Creators will make next. 

Happy Creating,

Team Lens Studio

Powerful Updates in Lens Studio 3.3


Lens Studio is already one of the most popular AR tools on the market and we’ve just given it a powerful upgrade with version 3.3. This release is focused on improving creator workflows by providing tools and resources that professional creators need. With Lens Studio 3.3, there is a wide variety of features that help save time and improve the quality of experiences:

My Lenses 2.0

Search and manage your Lenses with our newly enhanced Lens management tool. Not only do you now have the ability to manage your Lenses in web browsers outside the Lens Studio application, you can also quickly search for and easily monitor your Lens activity in one place. Toggle between personal and sponsored Lens accounts, see the status of your Lens, set Lens visibility, and add tags, Scan Triggers and Preview Videos within My Lenses 2.0.

Visual Scripting

Create custom interactivity using graphical, node-based scripting. No Code AR allows you to save time while building complex logic without the need to code.

Texture Compression

Pack richer assets for more compelling Lenses with Texture Compression. We listened to your feedback that compressing assets into the 4 MB Lens size can be tricky, especially when building Lenses for brands. So we've made it easier to compress textures right inside Lens Studio, allowing you to compare quality and size tradeoffs visually. The newly supported compression formatting will help your Lens load faster and use less RAM, creating a better experience for Snapchatters. 

Logger

Group, filter and search messages with our updated Logger, which will help streamline your workflow as you build and test your Lenses.

Building Blocks

Get started quickly on your next Lens experience with Building Blocks: downloadable assets and helper scripts that help you prototype, refine and add features to your Lens experiences. Check it out in our Additional Resources page on the Community Support Website.

New Templates

There are several templates to jumpstart your next Lens, including:

  • Face Morph Template: Transform faces into 3D characters using a custom mesh and build more transformative, realistic experiences. 
  • Configuration Template: use UI widgets to create an adjustable Lens. This is particularly great for building innovative shopping and try-on experiences.
  • Tween Template: set-up Tween animations quickly through a dropdown menu great for building games and interactive experiences.


We’ve also made other improvements such as additional SnapML performance increases and bug fixes.

Within Lens Studio, your creative possibilities are virtually endless. Download Lens Studio 3.3 now and get started on your next Lens today!

Happy Creating,

Team Lens Studio

Create LiDAR-Powered Lenses for the New iPhone 12 Pro

Today, we’re launching Lens Studio 3.2, which lets augmented reality creators and developers build LiDAR-powered Lenses for the new iPhone 12 Pro. 

The state-of-the-art LiDAR Scanner on iPhone 12 Pro and iPhone 12 Pro Max enables immersive AR experiences that overlay more seamlessly onto the real world. It lets Snapchat’s camera see a metric scale mesh of the scene, understanding the geometry and meaning of surfaces and objects. This new level of scene understanding allows Lenses to interact realistically with the surrounding world. Thanks to the power of A14 Bionic and ARKit, you can render thousands of AR objects in real time, letting you create immersive, magical environments for the whole Snapchat community to explore.

"The addition of the LiDAR Scanner to iPhone 12 Pro models enables a new level of creativity for augmented reality," said Eitan Pilipski, Snap's SVP of Camera Platform. "We're excited to collaborate with Apple to bring this sophisticated technology to our Lens Creator community."  

Through a new interactive preview mode in Lens Studio 3.2, you can create Lenses and preview them in the world, even before you have the new iPhone 12 Pro in your hand. You can also open Snapchat on Apple’s latest iPad Pro to bring your LiDAR-powered Lenses to life. 


Welcome to the next generation of what’s possible with AR -- where the digital world takes a step closer to seamlessly melding with the physical world. We can’t wait to see what you build with Lens Studio 3.2!   

Download the template to create LiDAR-Powered Lenses here.

Team Lens Studio

Enhanced Capabilities Inspired By You


We believe in making AR creation accessible to all kinds of creators.

In this latest update, we’ve made it easier to find the specific template or Material Editor Node you need with new search bars, so you can get to creating faster than ever before. We also extended capabilities with our Face Mesh and Hand Tracking features to allow for hand segmentation and tracking against an entire skull as compared to just one’s face.   

We hope the new Start Screen search function can help you find exciting new templates for:

  • Hand Segmentation - Segment an image against your hand, as well as occlude things behind hands. This template also demonstrates how you can use hand gestures to control effects around a segmented hand.
  • Behavior Script - Learn how you can use the Behavior Helper Script to set up different effects and interactions through a dropdown menu. You can choose different triggers like face or touch interactions, and respond to them with effects like enabling objects, playing tweens, and more!

Then be sure to check out the Templates page to find three downloadable templates for Head Mesh that help you learn more about our new skull property in the Face Mesh asset, which allows you to track a user’s whole head shape.

Our templates make it easy for beginners and experts alike to get acquainted with new Lens Studio features. They also cut down on the overall creation time of Lenses.  But they’re really just the beginning of what you can make. 

As always, keep us posted on what you create in the Community Forum. If you haven’t already, follow us on Twitter and Youtube for creator spotlights, tutorials and countless other resources. If you’re reading this, you’re already a part of our AR-obsessed family. 

Also! Don’t forget to keep checking this blog. There’s always big, exciting, augmented things ahead. 

Happy Creating!

Team Lens Studio

Zedd X Jasmine X Snapchat = The Ultimate Quarantine Concert

In the time of Covid-19 and socially distancing, Zedd and Jasmine wanted to find a way to bring people together and celebrate the release of their new song. Partnering with Official Lens Creator Michael Nicholl, they created an AR quarantine concert unlike any other. Opening on the front facing camera, Snapchatters unlocked their VIP ticket and watched as the concert came to life right before their eyes. Check it out now!

Team Lens Studio

Snap Stars X OLCs Make Moves Together

To help us launch Lens Studio 3.1’s 2D Full Body Tracking feature, we teamed up 4 Snap Stars and 4 Official Lens Creators to create Lenses that move with you. Knowing Snapchatters use our Lenses across multiple platforms, this partnership utilized our newest feature to level up dance challenges. 

Jye Trudinger and Jalaiah Harmon drew inspiration from Jye’s Lens Trails — a Lens which amplifies and accentuates your movements. In honor of Jalaiah’s incredible choreography, Jye used 3D occlusion to create Star Burst—a vibrant animated rainbow that adds expression and depth to every move you make. “I love how AR gives you a completely new way of interacting with your phone and the environment around you”, said Jye. 

Max van Leeuwen’s Lens Alone is the perfect compliment to Loren Grey’s aesthetic. After experimenting with a few styles, Max landed on using motion graphics and custom materials to create a Lens that is not just fun to dance to but also enhances every movement. 

Robin Delaporte worked with Sarati to create Be you, an uplifting Lens that provides the positive message of ‘be you’ as well as allows you to change it to whatever empowers you, as you move and dance around. We can’t think of a more inspiring way to use 2D full body tracking than to support and love one another.

Abbas Sajad partnered with Dixie D'Amelio, to develop Be Happy, a Lens that is an extension of Dixie's new song "Be Happy". “I felt this was the chance for me to expand on the music video and stylize the emotions that Dixie mentions in the song,” said Abbas. Designing everything by hand using Procreate, Abbas put a heavy emphasis on the environment and the Snapchatter’s movements, creating a visually stunning and exciting Lens that enables you to control the weather. 

This epic collaboration between Snap Stars and OLCs resulted in unforgettable Lenses that not only took Snapchat by storm, but elevated dance challenges everywhere.

To learn more about Lens Studio 3.1 and 2D full body tracking, check out our release here.

Happy creating!

Team Lens Studio

Introducing 2D Full Body Tracking

The latest Lens Studio update lets you reimagine what it means to move. With the arrival of 2D Full Body Tracking, you can now create Lenses that move with your entire body. In technical terms, this means you’ll have the ability to track 18 joints and trigger effects based on those body movements - legs included! This feature will be especially useful as you level up your next dance challenge, workout tutorial, or whatever’s keeping you moving these days!


New Templates


Full Body Triggers

Trigger effects based on full skeletal tracking poses and points’ positions.

Full Body Attachments

Attach objects to (and around) users’ joints.


Snap Star x Official Lens Creator Partnerships

To debut this new technology, we paired 4 Official Lens Creators with 4 Snap Stars and asked them to develop bespoke 2D Full Body TrackingLenses that reflect their individual styles.

Try their Lenses:

  • Star Burst by Jalaiah Harmon and Jye Trudinger
  • Be you by Sarati and Robin Delaporte
  • Alone by Loren Grey and Max van Leeuwen
  • Be Happy by Dixie D'Amelio and Abbas Sajad

We hope these updates will inspire you to keep innovating, iterating, and doing what you do best. Whether you’re busting a move or crushing a workout, Lens Studio is always looking to help elevate your AR vision. As always, we can’t wait to see what you create.

Team Lens Studio

Snap With Pride


Snap and Pride Media teamed up to ensure that the spirit of Pride marches on. Several of our Official Lens Creators kicked off Pride last month with new, interactive AR Lenses that reflect the vibrancy and strength of this community. You can read more about this year's "Champions of Pride" on The Advocate. Official Lens Creators participated in this national exhibition with augmented galleries, activist portraits, and regional stories of LGBTQ+ history in the United States.


Brielle Garcia represented the Pacific West with an augmented ocean floor that comes to life with faces of activists like Jasmyne Cannick, who was recently elected to the Democratic Party’s Los Angeles County Central Committee.


CyreneQ showed some Southern pride with a colorful collection of local faces like Big Freedia, whose Louisiana-born music lights up the streets of New Orleans for Pride every June.


Joshua Keeney highlights the North Atlantic with leaders making waves of all sizes, such as the “Mighty” Rebekah, a 13-year-old who pioneered an LGBTQ-inclusive curriculum in her own school district. 


Alie Jackson's virtual mural displays the pride of the Mountain region with a parade of journalists, while the Midwest is represented by people like State Rep. Kelly Cassidy, who became the first first queer parent elected to the Illinois Legislature.

Even though June is now over, we want Snapchatters to keep showing their pride! Keep it up with community Lenses or try building your own in Lens Studio. If you're looking to get involved with the Pride movement or be a bigger ally to the LGBTQ+ community, start in your own neighborhood. Work with your nearest LGBT center or go big with organizations like the Human Rights Campaign or InterPride, read up on relevant history and news, and find ways to educate others.

Team Lens Studio

A look back at Snap Partner Summit 2020

On June 11th, we hosted our 2nd annual Snap Partner Summit, virtually! The keynote was streamed, featuring product announcements, partner highlights, and celebrations of the Snapchat community.

We celebrated you, our community of creators, and your astonishing accomplishment of building over 1 million Lens AR experiences¹ with Lens Studio! Check out what you’ve created over the past year.


Snap Inc’s Katie Babineau, Marketing Lead of Snap Labs, led a panel discussion featuring special guests including Official Lens Creators Anrick Bregman and Pedro Cruz, to learn how Snap’s augmented reality platform is helping shift the way we interact with the world around us.


Announcements


We made the exciting announcement that machine learning is now available in Lens Studio, allowing anyone to apply the power of convolutional neural networks to their Lenses! Check out some of the amazing Lenses our first SnapML partners have made.
 

Wannaby


Teaming up with Wannaby, we created a downloadable foot tracking template that allows you to create fun Lenses that interact with your feet. This powerful template enables you to build a wide range of experiences, including realistic shoe try-on Lenses.


Prisma


Partners like Prisma, an app that turns your photos into works of art, are using SnapML to enable you to see the world through a new Lens—and even step into a renaissance painting!


2020CV and mkcola


SnapML has enabled our creators and developers to build extraordinary Lenses together. 2020CV and mkcola teamed up, using 2020CV’s hand tracking model and mkcola’s creative eye to build a bewitching Lens. 


Creative Kit and Dynamic Lenses


Creative Kit makes it easier than ever to share content from apps directly into Snapchat. We’ve now expanded it to include AR with new Dynamic Lenses. Developers can bring real-time information from their app into Snapchat Lenses, making it easy for any partner to build customized AR Lens experiences.

This past year has been an amazing one in the world of augmented reality. We can’t wait to see what the future holds!

What will you create?

Team Lens Studio


Introducing Lens Studio 3.0

Today at the Snap Partner Summit we announced even more ways for creators to transform their world! You can now integrate your own machine learning models into Lens Studio with SnapML.

Meet SnapML 


With SnapML, you can now create your own Lens features with neural networks that you have trained. By adding these ML models to your Lenses, the Snapchat Camera will be even better at transforming the world around you! Not an ML developer? Don’t worry, we’ve added templates to this new version of Lens Studio so anyone can get started. What will you create?

Style Transfer

Apply an art style to the camera feed using Machine Learning to alter the world as you see it.

Custom Segmentation

Use a custom segmentation mask to apply effects to certain parts of a scene.

Object Detection

Attach an image to a custom detected object.

Classification

Understand what’s in a scene and react to what the camera sees.

Ground Segmentation

Replace the ground with a material and occlude objects not on the ground.

More Possibilities!

Use these templates as a starting point for integrating additional models, or add your own.



New Templates


Hand Gestures 

Use different hand poses like open palm, closed palm, and more to trigger custom effects.

Face Landmarks 

Trigger effects by tracking specific coordinates on the face. 

Face Expressions 

Use Lens Studio’s new facial expression tracking to drive blendshapes on 3D models.

Foot Tracking

In partnership with Wannaby, we’ve created a foot tracking template powered by their ML model that allows anyone to easily create Lenses that interact with your feet!


Additional Updates


New Update, New Look

We’ve updated Lens Studio’s UI and added two themes to make it easier to customize and navigate. 

Procedural Texture

Access and create textures from script with Procedural Texture.

Color Shadows

Grey Shadows be gone! Use any color of the rainbow to add depth to your Lens.

3D Eyeball Tracking

Replace or augment eyes in full 3D, including realistic gaze tracking.

More Material Editor Nodes

Further customize your materials with new matrices, arrays, and lighting nodes!

Happy creating!

Team Lens Studio