The Face Mesh resource provides a 3D mesh that will mimic the user’s facial expression in real time. It can be used anywhere a mesh may be used. For example, you can use the Head Binding component and the Face Mesh resource to add a 3D face mask on the user. Take a look at the Face Mesh Template for examples on how to use Face Mesh.
Adding a Face Mesh
You can automatically add a Face Mesh to a user's head by clicking
Add New > Face Mesh in the
Alternatively, you can add the resource alone by pressing
Add New > Face Mesh in the
You can then use this resource in the
Mesh field of a
Render Mesh Visual to display it in your Lens.
Face Mesh Customization
To change the setting of the Face Mesh, select the Face Mesh resource in the
Resources panel, and adjust its settings in the
You can set which Face in the camera drives the Face Mesh by setting the
Face Index field. The first face detected by the camera has a face Index of
0, and the second face has an index of
1, and so forth.
You can also specify which part of the Face Mesh should be rendered by enabling or disabling the
Eye Geometry or
Mouth Geometry checkboxes.
Hiding Parts of the Face Mesh
In some cases you may want to hide parts of the Face Mesh. You can do this by using an
Opacity Mask on a PBR material and use that material for the Face Mesh, similar to how you would on other meshes.
To create a PBR material, in the
Resources panel, press
Add New > PBR.
Then select your Face Mesh object in the
Objects panel, and in the
Inspector panel, set the material of the Render Mesh Visual, to be the new PBR material.
Then, in the
Resources panel, select the PBR material, and set its
Blend Mode to
Normal so the material can have transparency. Next, enable the
Opacity Texture checkbox and a
Texture field will be enabled.
You can set this
Texture field to your own texture. The texture should correspond to the Face Mesh UV, which you can find in the next section.
For example, if we use this mask:
The final Face Mesh will look like:
Download the Face Mesh UV
The Face Mesh UV file provides a reference on how 2D textures are applied to the Face Mesh. These textures can be used to modify how your Face Mesh appears. For example, you can use it to create an opacity mask texture to hide parts of the Face Mesh from appearing in your Lens as in the previous section, or create a normal map texture to add additional details to the Face Mesh. Take a look at the Materials guide for more information on how different textures can be used to create a material in Lens Studio.
Download the Face Mesh 3D model
You can also download a 3D model of the Face Mesh to view your content in other 3D softwares. For example, you can use it as a reference to paint on in softwares such as Substance Painter. Take a look at the Substance Painter texturing guide for more information on how to create textures to use on a material in Lens Studio.
At this time it’s not possible to replace Face Mesh object in the Lens Studio with other face mesh 3D models outside of the Lens Studio.
Still Looking for help?Visit Support