Cryptomatte

Cryptomatte is a piece of open-source software created by Jonah Friedman and Andy Jones at Psyop. It is also used synonymously for the specific style of image created by the software or other software working alike.

Cryptomatte
Original author(s)	Jonah Friedman Andy Jones
Developer(s)	Psyop
Initial release	10 July 2016; 9 years ago (2016-07-10)
Stable release	1.4 / 3 May 2021; 4 years ago (2021-05-03)
Preview release	1.5.0.beta / 10 March 2021; 4 years ago (2021-03-10)
Repository	github.com/Psyop/Cryptomatte
Written in	Python, Lua
License	BSD 3-clause license
Website	github.com/Psyop/Cryptomatte

Top: The splash screen of blender 2.81 as rendered image
Bottom: The same scene as cryptomatte image view

Cryptomatte is a quasi-standard in the industry, because of its ubiquity, integration into popular 3D graphics software, and ease of use.

Render processing

The program itself creates an ID matte of a scene that can be used to create for example image masks for single or multiple objects in the scene. The ID matte has a very distinctive look and itself is sometimes referred to as cryptomatte. These cryptomatte images are in general very colourful assigning each object or material a different random colour. The program creates mattes that support motion blur, transparency and depth of field using data that is already available at render time.^[1]

Supported render engines

Cryptomatte images can be created by several 3D graphic programs like Blender,^[2] Autodesk Maya,^[3] Autodesk 3ds Max^[4] or Houdini^[5] and are usually exported using the OpenEXR file format.

Whether a program is able to generate a cryptomatte or not is determined by the render engine being used. If a program supports more than one render engine it is possible that it can generate cryptomatte images with one engine while being unable to do so with the other one. Blender, for example, had no option to create a cryptomatte image before version 2.80.^[6] With version 2.80, only the "Cycles" path-tracing render engine supported creating a cryptomatte whereas "Eevee", the newly added real-time render engine, did not. The support to create cryptomatte images was added to Eevee with version 2.92 that was published on February 25, 2021^[7] one and a half years after Eevee was first published.^[8]

The following render engines are known to support creating cryptomatte images:

Render engine name	Shipped with	Added with version
Arnold[9][10]	Autodesk 3ds Max Autodesk Maya	Arnold 5.2
Cycles[6]	Blender	Blender 2.80
Eevee[8]	Blender	Blender 2.92
Mantra[11]	Houdini	Houdini 16.5
Karma[12]	Houdini	Houdini 18.5
Modo renderer / mPath[13]	Modo[14]	Modo 14.2
Redshift[15]	Cinema 4D (CPU-only)	Redshift 2.6.11
3Delight[16]	Katana	3Delight 1.7.32[16]
Unreal Engine (Movie Render Queue)[17]	Unreal Engine	4.26
Radeon ProRender[18]		Radeon ProRender 3.1
Octane Render[19]
RenderMan[20]
V-Ray[21]

Supported compositing software

Compositing software name	Added with version
Autodesk Flame	2020[22]
After Effects	17.0[23]
Nuke	13.0[24]
Blackmagic Fusion	20
Blender (Compositing Nodes)	2.8
Houdini (COP)	16.5[11]
V-Ray (V-Ray Frame Buffer)	5 Update 1[25]
Adobe Photoshop	Exr-IO 2.0[26]
Gaffer	0.61.2.0[27]

Workflow example

In a 3D scene a cryptomatte image can be created that assigns a unique ID to each object. The objects usually also have distinct colours that make a scene with many objects very colourful. The ID matte can be used to pick one or more objects in a scene. The ID matte can either be exported or it can be used by the 3D software itself for compositing.

An example workflow would be to use the cryptomatte image to generate a mask that itself is used to limit an effect to only a certain part of the image. It can thereby be used to quickly create masks without the need of re-rendering a whole scene.

The example workflow for images:

• 
  A simple rendered 3D scene
• 
  The scene's cryptomatte view as image
• 
  A mask based on the cryptomatte image with the cube as selected object

The same workflow for video files:

• A simple rendered 3D scene
• The scene's cryptomatte view as image
• A mask based on the cryptomatte image with the cube as selected object
• The cryptomatte (top), rendered (middle) and mask view (bottom) combined

The masks in the examples can be used to limit a visual effect so that only the cube in the middle is affected.

Licensing

The developers published the program's source code and licensed it under the BSD 3-clause license "to turn it into an ecosystem around an open standard". Their goal was "to see a diverse ecosystem of renderers that can create Cryptomatte images and plugins for compositing applications to decode them".^[1]

See also

• Deep image compositing