Enzo: Real-Time Filmmaking in UE5 with Mesh to Meta Plugin BTS | Part 6: Facial Motion Pipeline

Link to our short film Enzo: https://youtu.be/psw2M94h_aA

This is the sixth part of the behind the scenes, where I share the pipeline I used in order to get Enzos facial motion performances into UE5. Enzo was brought to life using the mesh to metahuman plugin by @3Lateral & @Epic Games in @Unreal Engine 5.

I captured the face and body performances using the Mark IV HMC by @Facewarewith the @Xsens & @MANUS™ integration. The Mark IV communicated with a Kipro using a @Teradek transmitter and receiver which then communicated with Facewares software, Shepherd.

I then streamed the performances into UE5 using the @Glassbox Tech Live Client plugin. And all of this is powered by a @Puget Systems workstation capable of running everything on a single machine.

Enzo came from the original character @Tomas Sackmann created for his course on @cgcircuitLLC using @Maxon Zbrush, @Russian3DScanner plugin Zwrap, @Autodesk Maya, Mari & Mudbox and @Adobe Substance 3D

Special thank you to Simon Kay (@mocappys ), Josh Beaudry from Faceware, Norman Wang from Glassbox, Katie Jo Turk, Catarina Rodrigues, Arsène van de Bilt from Manus & Kelly Shipman from Puget Systems. These incredible people took the time to help me get my Metahuman motion capture pipeline set up and working in Unreal.

And special thank you to @Max Warlond for sharing his Metahuman Lighting setup.

~ Links ~

3D Character Artist Tomas Sackmann
~ CGCircuit Course: https://www.cgcircuit.com/bundle-details.php?val=96
~ Youtube: https://www.youtube.com/channel/UC7YucqAo9NodNN1_mcJYLvA
~Artstation: https://www.artstation.com/sackmanntomas

Unreal Engine Artist Max Warland
~ Youtube: https://www.youtube.com/watch?v=uaQEZBFohJQ&t=0s
~ Artstation: https://www.artstation.com/warlond

00:00 Intro
00:20 Syncing
00:48 Mocap Hardware
01:17 Software Integrations
01:40 Recording & ROMs
02:08 Unreal Live Client Setup
02:43 Motion Logic Blueprint
03:09 Faceware Studio Setup
03:33 Creating a Profile
04:03 Motion Effects
04:48 Multiplier
05:23 Live Client Control Profile
06:47 Recording & Optimization in Unreal


#metahumans #meshtometahuman #ue5 #unrealengine5 #3dcharacter #digitalcharacter #epicgames #virtualproduction #mocap #metahumancreator #nvidiartx