Adapting characters to use real-time facial capture | Unreal Engine

  προβολές 19,957

Unreal Engine

Πριν 27 ημέρες

The Live Link Face app streams high-quality facial animation in real time from your iPhone directly onto characters in Unreal Engine. But on some occasions, the characters where we hope to transfer these animations do not fully comply with the basic recommendations, although with some ingenuity we can solve this.
In this video we will take advantage of the Meerkat demo project to animate this adorable pet developed by Weta Digital.

Σχόλια
Wistbacka
Wistbacka Πριν 15 ημέρες
If only Epic put like 1% of this effort into improving their game store, it too would be amazing. Now it's a clunky mess. Seriously impressive stuff shown here.
peter
peter Πριν 21 ημέρα
i got a very hard time follwing this. english is not my native language so the way he speaks becomes even harder :(
MC Songs by MC Jams
MC Songs by MC Jams Πριν 21 ημέρα
Wtf is he saying? 😛
Turgay Algül •15 yıl önce
Turgay Algül •15 yıl önce Πριν 23 ημέρες
Ue5 pls
Wibu Sableng
Wibu Sableng Πριν 24 ημέρες
this is What happen To Vtuber Code Miko and AI Angel
Aug Litv
Aug Litv Πριν 22 ημέρες
CodeMiko used a whole suit for about 30k
U Ja
U Ja Πριν 25 ημέρες
Do you have to have iphone 12 or can you do this with iphone 10 also?
Fractured Fantasy
Fractured Fantasy Πριν 22 ημέρες
iPhone x works... general rule of thumb is any iPhone without the "thumb button". I also have this working with iPad Pro 3 & 4. Demo here if you're interested: grpost.info/will/t55_Y8RobpGrcpM/b-nteo&
One Of Many
One Of Many Πριν 25 ημέρες
Does it only support iPhones? Or is there a way to use this tech without supporting chinese sweatshops and child slavery? www.barnorama.com/wp-content/uploads/2020/01/the-best-part-of-the-golden-globes-is-the-memes-making-f_020.jpg
Jacob Garbarz
Jacob Garbarz Πριν 25 ημέρες
This is hilarious, I’m about to run it
TheAmoscokkie
TheAmoscokkie Πριν 26 ημέρες
so far this is UE4 best features that do not need to rely on other external tools. This is then the right concept of selling UE4 apart from the recent short film event in Australia.
Brian Clarkson
Brian Clarkson Πριν 26 ημέρες
Great tutorial. Very clear and easily understood. Very creative.
WhatMyNameIs
WhatMyNameIs Πριν 26 ημέρες
You should've included that it used an iPhone in the title. Hype == LetDown = true
Brian Clarkson
Brian Clarkson Πριν 26 ημέρες
He did tell us in the beginning of the tutorial.
Huang Ti
Huang Ti Πριν 26 ημέρες
when I create a human character to animated with blendshape and Niagara grooms,and the model are poke,grooms cannot drive correctly with blendshape, how could I fix this issue?
zorakbane
zorakbane Πριν 27 ημέρες
Does this work with a webcam?
Brian Clarkson
Brian Clarkson Πριν 26 ημέρες
No you need a iPhone X or later.
Mike Johnson
Mike Johnson Πριν 27 ημέρες
By the time you retarget the blendshapes/morph targets to the character, it looks like you get 5-10% movement. In order to fully take advantage of this tech, you need to blow out the blendshapes to 200% or more (play with it). So by the time you have it retargeted, there's a closer 1:1 ratio of movement on the character.
Mike Johnson
Mike Johnson Πριν 15 ημέρες
@LPNP I've tried to look up motion smoothing, for UE4 and nothing comes up. Is it called something else? Theres a motion smoothing SteamVR but thats it and it looks like its for cameras.
Christian Andrade
Christian Andrade Πριν 26 ημέρες
For sure. There are many things that can be done, including adding other blendshapes that use the same curve as another. And yes, all curves can all be calibrated or overexposed manually. But in the video it was tried to keep everything simple to be able to comply with the time, but it can definitely be explored in more detail on twitter or another medium in the future.
LPNP
LPNP Πριν 27 ημέρες
That's the motion smoothing. You can reduce this in unreal at the expense of a little jitter.
Feeding_Wolves
Feeding_Wolves Πριν 27 ημέρες
This is awesome!!! I just followed along. Is there going to be a continuation of this?
Raun Carswell
Raun Carswell Πριν 27 ημέρες
ComparetheMeerkat. Now made even more Simples.
kelvin martinez
kelvin martinez Πριν 27 ημέρες
Ooh look is a meerkat..
Reginald Armah
Reginald Armah Πριν 27 ημέρες
The instructor has a funny accent.
Christian Andrade
Christian Andrade Πριν 26 ημέρες
@LPNP gracias!
LPNP
LPNP Πριν 26 ημέρες
@Christian Andrade i think you did a great job. I am spanish so it may have been easier for me, but i think you were clear. I learned a lot from this presentation.
Christian Andrade
Christian Andrade Πριν 26 ημέρες
Haha, yep, I don't usually speak long sentences in English. When I heard it in edit it seemed like a kind of text-to-speech software with a strange accent. yep, I need to practice my speaking more.
Christian Andrade
Christian Andrade Πριν 26 ημέρες
@LPNP Lol, Ecuador really, but from a region that speaks with an accent similar to Mexican. yep, I have to practice my speaking more :D
LPNP
LPNP Πριν 27 ημέρες
I'm not sure where he's from, but I would guess Mexico. I love the trill on his Rs.
FUN BBTV
FUN BBTV Πριν 27 ημέρες
waow..i'm impressed :) too bad i don't have the latest iphone :(
Fredrik Ekholm
Fredrik Ekholm Πριν 16 ημέρες
You don't need the latest iphone, it works with iphone X and later.
Braindrain
Braindrain Πριν 27 ημέρες
Well, I don't have an iPhone :-/
Misvnthrope
Misvnthrope Πριν 27 ημέρες
Very easy to understand. Good Tutorial 👍🏼
Polygon Hive - Make Your Game
Polygon Hive - Make Your Game Πριν 27 ημέρες
Unreal... making meerkats talk! 😅
Sigrid
Sigrid Πριν 27 ημέρες
Didn't Epic Games acquire Hypersense? Wasn't Hypersense working on something like this that worked on Android?
Swapnil Nishad
Swapnil Nishad Πριν 27 ημέρες
The outro was very funny !!!
4Folhas Games
4Folhas Games Πριν 27 ημέρες
I think this squirrel is in the uncanny valley. Using morphs in linear situations is very good, but in real time I think it is better to put 200 bones on the face.
4Folhas Games
4Folhas Games Πριν 26 ημέρες
@Christian Andrade When I have more time I will dedicate myself to a project. I want to take Blender and modify it to name each vertex, so I can put a bone in each vertex and use the mesh deformations more precisely. Because bones are not too heavy for the computer, I think using heavy weight paint is already oversized. Then another problem will happen, handling a file with 50 000 bones. You will need to change the layout of the unreal to organize.
4Folhas Games
4Folhas Games Πριν 26 ημέρες
@Christian Andrade It is interesting for those who are studying to understand that sometimes the same model does not work for different situations.
4Folhas Games
4Folhas Games Πριν 26 ημέρες
@Christian Andrade This model is very good, in the video tech demo it was very good because it is just a video. In live action it was strange it was not made for live.
Christian Andrade
Christian Andrade Πριν 26 ημέρες
Yep, as mentioned in the video, that mesh was not designed to be animated with face mocap. So only one way of doing it was improvised. A more realistic model that can be animated with the Arkit SDK requires 51 morph targets. This one didn't even have 14 functional
Free 3D channel
Free 3D channel Πριν 27 ημέρες
Wow! Super-cool! Thank you!=)
Chiaka Chima
Chiaka Chima Πριν 27 ημέρες
Very cool info and funny 😆😆
nanohawk 001
nanohawk 001 Πριν 27 ημέρες
hahaha it's really good
lordraz m
lordraz m Πριν 27 ημέρες
14:45 hahahaha its good
FlamingoX
FlamingoX Πριν 27 ημέρες
Everyday, I get more and more scared. Unreal has meerkats now... and they can talk 😳
JSFILMZ
JSFILMZ Πριν 27 ημέρες
hakuna matata
Coding Panda
Coding Panda Πριν 27 ημέρες
Please support me
YT-CesarB !
YT-CesarB ! Πριν 27 ημέρες
Lips do not match the words
Christian Andrade
Christian Andrade Πριν 27 ημέρες
As mentioned in the video, in this specific mesh, facial blend shapes are not compatible with the requirements of the 51 facial curves required by Arkit SDK. This is something that could be a limitation since there are many character assets that do not have more than a limited number of blends shapes. However, this is not a limitation as there are ways to take advantage of some of these deformers and make the mesh move. And that was what was done in this video. If you are looking to have much more control of the movement, even at the lip sync level, I would recommend trying the Face Ar sample or adding the blendshapes in an external 3D DDC tools
Coding Panda
Coding Panda Πριν 27 ημέρες
Please support me
Coding Panda
Coding Panda Πριν 27 ημέρες
First
Panzer Of The Lake
Panzer Of The Lake Πριν 27 ημέρες
@Coding Panda stfu
Coding Panda
Coding Panda Πριν 27 ημέρες
Please support me
Learn Unreal Engine for Blender Users - UE4 Beginner Tutorial
2:08:33
Animating with Control Rig in 4.26 | Inside Unreal
3:01:32
Immune - Da Luz (Official Audio)
3:08
Barcode Entertainment
προβολές 363K
Dani Gambino - 131X (Official Music Video)
3:44
Elite Musik
προβολές 434K
MELISSES "Το πιο τραγανό φιλί" / Serenata
0:52
Kako - Κελί ft. Άρρωστο πνεύμα
3:27
Kakoithis Bdc | xTp
προβολές 62K
Create Your Face (Blender Tutorial)
23:34
Default Cube
προβολές 524K
A Guided Tour of Gameplay Abilities | Inside Unreal
3:21:28
Rough Introduction To Quartz Unreal Engine Subsystem (UE4.26)
34:55
Unreal Engine 4 Beginner Tutorial: Getting Started
1:04:10
Immune - Da Luz (Official Audio)
3:08
Barcode Entertainment
προβολές 363K
Dani Gambino - 131X (Official Music Video)
3:44
Elite Musik
προβολές 434K
MELISSES "Το πιο τραγανό φιλί" / Serenata
0:52
Kako - Κελί ft. Άρρωστο πνεύμα
3:27
Kakoithis Bdc | xTp
προβολές 62K
[EN] Free Fire Europe Pro League Season 2 - League Circuit Day 8
2:19:51
Free Fire Europe Official
προβολές 79K
BOOGIE BOMB Imposter Role in Among Us
15:04
SSundee
προβολές 2M
Ultimate in Chest in Chest...LoL Daily Moments Ep 1399
16:45
I Paid A BUILDER To FIX COW TOWN! (Minecraft)
9:41