The Only Blender Facial Animation & Lip Sync Tutorial You Need! — Transcript
Full transcript
- 0:00Hello everyone, how is everyone doing?
- 0:01My name is Deepak and welcome all of
- 0:03you to the Deepak Rafi Hindi YouTube
- 0:04channel. So first of all, I want to
- 0:05apologize to all of you. I haven't been
- 0:07active on YouTube for quite a few days.
- 0:09And there are many reasons, some
- 0:10personal, some other things. So, I
- 0:12apologize for that and I am trying to
- 0:14keep things consistent now. And I have
- 0:16received requests for many topics. So,
- 0:18it will be my endeavor to cover all
- 0:20those topics here. And all the previous
- 0:23part one, part two videos we have made,
- 0:26we will continue them, and along with
- 0:28that, videos have started being
- 0:30uploaded to our Blender Basic to
- 0:32Advanced new version course for our
- 0:34membership as well. So if anyone wants
- 0:36to join there, please do join. The fee
- 0:39there is only ₹ 150. So let's go guys
- 0:41, without any delay, let's start
- 0:43today's video. In today's video, we are
- 0:45going to talk about how we can create
- 0:47facial expressions in Blender.
- 0:50Basically, suppose you have any model
- 0:52and you want to customize it, create
- 0:55facial expressions, lip-syncing,
- 0:57blinking, and all that in your own way,
- 0:59then how can you do it? So without any
- 1:02delay, let's start today's video. And
- 1:05the second thing guys, if any of you
- 1:07need any type of 3D model, we have all
- 1:08models available. You can contact us on
- 1:11the number given below. So without any
- 1:13delay, let's start today's video.
- 1:15Alright guys, for now, first of all, I
- 1:17have Chintu's facial rig, which I have
- 1:18done separately. Videos for this will
- 1:20also be coming very soon. We will
- 1:22discuss this one later. For now, I will
- 1:24hide it because it has been created
- 1:25with the help of an add-on. So I will
- 1:27tell you about this later. Right now,
- 1:29you can see we have already created a
- 1:31shape key on this, which is basically
- 1:32for its lip-syncing. So I am going to
- 1:34tell you how you can also do such great
- 1:36lip-syncing. So without any delay,
- 1:38let's start today's work. So first of
- 1:42all guys, see, the model you have,
- 1:43basically if you look at it carefully,
- 1:44you need to pay a lot of attention to
- 1:45two or three things in it. The first
- 1:48thing is that, look, this model of
- 1:49yours should be an entirely single
- 1:51object. If it is not a single object,
- 1:53it is possible that your lip-syncing
- 1:55may not look that good. But do you know
- 1:57what the problem is sometimes? The
- 1:59problem is not whether it is a single
- 2:00object or not. Sometimes it happens,
- 2:02let's assume it is a single object. Now
- 2:03, let's say I have created its
- 2:05lip-syncing. So, in that, I also need
- 2:07to move its teeth. I also need to move
- 2:09its tongue, so how will I move it? For
- 2:12that, I have already found a very good
- 2:13way, so to speak. In that way, you can
- 2:16do it very perfectly. So, first of all,
- 2:19I will do one thing: I will join the
- 2:21neck that I had detached from here so
- 2:23that everything looks excellent.
- 2:25Alright. Okay? Now it looks right. All
- 2:28good. Perfect. So, first of all, I will
- 2:30tell you what I have done in this. If
- 2:33you come here into my Object Data
- 2:35Properties, you will see that if you
- 2:37select "teeth bottom," the bottom teeth
- 2:39are selected. And if I select this, the
- 2:42top teeth are selected. I will show you
- 2:45by selecting this mesh and pressing
- 2:48Ctrl + H to hide it, then you will see
- 2:51I have already made these, the bottom
- 2:54and the top, into what already? I have
- 2:58kept them created in vertex groups. Now
- 2:59, what is the reason for this? Why have
- 3:01I created vertex groups? The reason is
- 3:03that this makes it easier for us to
- 3:05select things. So now I will tell you
- 3:07how. For now, first I will turn off my
- 3:09X-ray mode and remove whatever shape
- 3:11keys are applied to it. Whenever you
- 3:14see, whenever you want to do
- 3:15lip-syncing on any object or any
- 3:16character, it doesn't matter if it's
- 3:18human or non-human. It makes no
- 3:20difference. So what do you need to do?
- 3:21You just need to come into your Object
- 3:23Data Properties. And after coming into
- 3:25the Object Data Properties, you just
- 3:27need to click on the Shape Keys section
- 3:29here and add your first key. So, our
- 3:32first key is our basis key. What is a
- 3:34basis key? Basically, it is what holds
- 3:37our basic shape. You have to keep this
- 3:39in mind. It holds our basic shape. So,
- 3:42in that, you will see that you don't
- 3:44even get many options here. Friends,
- 3:46when you click on 'New' here, you will
- 3:48see 'Key 1' written. Yes guys, this is
- 3:50'Key 1' where we will basically perform
- 3:53the deformation, and whatever
- 3:54deformation we do to this character, it
- 3:57will record it as is, and then we can
- 3:59use it in any way. So, what will I do
- 4:01first? I will double-click it to rename
- 4:04it. Let's say I name it 'Talking'.
- 4:07Let's use 'Talking' instead of 'Lipsync
- 4:09'. I have set it to 'Talking'. And
- 4:12after that, I will go into its Edit
- 4:13Mode. Pressing the Tab key. You will
- 4:15notice it lifting up slightly. So, what
- 4:17is the reason for it lifting up? Always
- 4:20keep one thing in mind: if there is any
- 4:22bone or armature inside your object, it
- 4:25will slightly deform from its position.
- 4:28So, if you don't want your object to
- 4:30move from one place to another, you can
- 4:33turn off all the armatures. For now, it
- 4:35doesn't really matter. So, I am not
- 4:37worrying about it, and I will press Tab
- 4:39. It went up a little in Edit Mode.
- 4:41That's not a problem. Then, what will I
- 4:43do first? Basically, I will press 3 to
- 4:45go into Face Mode. Or you can go there
- 4:48manually. Then I selected this part and
- 4:50this part. Now, as I try to move it by
- 4:53pressing 'G', it is very difficult to
- 4:55move this mesh. But if I go up here, we
- 4:58have 'Proportional Editing'. If I turn
- 5:01it on, you will see that I can pull it
- 5:03easily. Now, with the scroll wheel, I
- 5:05can adjust the Proportional Editing
- 5:07size. But there is still a big problem
- 5:09here. The problem is that it is pulling
- 5:11like this. In this way. Now, what
- 5:12should be done about this? Why is this
- 5:14happening? Because, look, there are two
- 5:16types of Proportional Editing. One is
- 5:18Normal Proportional Editing, and the
- 5:20other is Connected Only Proportional
- 5:21Editing. So, what is it currently set
- 5:23to? It is set to 'Normal'. If I go into
- 5:26its settings and click on 'Connected
- 5:28Only', then only the parts connected to
- 5:30this face will move. The whole thing
- 5:33doesn't move. So now, if I press 'G'
- 5:35and 'Z' to move it slightly downward,
- 5:37you will see that its lips are opening
- 5:39quite nicely. That looks awesome, by
- 5:41the way. So, I will open it from the
- 5:43bottom here as well. After selecting it
- 5:45like this, I’ll press G and open it
- 5:47upwards too. Something like this. Now,
- 5:50if I exit edit mode, you’ll see that
- 5:53when I move the value slider up and
- 5:55down, the mouth opens. There’s no
- 5:58issue, but the teeth aren't moving,
- 6:00which looks very strange. Now, what
- 6:02will I do? I'll go back into edit mode
- 6:04by pressing Tab. And you’ll see
- 6:06it’s quite difficult to select all
- 6:08the teeth here. And because of this, I
- 6:11had already created a set in the vertex
- 6:14group beforehand. Now, what will I do?
- 6:17I’ll select the top teeth and press G
- 6:20and Z to move them slightly upward.
- 6:23Similarly, I will select the bottom
- 6:25ones. Select them. After that, I’ll
- 6:27press G and Z to move them slightly
- 6:28downward. And the tongue inside, which
- 6:31should have been mixed with it but
- 6:33isn't. But now you’ll see, when I
- 6:36move it, look how smoothly it’s
- 6:38moving. If you still find any issues or
- 6:42problems, you can move things slightly
- 6:43to make them look better. It’s
- 6:46totally up to you how you want things
- 6:49to look. Here we go. So, I will lift it
- 6:52up just a little bit. Something like
- 6:55that. And as soon as you are done with
- 6:56proportional editing, turn it off
- 6:58immediately. I want the top teeth to be
- 7:00slightly visible. So, I’ll press G
- 7:02and Z. You can see the top teeth are
- 7:04now visible. And now here we go. Here
- 7:08we go. It’s looking quite great.
- 7:10It’s looking pretty good. And this is
- 7:12what we want, by the way. Alright. So,
- 7:15I think you have understood how we
- 7:17basically create the talking animation.
- 7:19Now, it doesn't matter which character
- 7:21you have, it makes no difference. You
- 7:23just have to use the process I have
- 7:26explained. Understood? So, I hope you
- 7:28understood how this works. This is how
- 7:31we can create lip-syncing for any
- 7:33object without any issues or trouble.
- 7:35Okay? Along with that, suppose I create
- 7:38a new one here. And then I will name it
- 7:42'Blink'. For example, I blinked here,
- 7:45and after blinking, now you will see,
- 7:47when I go back into its Edit Mode, here
- 7:49you can see we have this type of mesh.
- 7:53And along with this, we also have to
- 7:54keep in mind that its eyes are
- 7:56protruding slightly, so the rig we make
- 7:58for this should be better. So what I
- 8:02will do is, first I will select all
- 8:04these eyebrow faces, and by pressing
- 8:06Shift + H, I will hide everything else.
- 8:10Only these three remain. And by
- 8:11selecting these three, I will go to the
- 8:13modifier section, go to all tabs, and
- 8:15what will I do for all of these? What
- 8:16do you call it? I will turn off the
- 8:18armature modifier. The benefit of this
- 8:19for me will be that when I go into Edit
- 8:21Mode, it won't move. It will stay in
- 8:23its place. For now, I don't need the
- 8:24eyebrows either. So I will hide them.
- 8:26Just I need only this one. So what do I
- 8:28have to do? Go here and make sure you
- 8:30are inside the blink one. Not inside
- 8:32the talking one. So you will go into
- 8:34Edit Mode and select this entire
- 8:35section. And if your model is fully
- 8:39symmetrical, meaning both sides are the
- 8:41same, then you can turn on this X here.
- 8:45So if you work on one side, it will
- 8:46automatically start working on the
- 8:48other side. So my model is already
- 8:50symmetrical, so I will use this, and
- 8:52after that, by pressing S and then Z, I
- 8:54will set it like this, first in this
- 8:56way. Then I will bring it out a little.
- 8:59That is super important somehow, in
- 9:01some way, like this. And that looks
- 9:03awesome by the way. And look, a very
- 9:05good feature of Shape Key is that you
- 9:07can modify it however you want
- 9:08according to your needs. And this is
- 9:11what I love about the Shape Key. I
- 9:13really like it, to be honest. So this
- 9:15is the best thing about it. If, let's
- 9:18say, I scale it a little bit here.
- 9:21Let's do one thing. Let's set a bit of
- 9:22control. A little more, so I made it
- 9:25slightly smaller on purpose. A little
- 9:27more, a little more, just keep it this
- 9:28much. Now I will manually select it
- 9:31myself and bring it down slightly. Like
- 9:34this, so what is happening with this?
- 9:36Basically, I am able to maintain the
- 9:38shapes of my eyes according to my
- 9:40preference. Look at this, this is what
- 9:42we want. This is the beauty of shape
- 9:46keys, that we can modify or move them
- 9:48however we want. And here we go. You
- 9:52will see that it takes a little bit of
- 9:54effort, but it is a one-time task.
- 9:56It’s a one-time job. Once you have
- 9:58done this. Then after that, you won't
- 10:00need to put much effort into it. So
- 10:03that we have to understand every time.
- 10:06So here we go. For now, this sharpness
- 10:10looks a bit off, so I will push it
- 10:11inward so it gets fixed. And I will
- 10:14push this one inward a little bit too.
- 10:16Something like that. And I need to
- 10:17remove the sharpness. So I need to
- 10:19bring this part out a little bit to
- 10:22create volume. And here we go. We have
- 10:26created a little volume. So you just
- 10:29have to pay attention to these things.
- 10:31Other than that, there is no such
- 10:32problem or trouble. And now you will
- 10:34see that the blink is working properly.
- 10:38If you feel that something is wrong,
- 10:40just fix it wherever it seems off. Okay
- 10:42. Right. Press G twice. Press G twice
- 10:45to move it back a bit. Press G twice to
- 10:47move it back a bit. Press G twice to
- 10:49move it back a bit. A little bit back,
- 10:51we will push this part inward slightly.
- 10:54It will look better with a bit of
- 10:56smoothness. Here we go. So wherever you
- 11:00feel that things don't look right. And
- 11:02here, it is totally a matter of time.
- 11:05It is all about time here, how you have
- 11:07to fix it or not. So you have to
- 11:10totally understand that. Alright? Now,
- 11:12let's talk about the eyebrows. So watch
- 11:14carefully how to do the eyebrows. Let's
- 11:15select both of them. We will press
- 11:17Shift again. Now look, first I will
- 11:19select the eyebrows, and since I have
- 11:21already selected both together, I will
- 11:23press P and separate by loose parts, so
- 11:25both will be separate. This is separate
- 11:27, and this is separate. Now you have to
- 11:29play the game very smartly here. You
- 11:31have to go into Edit Mode. Press A to
- 11:33select your eyebrows. After that, you
- 11:35have to select your eyes. And here you
- 11:37will see that when I go into edit mode,
- 11:39these eyes automatically close. So,
- 11:41what do you just need to do? You need
- 11:42to Ctrl + J this with this. And when
- 11:45should you do Ctrl + J? Select your
- 11:46eyebrow, and before that, select it in
- 11:49edit mode. Why am I doing this? There
- 11:51is a reason for it. I will select the
- 11:52eyebrow first. Then I will select this.
- 11:54I will press Ctrl + J. Now, as soon as
- 11:56I pressed Ctrl + J, you will see that
- 11:58the eyebrow has vanished somewhere. It
- 12:00has disappeared somewhere. Somehow you
- 12:02will see. But if you look, it is right
- 12:04there. Why did this happen? Because
- 12:06look, the texture that was inside it
- 12:08basically disappeared from it. So, we
- 12:09don't care about that. What do we need
- 12:11to do? Just take it out. This is a very
- 12:13large eyebrow, basically, and we need
- 12:15to bring it down. And what do we need
- 12:16to do with it? Scale it in this way.
- 12:19Because the texture that is basically
- 12:21inside it, I will bring that back later
- 12:23. But first, I need to set it according
- 12:25to the eyes. Something like this, and
- 12:28it doesn't even have to be set
- 12:29perfectly. Roughly, you have to set it,
- 12:31and you will see that your work is done
- 12:33. You won't even notice. Okay? But now,
- 12:35we need to apply the texture to it. So,
- 12:37we will go here into the materials, and
- 12:39these are the baby eyelashes. We need
- 12:40to assign this. Now, as you go to
- 12:42assign it, you will see that nothing is
- 12:44visible here. This is because I have
- 12:46joined it with this. So, the UV of your
- 12:48eyebrow has basically been shifted. So,
- 12:51what will we do? We will bring the
- 12:54eyelashes out from here. There they are
- 12:56. Now, I will select this. One second,
- 13:01let's look at it in the front view and
- 13:02top view once. I will normalize
- 13:05whatever I have here. I will press U
- 13:08and do "Project from View". So, my
- 13:09eyelashes have appeared. I will select
- 13:11it by pressing A, something like this,
- 13:13and you will see that the eyelashes
- 13:15have started appearing here. So, let me
- 13:17try to unwrap it normally once first,
- 13:20and angle-based...yes, angle-based is
- 13:22coming out better. So, I placed it
- 13:25somewhere here and set it somewhere
- 13:27here. I think it has flipped. Down
- 13:30there, like that, for now, I have
- 13:33roughly set it, something like this.
- 13:38And here we go, so you're getting some
- 13:40issues on the sides, like this. So now
- 13:44the texturing part remains, but I've
- 13:46shown you one already because the video
- 13:48is already getting too long, so I won't
- 13:50show the second one. So here is our
- 13:52eyebrow, and now you will see, as soon
- 13:53as I select it, look at its average,
- 13:55it's moving perfectly with it. So this
- 13:57is how we can do it. And if you want to
- 13:59make it even better, I mean this thing,
- 14:01then you will have to move it up a
- 14:03little bit like this. And look, its
- 14:05averages have become perfect. And here
- 14:07we go. Look at this. So these are going
- 14:10along with it. And basically, our
- 14:11blinking is also perfect now. One
- 14:13second, let me turn this off. Look at
- 14:16this. Okay? Now you might ask why it
- 14:18doesn't have that finishing touch?
- 14:19Because this finishing was still left
- 14:21to be done as we had already started
- 14:23working on the texture. We couldn't see
- 14:25it. And now that we can see it, we can
- 14:27set it here with a proper finish. There
- 14:30is no issue or problem with that. Yes,
- 14:32look, make it as perfect as you want to
- 14:36make it here. There is no such issue or
- 14:39problem. And here we go, it's working
- 14:42perfectly. Got it. So the second one
- 14:44will also be something like this. So
- 14:47alright guys, in this video we learned
- 14:49how we can do lip-sync for any
- 14:51character and also how to do blinking.
- 14:53So I hope guys you understood how this
- 14:56is done. And if you liked this video,
- 14:58then please like this video. Subscribe
- 15:00to our channel. We are now very close
- 15:03to 50k. Quickly get us to 50k. We are
- 15:05going to hold a huge giveaway. Okay,
- 15:08and also guys, if any of you want
- 15:10personal training for Blender, we
- 15:11currently have slots open for
- 15:13one-on-one personal training, so you
- 15:15can join. So yes guys, that's it for
- 15:18this video and okay, and to join, call
- 15:20us on the number given below and after
- 15:22discussing on the call, you will get
- 15:23complete one-on-one training for
- 15:25whatever you want to learn. It will
- 15:27just be you and me. There won't be any
- 15:28other person. We teach you personally.
- 15:31So whatever you want to learn, modeling
- 15:33, texturing, lighting, animation,
- 15:34everything, we teach that one-on-one.
- 15:36So that's all for this video, guys. See
- 15:38you in the next lesson. Until then,
- 15:39take care of yourself. Bye-bye, take
- 15:40care. Stay home guys and love you all.
About this transcript
This page contains the full transcript of The Only Blender Facial Animation & Lip Sync Tutorial You Need! by Deepak Graphics Hindi, generated from the public captions YouTube serves with the video. The transcript has 3,177 words across 431 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.
What you can do with it
Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to choose a caption track available on the video.
Free YouTube transcript tool
YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, caption language selection, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.