Differences

en:lipsync [2011/09/12 19:50] bobocat		en:lipsync [2021/10/28 09:36] (current)
Line 1:		Line 1:
		+	==== Lipsync ====
		+
	Lipsync is the process of animating a character's mouth to match spoken words.		Lipsync is the process of animating a character's mouth to match spoken words.
Line 5:		Line 7:
	For the Gamerotica welcome video, The character Trixi has lipsync animation at the start and end of the video. This Wiki page is a bit of a "post-mortem" on that process. Play the video below to see the finished result.		For the Gamerotica welcome video, The character Trixi has lipsync animation at the start and end of the video. This Wiki page is a bit of a "post-mortem" on that process. Play the video below to see the finished result.
-	<flashplayer width=368 height=272>file=http://cdn.help.thrixxx.com/lib/exe/fetch.php?media=en:howto:lipsync:lipsync.flv</flashplayer>	+	{{:en:howto:lipsync:lipsync.mp4}}
	**NOTE** Before attempting this process, you should be familiar with creating basic animation in the Pose Editor as well as video and sound editing using a video editing package. This is not a polished step by step tutorial for beginners and is presented as-is. However, it should give you a good head start if you are trying to do your own lipsync in 3D Sexvilla 2.		**NOTE** Before attempting this process, you should be familiar with creating basic animation in the Pose Editor as well as video and sound editing using a video editing package. This is not a polished step by step tutorial for beginners and is presented as-is. However, it should give you a good head start if you are trying to do your own lipsync in 3D Sexvilla 2.
Line 32:		Line 34:
	==== How to do it step by step ====		==== How to do it step by step ====
-	- Record your narration and edit it to the correct length. You want this to be FINAL before you start.	+	- Record your dialogue and edit it to the correct length. You want this to be FINAL before you start.
-	- Set up your model in the Pose Editor so you can see her face full on. Set at least one keyframe at the end of the fourth animation slot so that the animation will play all the way through. Hit the Play button in the Timeline bar and Record the video playing all the way through using Fraps. I found that starting the recording just before the end of the fourth section allowed me to easily find the first frame of the first section when I was editing. NOTE: It' better to do the lipsync as the first step before you do any other animation. Otherwise it will be difficult to see the mouth positions clearly.\\	+	- Set up your model in the Pose Editor so you can see her face full on. Set at least one keyframe at the end of the fourth animation slot so that the animation will play all the way through. Hit the Play button in the Timeline bar and Record the video playing all the way through using Fraps. I found that starting the recording just before the end of the fourth section allowed me to easily find the first frame of the first section when I was editing. NOTE: It's best to do the lipsync as the first step before you do any other animation. Otherwise it will be difficult to see the mouth positions clearly.\\
-	- Import the video into your video editing software. Trim the video to start at the first frame of the first section (of the Pose Editor timeline). Line up the audio so it starts a bit after the start to give yourself some breathing room. This will now be your master reference.	+	- Import the video into your video editing software. Trim the video to start at the first frame of the first section (of the Pose Editor timeline). Line up the audio so it starts a bit after the start to give yourself some breathing room. This will now be your master reference. (Optional but recommended: Do the "record your lips" step in the additional tips below)
	- Open up the Pose Editor and your video editing software so they are side-by-side. It helps if you have a dual monitor setup but it's not critical.		- Open up the Pose Editor and your video editing software so they are side-by-side. It helps if you have a dual monitor setup but it's not critical.
	- Scrub the video/audio in the video editing software to the first phoneme (E.g. "W" sound in "welcome")		- Scrub the video/audio in the video editing software to the first phoneme (E.g. "W" sound in "welcome")
Line 46:		Line 48:
	- add some facial expressions to compliment the lipsync		- add some facial expressions to compliment the lipsync
	- complete whatever other animation is required for your model		- complete whatever other animation is required for your model
-	- When you are finished, hit CTRL+ALT+G to hide the interface when you can record the final video.	+	- When you are finished, hit CTRL+ALT+G to hide the interface when you record the final video.
	==== Some lipsync settings for the Pose Editor ====		==== Some lipsync settings for the Pose Editor ====
Line 52:		Line 54:
	|{{:en:howto:lipsync:lipsync_cdg.png|}}|CDG position. Also works for A, L and T. With L and T put the tongue up to touch the inside of the top teeth. If you use this for E or S you can add some more smile to show more of the EEE teeth|		|{{:en:howto:lipsync:lipsync_cdg.png|}}|CDG position. Also works for A, L and T. With L and T put the tongue up to touch the inside of the top teeth. If you use this for E or S you can add some more smile to show more of the EEE teeth|
-	|{{:en:howto:lipsync:lipsync_fv.png|}}|FV position. This one pushes the jaw back to get that slight overbite|	+	|{{:en:howto:lipsync:lipsync_fv.png|}}|FV position. This one pushes the jaw forward to get that slight underbite|
	|{{:en:howto:lipsync:lipsync_ooo.png|}}|OOO position|		|{{:en:howto:lipsync:lipsync_ooo.png|}}|OOO position|
	|{{:en:howto:lipsync:lipsync_r.png|}}|R position. Also works for OOO|		|{{:en:howto:lipsync:lipsync_r.png|}}|R position. Also works for OOO|
Line 59:		Line 61:
	==== Additional Tips ====		==== Additional Tips ====
-	- **Film your lips** I did one other thing that was incredibly useful. I recorded a close-up of my own lips saying the words, ensuring that my lips matched as close as possible. I then took that video, cropped it and overlaid it on the reference video. This takes most of the guesswork out of what position goes where and allows you to see which positions flow into other positions. Of course, if you can film your original voice actor saying the lines with facial expressions that's even better.	+	- **Film your lips** I did one other thing that was incredibly useful. I recorded a close-up of my own lips saying the words, ensuring that my lips matched as close as possible. I then took that video, cropped it and overlaid it on the reference video. This takes most of the guesswork out of what position goes where and allows you to see which positions flow into other positions. Of course, if you can film your original voice actor saying the lines with facial expressions that's even better. Using a small mirror to see the shape your lips make works pretty good too.
	- **Use the Key Editor** Once you have a good setting for a particular phoneme, you can use the Key Editor to copy those keyframes to another place with the same phoneme. You can also slide keyframes around by selecting them and using the middle mouse button.		- **Use the Key Editor** Once you have a good setting for a particular phoneme, you can use the Key Editor to copy those keyframes to another place with the same phoneme. You can also slide keyframes around by selecting them and using the middle mouse button.
	==== Finishing Touches ====		==== Finishing Touches ====
	When you've completed your lipsync to your satisfaction, it's time to do the secondary animation. This is stuff like moving the head, body, etc. The best way to approach this is to ACT IT OUT. Animators are essentially actors. A really effective technique is to film yourself or someone else acting out the lines and then use that as reference for the animation. A small hand mirror can also be very useful.		When you've completed your lipsync to your satisfaction, it's time to do the secondary animation. This is stuff like moving the head, body, etc. The best way to approach this is to ACT IT OUT. Animators are essentially actors. A really effective technique is to film yourself or someone else acting out the lines and then use that as reference for the animation. A small hand mirror can also be very useful.
-