If you own a copy of Magix Vegas (previously Sony Vegas), you can use this script to visualize Rhubarb Lip Sync’s output on the timeline. This can be useful for creating lip-synced videos or for debugging.
Copy (or symlink) the files in this directory to <Vegas installation directory>\Script Menu. When you restart Vegas, you’ll find two new menu items:
-
Tools > Scripting > Import Rhubarb: This will create a new Vegas project and add two tracks: a video track with a visualization of Rhubarb Lip Sync’s output and an audio track with the original recording.
-
Tools > Scripting > Debug Rhubarb: This will create markers or regions on the timeline visualizing Rhubarb Lip Sync’s internal data from a log file. You can obtain a log file by redirecting
stdout. I’ve written this script mainly as a debugging aid for myself; feel free to contact me if you’re interested and need a more thorough explanation.
You cannot perform lip sync directly from the Vegas scripts. Instead, run Rhubarb Lip Sync from the command line, specifying the XML output format.
Select Tools > Scripting > Import Rhubarb. Fill in at least the following fields:
-
One image file: You need a set of image files, one for each mouth shapes. All image files should have the same size and should end with “-<mouth shape>”, for instance alison-a.png, alison-b.png, and so on. Click the “…” button at the right of this field and select one of these image files. The script will automatically find the other image files.
-
XML file: Click the “…” button at the right of this field and select the XML file created by Rhubarb Lip Sync.
Click OK to create the animation.