Launched this week
Audio Lip Sync Pro for Blender
Generate high-quality facial animations, direct from audio.
39 followers
Generate high-quality facial animations, direct from audio.
39 followers
Audio Lip Sync Pro is a tool for animators and modellers to generate high-quality lip-sync animations directly from audio clips. All processing is performed locally, no account, subscription, or network access is (or ever will be) required. Buy once, own for life! Currently, it supports meshes with ARKit blendshapes inside Blender (via the Video Sequencer). Releases for Unity and Maya are coming soon!
what this model you have trained takes as input and outputs ?
@ivan_telnov it's an internal model. I trained this a while back to use streaming codec features and I then repurposed it to use a larger model with a non-streaming codec. Currently it's only outputting standard ARKit blendshape values, I'm exploring using vertex/patch displacements for future versions.
You're solving a problem many AI generation models have not perfected yet. Good luck with your launch.
@richatsealedvaultthanks for your kind words! Each new version gets better and better.