Research

Papers and deep dives from the sync. labs research team, from Wav2Lip and lip-to-speech synthesis to how AI lip sync models work under the hood.

4 posts

research

How AI lip sync actually works

The architectures, the training trick that changed the field, and the failure modes nobody talks about. An honest look at what modern AI lip sync models are doing under the hood.

28 May 2026 · 7 min read

research

Audio-Visual Face Reenactment

An identity-aware talking head video method that combines a dense motion field from learnable keypoints with audio conditioning on the mouth region, and ships state-of-the-art results across unseen faces, languages, and voices.

6 Oct 2022 · 1 min read

research

A lip sync expert is all you need

Wav2Lip uses a pretrained, frozen lip-sync discriminator to push speech-to-lip generation into unconstrained, in-the-wild video, and introduces the LSE-D and LSE-C benchmarks the field still uses today.

23 Aug 2020 · 1 min read

research

Speaking styles for lip-to-speech synthesis

We release Lip2Wav, a 120-hour single-speaker dataset, and a new architecture that learns individual speaking styles to generate natural speech from lip movements, four times more intelligible than prior work.

17 May 2020 · 1 min read

Back to Blog