rudrabha

rudrabha

Rudrabha Mukhopadhyay is co-founder and CTO of sync. labs. He co-authored Wav2Lip, the open-source research project that helped define zero-shot lip sync and has earned 13k+ GitHub stars. sync. labs grew out of that research foundation. Rudrabha writes about lipsync models, speech-driven video generation, visual dubbing, and the technical work behind making translated video feel natural.

Audio-Visual Face Reenactment
research

Audio-Visual Face Reenactment

An identity-aware talking head video method that combines a dense motion field from learnable keypoints with audio conditioning on the mouth region, and ships state-of-the-art results across unseen faces, languages, and voices.

A lip sync expert is all you need
research

A lip sync expert is all you need

Wav2Lip uses a pretrained, frozen lip-sync discriminator to push speech-to-lip generation into unconstrained, in-the-wild video, and introduces the LSE-D and LSE-C benchmarks the field still uses today.

Speaking styles for lip-to-speech synthesis
research

Speaking styles for lip-to-speech synthesis

We release Lip2Wav, a 120-hour single-speaker dataset, and a new architecture that learns individual speaking styles to generate natural speech from lip movements, four times more intelligible than prior work.

Back to Blog