Lipsync-1.8.0-beta in research preview

Lipsync-1.8.0-beta in research preview

We bought a ton of gpus + baked a new zero-shot model that works on any video in the wild.

It's our best yet, by far.

A lot of you asked us to generate better teeth. well, we did.

Challenge is our old approach wouldn't let us achieve this.

So, we went back to the drawing board + experimented w/ some newer techniques, which needed more compute.

1.8.x marks the beginning of a new class of models entirely.

Technical updates:

  • better w/ details — matching skin tones, and consistent lip color
  • generate high quality, natural looking teeth
  • smooth, temporally consistent lipsync
  • generates ~1.6 frames per sec rn, will optimize soon

available now to users on the playground.