Skip to content

Releases: radekd91/emoca

EMOCA-v2.0.0

14 Feb 15:55
Compare
Choose a tag to compare

Release of EMOCA v2

New retrained of EMOCA that performs much better. Compared to the original model it produces:

  1. Much better lip and eye alignment
  2. Much better lip articulation

This is achieved by:

  1. Using a subset of mediapipe landmarks for mouth, eyes and eyebrows (as opposed to FAN landmarks that EMOCA v1 uses)
  2. Using absolute landmark loss in combination with the relative losses (as opposed to only relative landmark losses in EMOCA v1)
  3. Incorporating perceptual lip reading loss. Inspired by spectre. Big shout-out to these guys!

You will have to upgrade to the new environment in order to use EMOCA v2.
This includes:

  • switching to Python 3.8
  • updating pytorch and pytorch3d
  • upating minor packages

Please follow the steps in the README

EMOCA v1.0

14 Feb 15:46
Compare
Choose a tag to compare

The release of the code and model published in the original paper.