Skip to content

Creating a custom Viseme animation to get result of 2D SVG output like "redlips_front" #2377

@azatech

Description

@azatech

I'm looking to create custom viseme animations for lip syncing in my project.

Am I understanding the process correctly for creating an SVG with a custom 2D avatar?

To create my own viseme animation similar to 'redlips_front' - FE: 'bluelips_front', I'll likely need to follow these general steps:

  1. Do I need to design the visemes - the specific lip shapes or visemes for the phonemes (all 22 visemes in our case)?

  2. Do I need to design animations of visemes - create a sequence of frames or keyframes that animate the lips transitioning between the different visemes smoothly?

  3. Next step is exporting the animation... Do I need to directly use my previously created animations with the Azure response.json? And Iterate one by one...
    json from actual Azure API:

[
  {
    "offset": 50.0,
    "id": 0
  },
  ....

3.2. I couldn't find where to submit (FE: to Azure API to pass/create new type: 'bluelips_front')? Is it possible?

P.S. In the end, I want to get an SVG animated output (just like with "redlips_front" now).
Please advise on how I can create an avatar (using visemes + design)

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestfutureIssue has been reviewed by the team and is eligible for addressing in the future.text-to-speechText-to-Speech

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions