Turn Management

This module controls turn taking behaviors based on audio-visual signals from both of the user and the agent. They are implemented with voice activity detection (VAD) model and voice activity projection (VAP) model.

There are two sub-modules are implemented in this module:

• VAD-based backchannel (https://github.com/isir/greta/wiki/Backchannel-based-on-VAD)
• VAP-based turn-management (https://github.com/isir/greta/wiki/Turn-management-based-on-VAP)

Common installation

• Install conda or anaconda from https://www.anaconda.com/
• Install python3 (usually installed with anaconda but not for some reasons [e.g. Path to "python.exe" is not set globally])
• You can test it by loading Greta - Microphone - backchannel.xml from Modular.jar. If it is correctly installed, Greta will do some nodding to your utterance.