-
Notifications
You must be signed in to change notification settings - Fork 17
Microphone
sagatake edited this page Sep 27, 2024
·
3 revisions
Microphone module to stream audio signals from one microphone to many modules.
- Install conda or anaconda from https://www.anaconda.com/
- Install python3 (usually installed with anaconda but not for some reasons [e.g. Path to "python.exe" is not set globally])
- You can test it by loading Greta - Microphone - backchannel.xml from Modular.jar. If it is correctly installed, Greta will do some nodding to your utterance.
- In Modular.jar, add Microphone module from Add->Input->Microphone
- Once you added the Microphone module, stream server is ready to connect (default protocol is TCP at port 9000 of localhost)
- You can modify the port number by replacing with your favorite number at the Microphone module in Modular.jar and press update button
- For more details, please check the following sources
- Microphone java project at https://github.com/isir/greta/tree/master/auxiliary/Microphone
- Python source code at https://github.com/isir/greta/tree/master/bin/Common/Data/microphone
- Generating New Facial expressions
- Generating New Gestures
- Generating new Hand configurations
- Creating an Instance for Interaction
- Create a new virtual character
- Creating a Greta Module in Java
- Integration examples
- Development guideline
- Naming policy
- Github repository
- Technical showcase
- Python integration
- Known issues
- Technical Specifications
- Pitfalls for Greta development
-
FML/BML
-
Tools
-
AUs from external sources
-
Large language model (LLM)
-
Automatic speech recognition (ASR)
-
Extensions
Nothing to show :)
- Incrementality
- Motion Capture to BAP values
- Interruptions
- Back Channels
- Appreciation Generator
- SSI Greta Integration
- TopicPlanner
- Shore
- Disco
- Watson
- Object node controller
- OSC communication for Unity
- 3D pose estimation from RGB camera through VAE (PFE-OpenPose-to-VAE-to-BVH)
- HOW TO CREATE BEHAVIOR SET
- Projects
- Signals