-
Notifications
You must be signed in to change notification settings - Fork 17
Gesture Editor
Brice Donval edited this page Jan 7, 2020
·
3 revisions
(Original Author: Dr. Jing HUANG)
This page shows the module about GestureEditorModule in Greta System.
It is used to build your proper Gestures (then defining in XML file).
- Arm position defines the gesture arm position by Symbolic value in gesture space.
- Hand Shape defines the hand shape key frame which is already defined in library.
- Hand Orientation defines the hand orientation by using different combination of directions.
- Curve Trajectory defines the trajectory for arm gesture by adding new key frames on the path.
- Expressive parameter defines the expressivity that can influence the variation of a whole gesture.
the gesture space using symbolic representations in 3 dimensions by McNeill sectors
- X: XEP, XP, XC, XCC, XOppC
- Y: YUpperEP, YUpperP, YUpperC, YCC, YLowerC, YLowerP, YLowerEP
- Z: ZNear, ZMiddle, ZFar
We define the expressivity as the manner of executing the gestures
We have modulated the quality of body movements by a set of expressivity parameters
We group these parameters into 3 sets:
- Gesture Volume controls the spatial variation of gestures;
- spatial parameter controls the variation of McNeill's sectors
- openness parameter changes the gesture form (elbow space) in IK
-
Sequential Variation controls the time based variation;
- Power uses various easing in-out functions
-
Power Variation allows us to further control the dynamism of these movements.
- Power also changes the postures. It means that a larger value of power influences more body parts.
- Generating New Facial expressions
- Generating New Gestures
- Generating new Hand configurations
- Creating an Instance for Interaction
- Create a new virtual character
- Creating a Greta Module in Java
- Integration examples
- Development guideline
- Naming policy
- Github repository
- Technical showcase
- Python integration
- Known issues
- Technical Specifications
- Pitfalls for Greta development
-
FML/BML
-
Tools
-
AUs from external sources
-
Large language model (LLM)
-
Automatic speech recognition (ASR)
-
Extensions
Nothing to show :)
- Incrementality
- Motion Capture to BAP values
- Interruptions
- Back Channels
- Appreciation Generator
- SSI Greta Integration
- TopicPlanner
- Shore
- Disco
- Watson
- Object node controller
- OSC communication for Unity
- 3D pose estimation from RGB camera through VAE (PFE-OpenPose-to-VAE-to-BVH)
- HOW TO CREATE BEHAVIOR SET
- Projects
- Signals