Technical Specifications

List of contents

• Animation
• Communication port
• Path
• Name correspondence between Greta modules and Java projects
• Abbreviations

Animation

Component	value
Face-body coordinate system	MPEG-4 FBA
Number of face parameters	66
Number of body parameters	196
Digrees of freedom (for each hand)	29

Body topology

Communication ports

(Last updated: 8 April, 2025)

Port	Connection (left: server, right: client)	Comment
1234	LM-studio - Mistral.py	when you run LLM locally
3150	meaning_miner_adapter_server.py - meaning_miner_adapter_client.py	MeaningMiner
4000		Conflict: Mistral, ASAP
4040	DeepGramFrame.java - DeepGram.py	DeepGram ASR
4444	opensmile_greta.py - realtime_PerceptNGen.py	ASAP, send/receive OpenSmile features
5000	OpenFaceOfflineZeroMQ.exe - any	send user's AU by OpenFace
5560	OpenFaceOutputStreamReader.java - RealTimePipeFinal.py	MODIFF, transmit user's AU by OpenFace to python
5561	RealTimePipeFinal.py - MODIFFFrame.java	MODIFF, send generated AU to java from python
5960	turnManagement.java - turnManager.py	TurnManagement, receive feedback from java in python
5961	turnManagement.java - turnManager.py	TurnManagement, send turn-taking behaviors from python to java
8087	SpeechRecognizerFrame.java - nothing	GoogleASR receiver
8088	SpeechRecognizerFrame.java - nothing	GoogleASR receiver
9000	mic_server.py - any	Microphone
9999	func_util.py - func_util.py	TurnManagement, communication within timeout process
50200	RealTimePipeFinal.py - "MICounselorIncrementalDA - Drinking.py"	MODIFF, ExternalTensorClient for DA, server1
50201	RealTimePipeFinal.py - "MICounselorIncrementalDA - Drinking.py"	MODIFF, ExternalTensorClient for DA, server2
61616	Broker.java - any	ActiveMQ

Path

Component	value	comment
FML/BML files	bin/Examples
Configurations	bin/Configurations
Python files	bin/Common/Data (bin/Scripts for ASAP module)
Batch files	bin/Common/Data
NVBG	bin/NVBG
charniak parser for NVBG	bin/charniak
CereProc lisence	bin/Common/Data/CereProc	not included in github
Character .ini file	bin/Common/Data/characters
External library .jar file	bin/Common/Lib/External
Face gestuary	e.g. bin/BehaviorRealizer/BehaviorLexicon/facelibrary.xml
Body gestuary	e.g. bin/BehaviorRealizer/BehaviorLexicon/gestuary_camille.xml

Name correspondence between Greta modules and Java projects

(Last updated: 24 April, 2025)

Menu group in Modular	Greta module in Modular	Java project	comment
Animation Filters - Face	Face Blender	MPEG4
Animation Filters - Face	Lip Blender	MPEG4
Animation Filters - Body	Body Blender	MPEG4
Player	Capture Controller	OgrePlayer
Planners	Behavior Planner	BehaviorPlanner
Realizers	Behavior Realizer	BehaviorRealizer
Inputs	FML File Reader	Intentions
Inputs	BML File Reader	Signals
Inputs	Body Head Noise	BodyAnimationPerformer
Inputs - Meaning Miner	MM FML File Reader	MeaningMiner
Inputs	MODIFF	MODIFF
Inputs	Rest_Pose_Setter	Signals
Outputs	Audio File Writer	Util
Outputs	FML File Writer	Intentions
Outputs	BML File Writer	Signals
Outputs	FAP File Writer	MPEG4
Outputs	BAP File Writer	MPEG4
Tools	FML Editor	Editors
Tools	BML Editor	Editors
Tools	Gesture Animation Editor	Editors
Tools	Hand Shape Editor	Editors
Tools	Face Library Viewer	Editors	class name in the Java project is FaceLibraryEditor
Network Connections	Greta Furhat Interface	GretaFurhatInterface
Dialogue - LLM	Mistral	LLM
Dialogue - DeepASR	DeepGram	DeepASR
Dialogue - TurnManagement	TurnManagement	TurnManagement

If you cannot find what you want here, you can find it with the following steps:

1. Open bin\Modular.xml
2. Check <item module="XXX" name="YYY" /> entry of your target module in <menu> block
3. Search <module name="XXX" style="ZZZ"> block by the module name
4. Check the object class path from <object class="greta.CCC.CCC..." lib_id="LLL">
5. Search the library definition with the key lib id="LLL"
6. From the <lib id="LLL" path="PPP">, the path is the project you should check in the Netbeans

Abbreviations

Abbreviation	full name	comment
BAP	body animation parameter	from MPEG-4 FBA
FAP	face animation parameter	from MPEG-4 FBA
APML	affective presentation markup language
FML	functional markup language	functional behavior (e.g., beat, smile)
BML	behavior markup language	raw-level behavior (e.g., head, gaze, gesture) and speech content
NVBG	nonverbal behavior generator	module for gesture generation
MI	motivational interview
MM	meaning miner	module for gesture generation
MODIFF-MI		adaptive facial expression