Changelog¶
New v0.3.4-alpha - 2019-01¶
Dockerized core modules for easy setup and automatic IP configuration between modules
Bridge and GUI are now in a separate folder, following other modules, to accommodate Docker
Update ZeroMQ OpenFace to v2.1.0
Unity3D to 2018.2.20f1
New v0.3.3-alpha¶
Decent improvements in documentation! (v0.3.3.1: own videos .csv + Blender FACS sliders)
GUI in Jupyter Notebook working again with new code base
Deep Learning module Python file renamed to
main.py
for consistency
New/changes v0.3.2-alpha¶
Simplified sending receiving messages (
facsvatarzeromq.py
now takes care of encoding / decoding and adding timestamps)Timestamp of message receive and send per module (
if Python >= 3.7: time.time_ns(), else time.time()
)Timestamp unified as string (ascii), formatted as 100 nanosecond precision integer, across modules; Default message parts: topic (string - ascii), timestamp (string - ascii), data (JSON formatted string - utf8)
Performance improvement: Time taken for smoothing per message reduced (asynchronous): 11.90 +/- 6.91 milliseconds to 6.83 +/- 2.79 milliseconds (pandas –> direct numpy)
In progress: print() –> logger
process_facstoblend
module accepts folder argument for different AU –> Blend Shape conversionsOpenFace modification updated to v2.0.6
Directly integrated with FACSHuman
New v0.3.1-alpha¶
OpenFace v2.0.3
Eye movement based on eye gaze data
Multi-user data support
Multi-user animation in Unity3D
Unity3D (2018.1.7f1) scene in cafe
Scan folder and select (all) files with 1 command
Switch targeted user of AU data for DNN (through GUI)
Voice Activity Detection (VAD) to switch DNN user
Mix participant AU / head pose data with DNN generated
TODO vx.x.x¶
Module management (Between modules: hearthbeat, controller, synchronized start, etc)
Unreal Engine support
GUI:
Manage Docker containers and show status
As web app with Voila