Post-Processing: Landmark Triangulation from Motion Capture¶

demonstration video coming soon...

Processing steps¶

Save videos to dedicated subfolders within project_root/recordings/ according to the naming convention outlined in Project Setup
Ensure that videos were synchronized when recording, or provide a frame_time_history.csv file so that caliscope can perform the synchronization during processing.
You may need to reload the workspace for the recordings to appear in the PostProcessing tab
Select which tracker you would like to apply
Click the Process button to begin the landmark tracking and triangulation.
3D landmark positions will be visualized and you can open the subfolder to inspect the landmark tracking on the recordings or to access the trajectory output files

Tracker Outputs¶

Current options for the tracker outputs are built on Google's Mediapipe and include pipelines for general Pose, Hands, and Face. The Holistic tracker combines all three outputs. While the Holistic tracker offers improved tracking of the face and hands compared to the Pose model, the number of points it supplies can quickly become unweildy (several hundred for the face). The Simple Holistic model filters out many of these points that may be extraneous to users primarily interested in gross skeletal movement.

Metarig Generation¶

For the Simple Holistic tracker you can generate a metarig configuration file. This will provide a set of parameters that can scale segments of a skeletal model based on the average distances between various landmarks throughout a dynamic calibration motion trial where the subject flexes and extends their joints with minimal camera occlusion.

With a more accurately scaled skeletal model, inverse kinematics can more successfully approximate the true movement.

Practical Recording Guidelines¶

Minimize motion blur
- motion blur can substantially compromise landmark recognition
- using a higher frame rate can reduce motion blur
- this will require more light to maintain good illumination