Motion Tracker

Regarding the translation

This document was translated by ChatGPT-4, and the content may contain inaccuracies.

PC/Mobile Application¶

Icon Buttons¶

Icon	Description	Face	Hands	Face + Hands
	Connection Settings	●	●	●
	Display Face/Hand Coordinates	●	●	●
	Display Video Feed	●	●	●
	Reset Face Parameters	●		●
	Face/Hand Settings	●	●	●
	System Settings	●	●	●
/	Hand Reference Position		●	●

Note

On the mobile version, face/hand settings are combined into the system settings icon.

About Hand Reference Position

The hand position XY represents the relative value of the icon's position. When the wrist is at the center of the icon, the position XY value is 0.
The hand recognition determines left or right hand based on the distance between the wrist and the left/right hand icons.

Connection Settings¶

Option	Description	PC	Mobile
Local	Directly connect when the application and EX are running on the same computer.	●
Remote	Enter the IP address of the computer running EX and the port number for EX remote access.	●
IP Address	The IP address of the computer running EX, viewable in the IP list in the EX Control Panel settings.	●	●
Port Number	The port number for EX remote access, which must be enabled in the EX Control Panel settings.	●	●
Find My Computer	Automatically locate the IP address and port number of the computer running EX. Requires enabling Network Discovery in the EX Control Panel.		●
Test Network Connection	Test whether the phone can connect to the network properly.		●

System Settings¶

Option	Description	PC	Mobile
Camera	Select the camera.	●
Frame Rate	Limit the maximum frame rate of the application.	●	●
Reset Pose When Tracking Lost	Reset the model's pose when recognition fails or the connection is interrupted.	●	●
Auto Reconnect	Reconnect automatically when the connection to EX is interrupted.		●
Display Debug Info	Show debug information on the main page.	●	●
Language	English / Simplified Chinese / Traditional Chinese / Japanese / Russian.	●	●
Interface Scaling	Adjust the size of the user interface.		●
Version Number	Display the application version number.	●	●
Backup	Backup mobile settings to the computer.		●
Restore	Restore settings from the computer to the mobile device.		●
Reset to Defaults	Restore the application to its default settings.	●	●

Face Settings¶

Option	Description	Applicable Parameters
Enable /	Enable the parameter.	All parameters
Invert	Invert the captured parameter values.	All parameters
Smoothing	Higher values result in smoother actions but with more delay.	All parameters
Sensitivity	Higher values make parameter values more sensitive to movements.	Angle XYZ, Position XYZ
Precision	Higher values result in greater parameter precision.	Eye Open/Close, Eye Wide/Narrow, Eye XY, Eyebrows, Mouth Open/Close, Mouth Shape, Pucker (Open/Close), Cheek Puff, Tongue Out
Range	Limit the range of captured parameter values.	Same as above
Sync to Right Eye	Synchronize blinking of both eyes.	Left/Right Eye
Sync to Right Eyebrow	Synchronize movement of both eyebrows.	Left/Right Eyebrow

About Smoothing

Smoothing controls the smoothness of model tracking. Higher values make movements smoother but slower, while lower values make the model follow movements more quickly and responsively.
For the head and body, reduce smoothing for Head XZ Position Z, and moderately increase smoothing for Head Y Position XY.
For facial features, reduce smoothing for Eye Blink, Eye XY, and Mouth Open/Close, while increasing smoothing for Eyebrows Y, Mouth Shape, and Eye Wide/Narrow.

About Range

Range restricts the maximum and minimum values of captured parameters, corresponding to the model's parameter range.
For example, if the eyes close too easily, try adjusting the maximum and minimum range values (shift the range to the left). Conversely, shift to the right if needed.
Since everyone's facial features vary, default values may not suit everyone. Adjust the settings to suit your specific needs.

Hand Settings¶

Option	Description	Applicable Parameters
Enable /	Enable the parameter.	All parameters
Invert	Invert the captured parameter values.	All parameters
Smoothing	Higher values result in smoother actions but with more delay.	All parameters
Sensitivity	Higher values make parameter values more sensitive to movements.	Angle XZ, Position XY
Recognition Delay	Delays the determination of hand recognition to filter recognition errors.	Left/Right Hand
Tracking Tolerance	Tracks continuous wrist movements to determine if the same hand is being tracked.	Left/Right Hand

SDK Version Comparison¶

SDK	PC	iOS	Android	Description
Mediapipe	●	●	●	Developed by Google, open source. Requires high device performance.
ULSee	●	●	●	Developed by ULSee, an early technology provider for Facerig. High performance with low device requirements.
ARKit		●		Developed by Apple, currently the most accurate and high-quality solution. ※ Only runs on Apple devices that support ARKit. Older devices may not be compatible.

Face	Mediapipe	ARKit	ULSee
Angle XYZ	●	●	●
Position XYZ	●	●	●
Eye Open/Close	●	●	●
Eye XY	●	●
Eye Wide		●
Eye Narrow		●
Eyebrows Up/Down	●	●	●
Mouth Open/Close	●	●	●
Mouth Shape	●	●	●
Pucker (Open)		●
Pucker (Close)		●
Cheek Puff		●
Tongue Out		●

Hands	Mediapipe	ARKit	ULSee
Angle XZ	●
Position XY	●
Fingers	●
Joints	●

Connection Tutorial¶

PC Version¶

From the tray icon menu, select Motion Tracker.
Local Connection: In Connection Settings, select Local and click Connect.
Remote Connection: In Connection Settings, select Remote. Open the Control Panel, navigate to the Settings page, and enable Remote Access. Click Show IP List, note the computer's IP and port number, and enter them into Connection Settings.
About Local and Remote
- If EX is running on the same computer, select Local, which does not require enabling Remote Access.
- If EX is running on another computer, select Remote and manually enter the IP address to connect.

Mobile Version¶

On the PC Control Panel's Settings page, enable the Remote Access service and click Enable Network Discovery.
On the mobile app's Connection Settings page, click Find My Computer. If successful, the IP address and port number will be filled in automatically. Click Connect.

FAQs¶

Mobile App Cannot Connect to the Computer¶

Ensure the phone and computer are on the same local network.

Check cellular network settings and allow Motion Tracker to access the network (iOS only).

In the phone's Wi-Fi settings, disable Private Address (iOS only, unverified effectiveness).

Ensure Remote Access is enabled correctly.

Add bin/lw/lw.exe from the application's installation directory to the system's Allow an App through Firewall list, or disable the system firewall and restart the application.

On the mobile app's Connection Settings page, click Test Network Connection and ensure it displays Test Successful.

Click Find My Computer and ensure the IP address and port number are correctly found.

Tracker Does Not Display Camera Feed¶

Ensure the camera is functioning properly.

Ensure the correct camera is selected in the tracker settings.

Ensure no other applications are using the camera.

Restart the computer.

Tracker Does Not Display Face/Hand Coordinates¶

Ensure the surrounding environment is well-lit and the camera can clearly display the face or hands.

Restart the application or computer.

Tracker Cannot Control the Model¶

Ensure the tracker is connected to the main program.

Ensure the corresponding model slot number is enabled in the tracker settings.

Ensure the model's Json configuration enables face/hand tracking and correctly binds the relevant model parameters. Refer to Model Setup for details.

If using a third-party model, the tracking functionality may be disabled in the configuration. Consult the model creator for assistance.