This app is for checking the operation of iFacialMocap. You can try out the features before you buy. This app is free to use, but has some functional limitations.
iFacialMocap is an innovative application designed for iOS devices, enabling users to capture and transmit facial expressions to 3D computer graphics (3DCG) software on a PC in real time. The app facilitates a seamless communication process, allowing for the export of FBX files directly via email. Users can easily manage their 3D model interactions through this app, making it an essential tool for digital artists and animators working with facial animations.
To initiate the FBX export, users must activate the REC mode for recording and then press the designated mail button, which leads to a version selection interface for the FBX format. After choosing a version and confirming via the OK button, the app saves the FBX file to the File folder and automatically opens the mail interface to share the file. This straightforward process simplifies the exporting of animated facial data for use in various applications.
The iFacialMocap app supports direct communication with popular 3D software programs like Maya, Unity, and Blender, allowing users to create real-time face animations seamlessly. Additionally, the app offers a feature for baking these real-time animations, enhancing the workflow for animators. This level of integration ensures that users can produce high-quality animations efficiently.
Within the iOS app, users can load VRM avatars and synchronize their performance with PC software like VMagicMirror, along with other VRM-centric applications such as Luppet and HANA_APP. To establish this connection, users must start the iFacialMocap app on their iPhone and then launch the corresponding software on their PC, ensuring they have entered the correct IP address of the iPhone. This setup fosters a robust interaction between mobile and desktop systems.
It is important to note that iFacialMocap is exclusively available for devices equipped with FaceID, such as specific iPhone and iPad models. The app utilizes the camera's depth data solely for the purpose of motion capture and does not retain any captured data on the iPhone. Furthermore, the application is designed for local network communication, ensuring that no information is transmitted to external third parties. Users can enjoy the full functionality of iFacialMocap as long as they have compatible Apple devices running the required iOS version.
iFacialMocap allows you to capture facial expressions in an iOS app and communicate in real time with 3DCG software on your PC. You can also do an FBX export by email.PC-side software allows you to import VRM models.
To export FBX, turn on the REC mode and record. And when you press the mail button, the version selection screen of FBX appears, and when you press the OK button, the FBX file is saved in the File folder and the mailer starts.
Detailed usage is available at the following URL:
https://ifacialmocap.com/
This app can create face animations by communicating with Maya, Unity and Blender in real time. In addition, animations created in real time can be baked.
This app can load VRM avatars within the iOS app. In addition, this app is linked with VMagicMirror on the PC and VRM related apps such as Luppet and HANA_APP.
To use, first start this app, then start "iFacialMocap to SoftWare app" on your PC and enter your iPhone's IP address.
(Donwload from PC use :https://ifacialmocap.com/download/
)
Next, create up to 52 morph targets (BlendShape or ShapeKey) according to the naming convention.
Finally, use 3DCG software to load the script / add-on and press the connection button.
Very accurate facial motion capture can be performed very easily.
This app is only available for models equipped with FaceID. The camera image and resulting depth data are only used to send motion capture data to the user's PC. That data is not stored in the iPhone. To get depth data from Apple's API, access to the camera is required.
This application is only used for communication with PCs within the same network and does not send information to third parties.
This app can only be used on iOS devices equipped with FaceID.
Supported devices are as follows:
・iPhone
iPhone 11 Pro Max
iPhone 11 Pro
iPhone 11
iPhone XS Max
iPhone XS
iPhone XR
iPhone X
・iPad
iPad Pro 12.9-inch (4th generation)
iPad Pro 12.9-inch (3rd generation)
iPad Pro 11-inch (2nd generation)
iPad Pro 11-inch
* Face ID is not installed in the new iPhone SE 2nd generation released in 2020, but you can use iFacial Mocap by updating to iOS 14 or later. Not limited to iPhone SE 2nd generation, iFacial Mocap can be used if it has an A12 or higher chip and has been updated to iOS14.