MetaHuman Synthetic Dataset for Optimizing 3D Model Skinning

Main Article Content

Abstract

In this study, we present a method for creating a synthetic dataset using the MetaHuman framework to optimize the skinning of 3D models. The research focuses on improving the quality of skeletal deformation (skinning) by leveraging a diverse array of high-fidelity virtual human models. Using MetaHuman, we generated an extensive dataset comprising dozens of virtual characters with varied anthropometric fea-tures and precisely defined skinning weight parameters. This data was used to train an algorithm that optimizes the distribution of skinning weights between bones and the character mesh.


The proposed approach automates the weight rigging process, significantly reducing manual effort for riggers and increasing the accuracy of deformations during animation. Experimental results show that leveraging synthetic data reduces skinning errors and produces smoother character movements compared to traditional methods. The outcomes have direct applications in the video game, animation, virtual reality, and simulation industries, where rapid and high-quality rigging of numerous characters is required. The method can be integrated into existing graphics engines and development pipelines (such as Unreal Engine or Unity) as a plugin or tool, facilitating the adoption of this technology in practical projects.

Article Details

References

1. Газизов Р.Р., Шубин А.В. Процедурные методы скиннинга гуманоидных персонажей // Электронные библиотеки. 2022. Т. 25, No. 5. С. 404–440. https://doi.org/10.26907/1562-5419-2022-25-5-404-440
2. Epic Games. New release brings Mesh to MetaHuman to Unreal Engine … MetaHuman Mesh to MetaHuman Announcement. 2022. URL: https://www.unrealengine.com/en-US/blog/new-release-brings-mesh-to-metahuman-to-unreal-engine-and-much-more
3. Epic Games Forums. Skinning Method in MetaHuman (developer reply), April, 2021. // Unreal Engine forum. 2021. URL: https://forums.unrealengine.com/t/skinning-method-in-metahuman/226222
4. Кугуракова В.В., Абрамов В.Д. и др. Генерация трехмерных синтетических датасетов // Электронные библиотеки. 2021. Т. 24. No. 4. C. 622–652. https://doi.org/10.26907/1562-5419-2021-24-4-622-652
5. Сулейманова Е.А., Газизов Р.Р., Кугуракова В.В. и др. От идеи до реальности: процесс создания одежды для персонажа компьютерной игры // Известия вузов. Технология текстильной промышленности. 2024. №5(413). С. 13–19. https://doi.org/10.47367/0021-3497_2024_5_13
6. Baran I., Popović J. Automatic Rigging and Animation of 3D Characters. ACM Trans. Graph. 2007. T. 26. No. 3. C. 72-es.
7. McGrane C. Auto-rigging? Still something only Mixamo can do? // ThreeJS Forum. 2022. URL: https://discourse.threejs.org/t/auto-rigging-still-some thing-only-mixamo-can-do/43709/8
8. Automatic rigging of three dimensional characters for animation: пат. США № 11,170,558 B2 / Adobe Inc.; опубл. 09.11.2021. URL: https://patents.google.com/patent/US11170558B2/en
9. Xu Z., Zhou Y., Kalogerakis E., Landreth C., Singh K. RigNet: Neural Rigging for Articulated Characters //arXiv preprint arXiv:2005.00559. 2020.
10. Liu L., Zheng Y., Tang D., Yuan Y., Fan C., Zhou K. Neuroskinning: Automatic skin binding for production characters with deep graph networks //ACM Transactions on Graphics (ToG). 2019. Vol. 38. No. 4. P. 1–12.
11. Mosella-Montoro A., Ruiz-Hidalgo J. Skinningnet: Two-stream graph convolutional neural network for skinning prediction of synthetic characters // Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2022. P. 18593–18602.
12. Guo Z. et al. Make-It-Animatable: An Efficient Framework for Authoring Animation-Ready 3D Characters //arXiv preprint arXiv:2411.18197. 2024. URL: https://jasongzy.github.io/Make-It-Animatable/
13. Gazizov R., Shubin A. Modification of Skeletal Character Animation Using Inverse Kinematics Controllers //2024 International Russian Smart Industry Conference (SmartIndustryCon). IEEE, 2024. P. 553–557. https://doi.org/10.1109/SmartIndustryCon61328.2024.10515984
14. Тарасов А.С., Кугуракова В.В. Реконструкция трехмерной модели человека по единственному изображению// Электронные библиотеки. 2021. Т. 24, № 3. С. 485–504. https://doi.org/10.26907/1562-5419-2021-24-3-485-504