Character animation notes

character_anim.md

Character Animation

• [https://github.com/ethz-adrl/control-toolbox] Control Toolbox - An Open-Source C++ Library for Robotics, Optimal and Model Predictive Control

• [https://github.com/davepagurek/DynamicKelvinlets] Dynamic Kelvinets to add secondary animation

• [http://domedb.perception.cs.cmu.edu/monototalcapture.html] Yassar's group's monocular mocap

• [https://arxiv.org/abs/1812.11103v3] Learning to Walk via Deep Reinforcement Learning

• [https://arxiv.org/abs/1810.02363v4] Recurrent Transition Networks for Character Locomotion

• [http://www.andreasaristidou.com/publications/papers/CUEDF-INFENG,%20TR-632.pdf] FABRIK

• [https://github.com/dgriff777/a3c_continuous] A3 Continuous Character Controller

• [http://research.cs.wisc.edu/graphics/Gallery/FootskateSolver/footskate.html] Footskate lib.

• [http://www.goatstream.com/research/papers/SA2013/SA2013.pdf] Muscle based bipeds

• [https://github.com/TheComet/ik] FABRIK solver

• [http://ogldev.atspace.co.uk/www/tutorial38/tutorial38.html] Assimp character data

• [http://theorangeduck.com/page/deep-learning-framework-character-motion-synthesis-and-editing] Motion synthesis

• [https://github.com/AliJalalifar/Character_Animation] Motion synthesis

• [https://github.com/tcoppex/aer-engine] Animation engine with computer shaders

• [https://github.com/sreyafrancis/PFNN] Demo (no code) of phase function NN

• [http://web.cs.ucla.edu/~nakada/pdfs/siggraph18_nakada.pdf] Deep Learning of Biomimetic Sensorimotor Control for Biomechanical Human Animation

• [http://crl.ethz.ch/publications.html] Robot control

• [https://arxiv.org/pdf/1805.09488.pdf] Viseme Net

• [https://github.com/purdue-biorobotics/flappy] Winged Locomotion Controller

• [https://github.com/nfrechette/acl] Animation Compression Library

• [[https://github.com/pafuhana1213/KawaiiPhysics] Kawaii Physics as used in games such as FFXIV

Rigging

• [https://medium.com/blue-sky-tech-blog/choprig-system-b11d4c1e252c] BlueSky's ChopRig system
• [https://zhan-xu.github.io/rig-net/] SIGGRAPH 2020 paper "RigNet: Neural Rigging for Articulated Characters"
• [https://github.com/zhan-xu/RigNet] RigNet code
• [https://github.com/electronicarts/dem-bones] Dem Bones - deriving rig weights from sample poses

Parameteric Models and Priors

• [https://github.com/ICT-VGL/ICT-FaceKit] A deformable, parametric base mesh for faces
• [http://www.makehumancommunity.org] Make Human procedural character generator
• [https://github.com/nghorbani/human_body_prior] Morphable Human Body Prior

Locomotion

• [https://github.com/ProjectBorealis/PBCharacterMovement] HL2-style movement engine in c++
• [https://github.com/dyanikoglu/ALSV4_CPP] Advance Locomotion System in C++

Simulation

• [https://github.com/opensim-org/SCONE] Open Source Software for Predictive Simulation of Biological Motion.

• [https://github.com/seiing/SoftCon] SoftCon: Simulation and Control of Soft-Bodied Animals with Biomimetic Actuators

• [https://github.com/pafuhana1213/KawaiiPhysics/blob/master/README_en.md] Kawaii Physics, secondary animation lib https://github.com/stack-of-tasks/pinocchio

humanoid solver pinocchio uses: https://github.com/humanoid-path-planner/hpp-fcl

hpp-fcl is derived from https://github.com/flexible-collision-library/fcl

fcl uses: https://github.com/danfis/libccd https://github.com/OctoMap/octomap

Miku Miku Dance

• [https://starletgem.deviantart.com/favourites/73510452/MMD] A bunch of MMD resources
• [https://sites.google.com/site/mikumikumovingeng/] Miku Miku Moving
• [https://github.com/ray-cast/ray-mmd] Miku Miku PBR rendering
• [https://github.com/powroupi/blender_mmd_tools] Blender MMD tools
• [https://learnmmd.com/http:/learnmmd.com/convert-vroid-studio-to-mmd-with-one-click/] Convert VRoid studio to MMD
• [https://www.deviantart.com/mmd-nay-pmd/art/New-MMD-Motion-Data-Index-A-L-526892180] data resource index
• [https://www.deviantart.com/mmd-nay-pmd/art/New-MMD-Motion-Data-Index-M-Z-531358782] index continued

Deformation

• [https://github.com/tneumann/skinning_decomposition_kavan] Kavan's Skinning Decomposition
• [https://github.com/3d-morphable-models/curated-list-of-awesome-3D-Morphable-Model-software-and-data] Morphable Models
• [https://github.com/electronicarts/dem-bones] dem bones - EA's LBS skinning computation

Hair

• [https://github.com/mravella/hair] Hair rendering
• [https://github.com/CaffeineViking/vkhr] Vulkan hair engine
• [http://www.kunzhou.net/2019/dynamic-hair-capture-sa19.pdf] Single view hair capture to mesh
• [https://prettydarke.cool/portfolio/open-source-afro-hair-library/] Open Source Afro Hair library

Authoring

• [https://github.com/alexismorin/Salon] Hair Salon (Unity VR tool)
• [http://www.makehumancommunity.org/] Make Human
• [http://kunzhou.net/2019/neuroskin.pdf] Neuroskinning
• [http://www.dgp.toronto.edu/~depaolic/projects/secondSkin/] Second Skin Modeling technique
• [https://github.com/intel/riggingtools] Rigging Tools by Intel
• [https://arxiv.org/pdf/1909.01064.pdf] Automated Parameterized Face Capture for Games

Pose Estimation

• [https://github.com/Mirevi/MotionHub] Merge body tracking data from different systems into a single coordinate system

• [https://github.com/jiang-du/BlazePose-tensorflow] A third-party Tensorflow Implementation for paper "BlazePose: On-device Real-time Body Pose tracking".

• [https://github.com/CalciferZh/minimal-hand] Minimal real time video hand tracker

• [http://files.is.tue.mpg.de/black/talks/GCPR2018webSmall.pdf] Fantastic History of Human Motion Tracking

• [https://github.com/mks0601/3DMPPE_POSENET_RELEASE] "Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image", ICCV 2019

• [https://github.com/zhan-xu/AnimSkelVolNet] 3DV 2019 paper "Predicting Animation Skeletons for 3D Articulated Models via Volumetric Nets"

• [https://github.com/jin-s13/COCO-WholeBody] COCO Wholebody landmarked data set

• [https://github.com/hongsukchoi/Pose2Mesh_RELEASE] "Pose2Mesh: Graph Convolutional Network for 3D Human Pose and Mesh Recovery from a 2D Human Pose", ECCV 2020

• [http://www.ecva.net/papers/eccv_2020/papers_ECCV/papers/123460188.pdf] VoxelPose: Towards Multi-Camera 3D Human Pose Estimation in Wild Environment

-[http://www.ecva.net/papers/eccv_2020/papers_ECCV/papers/123520596.pdf] Neural Articulated Shape Approximation

• [https://github.com/facebookresearch/VideoPose3D] FRL Video Pose Estimation and paper: https://dariopavllo.github.io/VideoPose3D/

• [https://github.com/ArashHosseini/3d-pose-baseline] A realtime 3d pose estimation baseline

• [https://github.com/mks0601/3DMPPE_POSENET_RELEASE] "Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image", ICCV 2019

https://arxiv.org/pdf/1906.00161.pdf

• [https://github.com/robertjoosten/video2mocap] Use OpenPose and ffmpeg to convert video to Maya animations

• [https://github.com/Shimingyi/MotioNet] MotioNet code

• [http://andreasaristidou.com/publications/papers/MotioNet.pdf] MotioNet paper ToG 2020

• [https://dl.acm.org/doi/10.1145/3403736.3403938] Technicolor Facelab, as used in Cats. DigiPro 2020

• [https://github.com/n1ckfg/OpenPoseRig] Using OpenPose in a 3D animation pipeline. Based on the work of @CMU-Perceptual-Computing-Lab, @una-dinosauria, @ArashHosseini, and @keel-210.

• [https://github.com/CalciferZh/minimal-hand] A minimal solution to hand motion capture from a single color camera at over 100fps. Easy to use, plug to run.

• https://github.com/foolwood/DAT Fast Segmentation Attention Filter

• [https://montreal.ubisoft.com/fr/robust-solving-of-optical-motion-capture-data-by-denoising-2/] Mocap denoising

• [https://kv2000.github.io/2020/03/25/deepFashion3DRevisited/] Single Image Clothes Mesh Estimation

• [https://github.com/akanazawa/human_dynamics] Human Capture with neural rnder

Neural Control

-[https://research.fb.com/publications/a-scalable-approach-to-control-diverse-behaviors-for-physically-simulated-characters/] Scalable Diverse Control for Physically Simulated Characters

http://mrl.snu.ac.kr/research/ProjectScalable/Page.htm https://motionretargeting2d.github.io/ https://www.cell.com/neuron/pdf/S0896-6273(19)30932-8.pdf Nested Neuronal Hierachies Orchestrate Control https://montreal.ubisoft.com/en/drecon-data-driven-responsive-control-of-physics-based-characters/ DReCon https://static-wordpress.akamaized.net/montreal.ubisoft.com/wp-content/uploads/2019/11/13214229/DReCon.pdf https://www.gameanim.com/2020/03/24/ragdoll-motion-matching/

• [https://github.com/UBCMOCCA/SymmetricRL] Learning Symmetrical Locomotion

• [https://www.goatstream.com/research/papers/SA2013/SA2013.pdf] Flexible Muscle-Based Locomotion for Bipedal Creatures, Siggraph Asia, 2013

• [https://www.goatstream.com/research/papers/SA2013/index.html] Project page

• [https://arxiv.org/pdf/2003.09820.pdf] A neural rig space for neural rendering (Disney Research) http://studios.disneyresearch.com/2020/03/24/rig-space-neural-rendering/

https://arxiv.org/pdf/2007.13886.pdf Perpetual Motion: Generating Unbounded Human Motion

https://sites.google.com/view/hsnms Hierarchical Style-based Networks for Motion Synthesis

Musculoskeletal Control

https://arxiv.org/pdf/2007.15311.pdf Functionality-Driven Musculature Retargeting

Tangible Interfaces

• [http://didi.com] Didi made the Monkey controller
• [https://igl.ethz.ch/projects/character-articulation-input-device/] Siggraph 2014, 3d printed lego-like controllers
• [https://www.youtube.com/watch?v=vBX47JamMN0] Demonstration of the printed controllers
• [http://www.blep.com/files/2613/6986/1526/DID.pdf] Dinosaur Input Device

Anime Rendering

• [https://www.cse.cuhk.edu.hk/~ttwong/publication-favorite.html] Deep learning on various rendering tasks

Misc

• [http://www.michaeldempsey.me/animation/#Tomorrow'sTech]
• [https://www.behance.net/edillinger Eric Dillinger's stop motion for ILM]
• [https://github.com/facebookresearch/fairmotion] Tools for BVH processing and annotation

Tracking

• [https://github.com/Mirevi/MotionHub] MotionHub

• [https://arxiv.org/abs/2002.12625] 4D Association Graph for Realtime Multi-person Motion Capture Using Multiple Video Cameras, Yuxiang Zhang, Liang An, Tao Yu, Xiu Li, Kun Li, Yebin Liu

• [https://anipose.readthedocs.io/en/latest/] Anipose

• [https://geometry.stanford.edu/projects/human-dynamics-eccv-2020/] Contact and Human Dynamics from Monocular Video - this is the one with a physics based model

• [https://montreal.ubisoft.com/en/robust-motion-in-betweening-2/] ROBUST MOTION IN-BETWEENING https://static-wordpress.akamaized.net/montreal.ubisoft.com/wp-content/uploads/2020/07/09155337/RobustMotionInbetweening.pdf

• [https://static-wordpress.akamaized.net/montreal.ubisoft.com/wp-content/uploads/2020/07/09154101/Learned_Motion_Matching.pdf] Learned MOtion Matching

-[https://arxiv.org/pdf/2004.04572.pdf] ARCH for Sausalito FRL