Humanoid Mocap
Released
Turn any video into game-ready s&box animation. Full-body and first-person hand mocap, on your own PC, with FBX export.
by chomnr library
updated 15 days ago
4MB
thumb_down_alt0 favorite7 library_books0
Humanoid Mocap
Changes
Changes
What's changed in Humanoid Mocap with each update.
AI Reconstruction & Smoother Captures1.0.329 September 2026
Areas
18 changes in this update

Added

5 changes
Reconstruct with AI

  • Reconstruct with AI - new button for body captures that rebuilds the animation with NVIDIA MotionBricks: key poses come from the capture and the motion between them is generated

  • Before / After comparison - the capture and the AI version play side by side, labelled BEFORE and AFTER, in sync and turning together when you orbit either one

  • Export both - Export writes the capture and the AI version together, the AI version as <name>_rebuilt.fbx

  • Model download - the MotionBricks model (about 730 MB) downloads once on first use, with a progress bar; it is shared with AI Animator, so an existing install is reused

  • Progress - the animation area shows the loader while the model downloads and while reconstructing, with a cancel button

Improved

7 changes
Reconstruct with AI

  • Looks like the video - the AI version follows the performance closely: hips, spine and limbs are pulled back wherever the AI drifts from the capture

  • Smoother motion - the AI version is about half as jerky as the capture on the test clips

  • Kick height - kicks keep their full height instead of coming out low

  • Planted feet - feet the performer keeps planted stay planted in the AI version; feet that move in the video still move

  • Wrists - wrists keep the capture's bend, so they no longer wobble or spin

Capture

  • Hands behind the body - a hand that passes behind the body in the video (floss, chambered fists) now goes behind it instead of hitting the torso

UI

  • Reset camera button - centred on the character dropdown

Fixed

2 changes
Reconstruct with AI

  • Sliding feet - the AI version's feet no longer slide while planted

  • Joins - removed the hitches where generated pieces of motion met

Removed

4 changes
Reconstruct with AI

  • Humanoid Retargeter required - Reconstruct with AI needs the Humanoid Retargeter library installed in the project

  • Body captures only - Reconstruct with AI is not available for First Person hand captures

  • Capture-only parts - fingers, wrists, neck and head always come from the capture

  • Very quick moves - moves quicker than about half a second (such as fast repeated kicks) come mostly from the capture

LiDAR & Depth Update1.0.228 September 2026
Areas
21 changes in this update

Added

8 changes
Depth

  • Automatic depth detection - checks every video for phone depth data and uses it automatically; videos without depth work as before

  • Full LiDAR - Record3D recordings (RGBD video or .r3d) are labelled FULL LIDAR DETECTED and the body is placed at the distance the sensor measured

  • Measured hand distance - clearly visible hands in LiDAR recordings take the distance the sensor measured

  • Phone camera path - moving .r3d recordings follow the camera path the phone tracked instead of an estimate

  • Partial depth - iPhone Cinematic mode videos are labelled PARTIAL DEPTH DETECTED and their depth corrects hands in front of or behind the body

Preview

  • Depth border - the source preview pulses green for full LiDAR and amber for partial depth

  • LiDAR view - new button beside the source preview shows a colour depth view (red near, blue far); disabled when no depth is found

Import

  • .r3d files - Record3D .r3d files can be uploaded, dragged in or picked with Upload video…

Improved

7 changes
Depth

  • Body distance - on LiDAR recordings the body's distance from the camera went from up to ~20 cm off to about 1 cm

Import

  • HEVC videos - H.265 videos preview and process without the Microsoft Store HEVC extension

  • Phone upload - depth tracks are kept; the page explains how to re-send a Cinematic video whose depth was stripped

Capture

  • Hand placement - hands match where the video shows them, including above the head, crossed and against the chest

  • Wrist direction - palms face the right way, taken from the hand tracker

  • Joint limits - elbows and knees only bend the way real joints do; fingers stay within natural limits

  • Foot contacts - planted feet stay put across the whole clip

Fixed

4 changes
Import

  • .mov preview - iPhone .mov videos no longer show "cannot preview" or play frames out of order

  • Decoded timestamps differ - fixed the capture error that appeared after a recent Windows update

Capture

  • Arms through the body - arms no longer pass through the torso

  • Floating hands - hands on the floor stay planted, for example when getting up from sitting

Known Issues

2 changes
Depth

  • Cinematic depth from Photos - picking a Cinematic video from Photos on the phone upload page strips its depth; choose it from Files ("Choose File") or copy it with Keep Originals

  • Depth changes distance only - poses, joint angles and fingers still come from the video

September Update1.0.124 September 2026
Areas
29 changes in this update

Added

7 changes
Editor

  • Upload screen - dark drop box with a green Choose Video button, like Humanoid Rigger'saeafa4c

  • Processing loader - the animation panel shows a spinner and the current step while a video processes0b37391

  • Download progress - a progress bar with the file name and how much is left to download0b37391

  • Reinstall worker - a button in Advanced that deletes and re-downloads the inference worker7b117a8

Capture

  • Edited videos - every shot is found, captured in order and joined into one animationec42137

  • Foot contacts - UnderPressure contact detection keeps planted feet from sliding690ea97

Setup

  • Prebuilt worker - installs from s&box download the inference worker automaticallye3cf2c7

Improved

11 changes
Editor

  • Workspace - redesigned with cards for the source video, animation and playback, and a status lighte38bb93

  • Advanced settings - grouped into Capture, mode options, Cleanup, Contact review and Capture detailse38bb93

  • Preview camera - renamed Head cam / Orbit and shown only in First Person, so it no longer clashes with the First/Third Person choicee38bb93

  • Preview framing - the camera holds steady instead of re-framing every frame5c75b26

Body motion

  • Smoothing - speed-adaptive, so fast moves stay sharp and slow ones stay smoothb986e92

  • Camera tilt - captures are levelled with gravityf5f9cc3

  • Jumps and flips - flights keep their real height, with smoother takeoffs and landings0ea51b7

  • Sitting - hips sit on the floor, and seated hips and feet stay puta3a8d25

  • Spine - straight spines with no mid-back hunch or crease at the base978fc67

  • Travel - tumbling and rolling moves stay on their linea82ad09

Hands

  • Wrist direction - hands face the way the video shows, using the finger model where it agrees with the body5665575

Fixed

8 changes
Editor

  • Viewmodel arms - a body capture is shown on the full character when arms are selected9b8c1d3

Capture

  • Damaged videos - captured up to where they stop playingaf37444

Setup

  • Missing worker - fixed "C# inference worker is missing" on installs from s&boxe3cf2c7

  • Old versions - only one worker version is kept on disk7b117a8

Body motion

  • Floating - body captures no longer hover above the floora5edb5a

  • Upside-down frames - sudden whole-body flips are removed0ea51b7

  • Sideways lean - torsos no longer lean to one sidecec5008

  • Crouches - a crouched skateboarder is no longer mistaken for sitting7b117a8

Known Issues

3 changes

  • First download - Third Person needs about 9 GB of models on the first capture (First Person about 2.6 GB)

  • Moving cameras - clips filmed with a moving camera can still show some foot slide

  • Two editors - starting a first capture in two editors at once can make the second download fail; press Retry