Profile Picturecarlosedubarreto

CEB 4D Humans

7 ratings

NON- COMMERCIAL use only

WINDOWS ONLY


IMPORTANT

To work, you need to install git on your machine.

You can get it from this link https://git-scm.com/downloads and install it



A free version was released, please consider donating PKL files created with the addon for us to build a library of animations. (link to the library)

More info and link to download the animations that are already available: https://www.patreon.com/posts/88955474


Free Animation Library

CEB 4D Humans Free Animation Files


Collaborate with the Animation Library
If you created animation and could share, please send me. You can contact me at:


Important information:

To fully work, you need a CUDA card. Users reported that they were able to run on a GPU with 6gb of VRAM.

If it doesnt work for you can try to use Google Colab to help. More information below


If you want dont want to use Google Colab, please test on your PC using the FREE version.


Model Files

People usually have problems when the code tries to download the model files automatically, prefer to get the model files manually and import maunally, there is a button for that on the VENV part. If you have the full version it will be available on this same gumroad, if you are a free user, get the file on this link https://carlosedubarreto.gumroad.com/l/dependency/2jhtxqo.

Further information on the model offline installation on the end of this page, in the FAQ part, the "Question: There was a connection error."


To use the addon you need to register on https://smpl.is.tue.mpg.de/ and agree with its license

CEB 4D humans heavy work done on top of the 4D humans code (available at https://github.com/shubham-goel/4D-Humans)


What CEB 4D human is?

The CEB 4d humans addon  is a tool that can make you animation work much faster by using a single video as input and export a very good animation that can be used in many ways:

- create an animation reference for you to create your own animation, understanding better how the body moves

- you can use it with he smoothing tools to fix th jitter that usually comes with markesless mocap solution

- you can select key poses (and erase everything else) to use as the first pass on your animation project


What you can do with CEB 4D Humans:

- you can easily create animations using almost any video with one or more people

- use the provided tools to remove jitter

- use the foot height to lock the foot on the Z axis (in case you have some unexpected results where the body goes away from the floor when it shouldn't)


What you can't do:

- you can't have finger tracking

- you can't have face tracking


Computer Specs needed:

total of 15gb free space on the hard drive which is:

10gb free on windows user folder

5gb free for venv data

A CUDA compatible card with 6gb (users reported that it works) if you want to run the full process on your pc.

If you dont have CUDA card or less then 6gb of memory you can run the main part on google colab and import it on the addon to finalize and import the data.


Tutorial on how to install the addon


Import Animations from Animation Library page


Export animations and how to send us to improve the animation library



How to use the animation on your own character

To transfer the animation to your character you can do something called retarget

By retargetting you can make your own character to come to life.

Here is an tutorial explanin how to do retargting from 4d human to a mixamo armature made by https://twitter.com/poomnattawat1


Tutorial using google Colab + CEB 4D Humans

link to official 4d humans google colab was not working, try this colab instead:

https://colab.research.google.com/drive/1xcdCNrFGXCCjUkqPHlgPix3wOhyxE75o?usp=sharing




Tools:

Smooth

This tools uses SmoothNet (https://github.com/cure-lab/SmoothNet) to clean the data created with CEB 4D Humans.

this smooth will only work with animation created with CEB 4d Humans or the google colab one.



Smooth 2 "j4ck (Giacomo Spaconi) Method"

this smooth tool cam make the animation much better than the raw data, and this tool can be used on other animtions, not only in CEB 4d Humans ones.


Foot height lock

This tool can help to make the animation not to fly around. Select the place where it should start to be locked to the floor, and when it should stop. this selection is necessary because you can have some action where the character jumps


Pack of free animations

This product also comes with a pack with several animations, that can be loaded loaded in blender using the addon. Its a selection of clips previously processed

expect more animations to come in the future.

the pack is called "PKL_Animations_1.zip" and it comes with 11 animations.



How to use the animation pack?

Unzip the "PKL_Animations_1.zip" file and you will have a PKL files. 

Load them using the Import option on the "Import/Export Animation" part of the panel

Then, you can load the animation using the "Import Raw option"

You can use the smooth option to make the animation more stable, as you can do if you are using your own footage.


Videos done using ceb 4d humans:






FAQ:

Question: After installing the addon I get an error and it do not execute the imported video

Answer: Make sure you have installed the VENV, its on the bottom part of the panel, click on it to expand the options.

the addon will only work converting the video to animation only if the venv is installed. All this buttons bellow cant be red. if some of them are red, it means it was not installed properly.



If you keep getting error, and a message to use with the full error text that is shown con the console.


the best is to copy all the text and send to us.


Question: There was a connection error.

Answer: if you have a connection error, download the "4d_humans_optional_offline_model_files.zip" file and import it on the Venv panel it is on the bottom of the panel on the 3d viewport (under CEB / 4d humans tab)


inside it you can find in the bottom, the optional "Import Offline Files" and click on the "Import Model Files" and select the "4d_humans_optional_offline_model_files.zip"



log of changes:

2024-04-22: Free 0.30: The free version was updated to work with Blender 4.1 and also got some tools from the Full version, such as SmoothNet and the great Giacomo Spaconi "j4ck" Smooth

2024-04-21: 1.11 Beta:

- Fix to make IK Control to work with WHAM, enable IK control in all 3 animation types (4d humans, wham and slahmr)

- added the source selector to choose which character to transform to IK Control

- added the load video on screen option to 4D Humans and WHAM

- adding quick save and quick load for markers

- better error handling on 4d humans, update to work with blender 4.1 for 4d humans, wham and slahmr

- Now slahmr should be simpler to install (First install and use 4d humans once them install SLAHMR and it should work)

2024-04-13: 1.10 Beta: Enabled to retarget the result after using the IK Control tools. Fixed the import PKL in 4d Humans

2024-04-06: 1.09 Beta - IK - FK control, Better Foor Lock and floor detection

2024-03-23: 1.08 Beta - Offline install of WHAM checkpoints using file "wham_offline_checkpoints.zip", actorcore rig preset

2024-03-11: 1.07 Beta - Fixing SLAHMR instalation problems, fixed the load video in SLAHMR, in case the image plane addon was not loaded

2024-02-24: 1.06 Beta - WHAM Update 2024-02-19 and started packing with the SMPL FBX

2024-02-19: 1.05 Beta - Finished adding SLAHMR and tools to load part of a video (for SLAHMR)

2024-02-12: 1.04 Beta - Adding SLAHMR (incomplete) to the addon, fix 4d humans creation and import

2024-02-10: 1.03 Beta - Fixes to the bugs introduced on version 1.02 and I've added the fix z location if you use the local option (its not available for world option)

2024-02-07: 1.02 Beta - Option to load pose/pose_world and trans/trans_world. Export and import of pkl files (now you can import the results from google colab) - IMPORTANT: Had to remove this version due to some issues that showed up on this version

2024-02-06: 1.01 Beta: 1.01Beta - Added possibility of multiple characters, and the correction to get all the animation. If there is a glitch on the detection, it will come as another character.

2024-02-05: 1.00 Beta: Introducing the addition WHAN project (https://github.com/yohanshin/WHAM) that is more stable and faster than 4d humans

2023-11-20: 0.55:Added Presets for retargeting UE4,UE5 and metahuman characters. Also added presets for some BlenderStudio Rigs (Ellie v1 and Rain v2.4)

2023-11-19: 0.54: Adjust rest position, this tool enables you to use the CEB 4d humans retarget system even if the target character is not in T pose. Added preset for retarget to "Character Creator +" character

2023-11-17: 0.53: New tool "Extract Marked Frames", that enables you to clean the animation more easily and faster

2023-10-13: 0.52: Fix where you can use videos with more than 1.300 frames

2023-09-19: 0.51: the mixamo rig now gets the prefix automatically (you dont have to write the prefix anymore)

2023-09-18: 0.50: added retargeting options (with mixamo and autorigpro presets) and fixed some bugs

2023-09-16: 0.41: fixed some bugs, rebuild the way to interact with the action list on the panel, make the core option more modular and added an option to make the next action to be in the same direction and place as the previous action (watch the video for better understanding)

2023-09-15: 0.40: Added tools to create a full animation using multiple parts of animations (using the power of NLA), updated the foot height lock, to consider also the wrists placement to have a better result

2023-09-11: CEB 4D Human - Fix import RAW/Smooth for other languages, added add t pose on frame 0 and remove location as export tools

2023-09-09: 0.22 - Added Link to Animation Library page (Free/Paid)

2023-09-05: 0.21 - added option to use less vram (about 8.5gb on my tests) (Free/Paid)

$
Add to cart
30 sales
Copy product URL

Ratings

5.0
(7 ratings)
5 stars
100%
4 stars
0%
3 stars
0%
2 stars
0%
1 star
0%
$0+

CEB 4D Humans

7 ratings
Add to cart