Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

blender issue in Quick Start #111

Closed
yxsysu opened this issue Dec 13, 2023 · 6 comments
Closed

blender issue in Quick Start #111

yxsysu opened this issue Dec 13, 2023 · 6 comments

Comments

@yxsysu
Copy link

yxsysu commented Dec 13, 2023

Hi, thanks for your great work. I am surprised by the experimental results.
I follow the Quick Start but I encounter a error.

# 1. Use HybrIK-X to estimate SMPL-X pose sequences from input video
# 2. Rig ECON's reconstruction mesh, to be compatible with SMPL-X's parametrization (-dress for dress/skirts).
# 3. Animate with SMPL-X pose sequences obtained from HybrIK-X, getting <file_name>_motion.npz
# 4. Render the frames with Blender (rgb-partial texture, normal-normal colors), and combine them to get final video

python -m apps.avatarizer -n <file_name>
python -m apps.animation -n <file_name> -m <motion_name>

# Note: to install missing python packages into Blender
# blender -b --python-expr "__import__('pip._internal')._internal.main(['install', 'moviepy'])"

wget https://download.is.tue.mpg.de/icon/econ_empty.blend
blender -b --python apps.blender_dance.py -- normal <file_name> 10 > /tmp/NULL

In the last step of blender, the program broke down with error ``unable to open a display''.
The problem is in line 112 of blender_dance.py:
bpy.ops.render.render(use_viewport=True, write_still=True)
I use blender2.82 in linux (only terminal without remote desktop), and install many packages (openGL and so forth). I confirm that I used `blender -b xxxxx`, but the error still exists.
It is my first time to run a 3D project. I do not know how to fix this and get the video results. Could you give me some hints?

@yxsysu
Copy link
Author

yxsysu commented Dec 13, 2023

image

@YuliangXiu
Copy link
Owner

Please refer to Blender Render to enable the headless rendering, or set up the blender on a machine with a display.

@chris-hndz
Copy link

Hola @yxsysu !

Sorry for my ignorance, but how can you extract the estimated SMPL-X pose sequences from input video with HybrIK-X into a file? How can you generate the SMPL-X pose sequences obtained from HybrIK-X, getting <file_name>_motion.npz ?

I managed to run HybrIK-X on a video with the command:

python scripts/demo_video_x.py --video-name examples/dance.mp4 --out-dir res_dance --save-pk --save-img

But this only generates a video from SMPL-X about the person in the video, and a folder with the image sequence of the original video, but does not generate any *.npz file.

Thanks in advance for your help! 😄

@chris-hndz
Copy link

OK, I've figures out what to do...

1) Use the correct repository

  • Apparently the official HybrIK-X repository is incomplete, so I used this fork and was able to export the SMPL-X pk file.

2) Update the blender addon:

  • I followed the instructions in this post, and I was able to load and play the HybrIK-X animation in Blender, and thus export it in fbx.

I hope this will be useful to other people.

@Mhao-lxx
Copy link

Hello, blogger! Thank you for your work!

I followed your instructions and successfully exported the .pk file, but this file cannot generate animations when used with the 3D models produced by SMPL-X.

image

Do you know how to solve this issue? Thank you!

@yxsysu
Copy link
Author

yxsysu commented Oct 15, 2024

Sorry, I haven't used this project in a long time and can't provide assistance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants