Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The video generation was killed. with 55 second wav #214

Open
hoverZ opened this issue Jul 12, 2024 · 1 comment
Open

The video generation was killed. with 55 second wav #214

hoverZ opened this issue Jul 12, 2024 · 1 comment

Comments

@hoverZ
Copy link

hoverZ commented Jul 12, 2024

o create a public link, set share=True in launch().
args ('/tmp/gradio/4659f9a53f90af1cfac2c7e0990384bb1fe25590/aud.wav', 'none', 0, 0, 0.4, 0.01, False, '/root/GeneFacePlusPlus/checkpoints/audio2motion_vae/model_ckpt_steps_400000.ckpt', None, None, '/root/GeneFacePlusPlus/checkpoints/motion2video_nerf/may_torso/model_ckpt_steps_250000.ckpt', False)
Changes of a2m_ckpt detected, reloading model
Changes of torso_ckpt detected, reloading model
infer inputs : {'drv_audio_name': '/tmp/gradio/4659f9a53f90af1cfac2c7e0990384bb1fe25590/aud.wav', 'blink_mode': 'none', 'temperature': 0, 'lle_percent': 0, 'mouth_amp': 0.4, 'raymarching_end_threshold': 0.01, 'fp16': False, 'a2m_ckpt': '/root/GeneFacePlusPlus/checkpoints/audio2motion_vae/model_ckpt_steps_400000.ckpt', 'postnet_ckpt': '', 'head_ckpt': '', 'torso_ckpt': '/root/GeneFacePlusPlus/checkpoints/motion2video_nerf/may_torso/model_ckpt_steps_250000.ckpt', 'low_memory_usage': False, 'drv_pose': 'nearest', 'debug': False, 'out_name': 'temp/out_bFUxPNBuqVqRfXvK.mp4'}
| WARN: egs/egs_bases/audio2motion/vae.yaml not exist.
| WARN: /root/GeneFacePlusPlus/checkpoints/th1kh_512_audio2motion/base.yaml not exist.
| load 'model' from '/root/GeneFacePlusPlus/checkpoints/audio2motion_vae/model_ckpt_steps_400000.ckpt', strict=True
| WARN: /root/GeneFacePlusPlus/checkpoints/motion2video_nerf/may_torso/lm3d_radnerf_torso.yaml not exist.
| load 'model' from '/root/GeneFacePlusPlus/checkpoints/motion2video_nerf/may_torso/model_ckpt_steps_250000.ckpt', strict=True
trainval: Smooth head trajectory (rotation and translation) with a window size of 7
/root/GeneFacePlusPlus/tasks/radnerfs/dataset_utils.py:266: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
self.lm68s = torch.tensor(self.lm2ds[:, index_lm68_from_lm478, :])
/root/GeneFacePlusPlus/inference/genefacepp_infer.py:184: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
eye_area_percents = torch.tensor(self.dataset.eye_area_percents)
Extracted wav file (16khz) from /tmp/gradio/4659f9a53f90af1cfac2c7e0990384bb1fe25590/aud.wav to /tmp/gradio/4659f9a53f90af1cfac2c7e0990384bb1fe25590/aud_16k.wav.
Loading the HuBERT Model...
/root/anaconda3/envs/geneface/lib/python3.9/site-packages/torch/_utils.py:776: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
return self.fget.get(instance, owner)()
Loading the Wav2Vec2 Processor...
GeneFace++ is rendering... : 0%| | 0/1360 [00:00<?, ?it/s]Setting up PyTorch plugin "bias_act_plugin"... Done.
Setting up PyTorch plugin "upfirdn2d_plugin"... Done.
GeneFace++ is rendering... : 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████| 1360/1360 [01:25<00:00, 15.85it/s]
Killed

Does anyone know why? How to solve it?

@wangjingyuancuc
Copy link

--low_memory_usage?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants