3060 12G GPU can run normally, but the speed is too slow. I hope it can be optimized.

[Crazy-CYZ]

Number of frames in a batch 3

[williamyang1991]

You can speed up the process by turning off some functions (sacrifice same performance)

modify

FRESCO/run_fresco.py

Lines 232 to 234 in 9fe1be7

	apply_FRESCO_opt(pipe, steps = timesteps[:config['end_opt_step']],
	flows = flows, occs = occs, correlation_matrix=correlation_matrix,
	saliency=saliency, optimize_temporal = True)

based on

FRESCO/run_fresco.py

Lines 223 to 225 in 9fe1be7

	* Turn off Spatial-guided optimization: set optimize_temporal = False in apply_FRESCO_opt()
	* Turn off Temporal-guided optimization: set correlation_matrix = [] in apply_FRESCO_opt()
	* Turn off FRESCO-guided optimization: disable_FRESCO_opt(pipe)

[jinwyp]

On 3080ti the GPU usage is under 30%, most of time is only 1%

[jinwyp]

I have done some test list below on 3080ti :

This processing time is only for processing the time of the first 3 keyframes.

1. Default setting
   ===== time: 171.90519642829895 sec

2. Turn off Spatial-guided optimization: set optimize_temporal = False in apply_FRESCO_opt()
   ===== time: 47.287460803985596 sec

3. Turn off Temporal-guided optimization: set correlation_matrix = [] in apply_FRESCO_opt()
   ===== time: 25.293941736221313 sec

Turn off Spatial-guided optimization: set optimize_temporal = False in apply_FRESCO_opt()
Turn off Temporal-guided optimization: set correlation_matrix = [] in apply_FRESCO_opt()
===== time: 15.881555318832397 sec

[williamyang1991]

My run_fresco.ipynb ran on 4090 GPU,
the running time for 8 frames is

1. Default setting: 26s
2. Turn off all optimization: 3s

I have done some test list below on 3080ti :

This processing time is only for processing the time of the first 3 keyframes.

1. Default setting
   ===== time: 171.90519642829895 sec
2. Turn off Spatial-guided optimization: set optimize_temporal = False in apply_FRESCO_opt()
   ===== time: 47.287460803985596 sec
3. Turn off Temporal-guided optimization: set correlation_matrix = [] in apply_FRESCO_opt()
   ===== time: 25.293941736221313 sec

Turn off Spatial-guided optimization: set optimize_temporal = False in apply_FRESCO_opt() Turn off Temporal-guided optimization: set correlation_matrix = [] in apply_FRESCO_opt() ===== time: 15.881555318832397 sec