Complexity analysis of VVC encoding and decoding

This page and dataset are supplementary material for our paper titled "COMPLEXITY ANALYSIS OF NEXT-GENERATION VVC ENCODING AND DECODING". For more detailed analysis on this data, plesae refere to the preprint of our paper (accepted to be presented at IEEE ICIP 2020) on: https://arxiv.org/abs/2005.10801

Six video sequences have been encoded and decoded using VVC and HEVC (VTM 6 and HM 16 respectively), under different configurations and QPs, and all operations have been analyzed using Intel VTune 2019. The VTune outputs are reported in csv files in VTune_CSV_reports.zip.

Citation:

In case of using this dataset or the provided reports, please cite the following:

[1] Farhad Pakdaman, Mohammad Ali Adelimanesh, Moncef Gabbouj, Mahmoud Reza Hashemi,"Complexity Analysis Of Next-Generation VVC Encoding and Decoding", IEEE International Conference on Image Processing (ICIP), 2020.

[2] Farhad Pakdaman, Mohammad Ali Adelimanesh, Moncef Gabbouj, Mahmoud Reza Hashemi, "DATASET FOR COMPLEXITY ANALYSIS OF VVC ENCODING AND DECODING", IEEE Dataport, 2020. [Online]. Available: http://dx.doi.org/10.21227/p0rm-4b03.

Tabulated reports

The detailed results of this study have been categorized and tabulated through Tables 1-4 below.

Table. A1 VVC Encoder complexity break-down of different sequences, for Motion Estimation (ME), Intra Prediction (IP), Transform/QUantization (T/Q), Entropy Coding (EC), Loop Filters (LF), and Memory operations (Mem).

Seq	Conf	QP	ME	IP	T/Q	EC	LF	Mem
BQTerrace_1920x1080_60	LD	22	44.81	6.42	28.55	12.01	1.57	3.39
		27	55.57	4.41	23.74	7.01	3.1	2.89
		32	62.75	3.67	17.11	4.29	5.86	2.61
		37	64.51	3.23	13	2.95	9.52	2.35
	RA	22	42.12	8.21	30.91	10.85	1.3	3.69
		27	51.33	7.08	24.65	7.02	3.39	3.07
		32	55.46	7.27	18.82	5.23	6.22	2.86
		37	56.89	7.2	14.36	4.14	9.98	2.43
	AI	22	0	25.35	48.94	15.82	1.21	4.34
		27	0	29.12	46.16	14.91	1.26	3.96
		32	0	31.1	42.92	14.8	1.71	4.18
		37	0	33.31	40.59	13.62	2.52	3.77
BasketballDrive_1920x1080_50	LD	22	44.05	7.67	32.11	7.74	1.1	3.92
		27	52.44	7.05	24.88	5.99	1.88	3.32
		32	58.16	6.13	19.83	4.68	2.99	3.39
		37	60.86	5.41	16.61	3.76	5.02	3.05
	RA	22	42.75	9.8	31.55	7.84	1.12	3.87
		27	51.15	8.91	24.81	5.86	1.9	3.72
		32	57.83	7.27	20.08	4.48	3.05	3.27
		37	61.49	6.02	16.5	3.41	5.13	2.92
	AI	22	0	28.63	48.33	13.6	0.95	4.04
		27	0	31.51	44.41	12.36	1.82	4.14
		32	0	33.27	40.45	11.6	3.27	4.3
		37	0	31.43	38.36	10.49	7.11	4.1
Cactus_1920x1080_50	LD	22	45.34	6.79	31.15	8.63	1.37	3.5
		27	54.47	6.23	23.04	6.31	2.7	3.42
		32	59.62	5.65	18.49	4.64	3.92	3.19
		37	62.08	5.3	15.96	3.61	5.21	2.82
	RA	22	41.71	9.15	31.9	8.86	1.36	4.05
		27	50.14	9	24.55	6.49	2.6	3.59
		32	55.96	8.05	19.71	4.9	3.94	3.24
		37	59.5	7.21	16.36	3.81	5.34	2.93
	AI	22	0	26.51	49.55	14.99	0.74	4.15
		27	0	29.44	46.36	13.65	1.25	4.15
		32	0	31.42	42.75	13.28	1.93	4.43
		37	0	32.31	40.74	12.12	3.36	4.31
Johnny_1280x720_60	LD	22	62.85	3.63	17.53	4.52	5.56	2.76
		27	67.93	2.36	11.16	2.58	10.15	2.11
		32	68.61	1.96	7.87	1.74	13.48	2.03
		37	65.37	1.64	5.94	1.27	18.49	1.88
	RA	22	57.79	6.18	19.3	5.32	5.24	2.76
		27	61.41	5.37	13.39	3.6	9.82	2.38
		32	61.7	4.96	10.79	2.93	12.47	2.23
		37	57.16	5.08	9.6	2.54	17.03	2.02
	AI	22	0	30.08	44.55	14.06	1.98	4.07
		27	0	30.77	42.73	13.37	3.33	3.98
		32	0	31.28	40.52	12.52	5.03	3.92
		37	0	31.22	37.61	10.85	8.51	3.96
KristenAndSara_1280x720_60	LD	22	62.49	4.08	17.77	4.57	4.94	2.77
		27	66.66	3.22	12.65	3.15	8.13	2.3
		32	67.65	2.7	9.8	2.23	10.88	2.18
		37	66.23	2.18	7.6	1.61	14.85	2.08
	RA	22	57.08	6.69	19.86	5.62	4.58	2.85
		27	61.33	5.72	14.43	3.91	8.11	2.49
		32	62.31	5.31	11.74	3.16	10.19	2.34
		37	58.05	5.29	10.17	2.8	15.36	2.1
	AI	22	0	29.72	44.68	14.1	1.96	4.14
		27	0	30.05	42.94	13.73	3.13	4.38
		32	0	31.5	40.12	13.18	4.51	4.17
		37	0	30.58	38.7	12.01	7.25	4.08
DaylightRoad2_3840x2160_60_10b	LD	22	21.49	7.23	41.03	23.96	0.31	3.25
		27	22.28	7.45	41.65	22.11	0.34	3.32
		32	23.33	7.73	42.09	20.07	0.37	3.29
		37	24.34	8.15	42.15	18.14	0.42	3.52
	AI	22	0	23.55	46.62	22.48	0.6	3.27
		27	0	23.54	47.14	21.92	0.59	3.35
		32	0	24.47	47.07	20.85	0.6	3.5
		37	0	23.8	48.45	19.79	0.67	3.64

Table. A2 HEVC Encoder complexity break-down

Seq	Conf	QP	ME	IP	T/Q	EC	LF	Mem
BQTerrace_1920x1080_60	LD	22	53.27	1.96	37.45	1.94	0.08	4.99
		27	68.61	0.98	23.28	0.84	0.1	5.85
		32	77.12	0.48	16.27	0.53	0.1	5.11
		37	80.55	0.25	13.34	0.42	0.11	4.96
	RA	22	49.61	2.06	40.32	2.06	0.11	5.46
		27	63.95	1.12	26.55	0.97	0.13	6.83
		32	71.73	0.69	20.35	0.63	0.14	5.95
		37	74.93	0.5	17.38	0.54	0.15	6.02
	AI	22	0	15.88	71.91	3.61	0.39	6.87
		27	0	17.96	68.76	3.09	0.49	8.45
		32	0	21	66.44	2.68	0.54	7.98
		37	0	23.24	62.86	2.44	0.6	9.49
BasketballDrive_1920x1080_50	LD	22	60.21	1.82	31.41	1.22	0.07	5
		27	68.62	1.45	23.68	0.78	0.08	5.08
		32	73.92	1.04	18.98	0.6	0.09	5.07
		37	76.97	0.81	16.29	0.49	0.09	5
	RA	22	54.77	1.95	35.8	1.4	0.11	5.59
		27	63.1	1.66	27.96	0.99	0.12	5.79
		32	67.86	1.3	23.38	0.82	0.12	6.09
		37	71.47	1.03	20.71	0.68	0.13	5.51
	AI	22	0	17.77	70.72	2.94	0.45	6.88
		27	0	21.62	65.27	2.43	0.59	8.8
		32	0	24.12	62.14	2.12	0.59	9.65
		37	0	25.2	60.77	2.08	0.61	10.05
Cactus_1920x1080_50	LD	22	56.1	1.88	35.04	1.44	0.09	5.15
		27	67.08	1.34	25	0.82	0.09	5.34
		32	72.97	0.93	19.45	0.72	0.1	5.49
		37	75.95	0.71	16.94	0.52	0.1	5.43
	RA	22	51.56	1.89	38.64	1.65	0.12	5.74
		27	61.91	1.45	28.71	1.02	0.12	6.31
		32	67.44	1.15	23.71	0.82	0.14	6.25
		37	70.07	0.94	20.99	0.65	0.14	6.7
	AI	22	0	16.53	72.23	3.27	0.41	6.22
		27	0	19.79	68.31	2.59	0.56	7.49
		32	0	22.58	64.21	2.3	0.6	8.94
		37	0	24.61	62.04	2.13	0.62	9.25
Johnny_1280x720_60	LD	22	71.02	0.91	21.34	0.65	0.1	5.62
		27	77.28	0.46	15.7	0.48	0.1	5.58
		32	79.19	0.23	14.06	0.45	0.11	5.57
		37	79.77	0.15	13.62	0.36	0.11	5.57
	RA	22	66.08	1.09	25.05	0.77	0.14	6.34
		27	71.53	0.66	20	0.73	0.15	6.35
		32	73.33	0.53	18.2	0.61	0.15	6.58
		37	73.4	0.45	17.79	0.64	0.17	6.99
	AI	22	0	20.98	66.1	2.74	0.57	8.33
		27	0	23.28	63.48	2.38	0.6	9.07
		32	0	24.96	61	2.33	0.6	9.69
		37	0	26.12	59.41	2.08	0.63	10.44
KristenAndSara_1280x720_60	LD	22	71.36	0.94	21.03	0.73	0.1	5.46
		27	76.84	0.52	15.96	0.54	0.1	5.66
		32	78.92	0.28	14.26	0.49	0.1	5.58
		37	80.16	0.19	13.36	0.46	0.11	5.34
	RA	22	67.26	1.03	24.01	0.89	0.14	6.17
		27	71.04	0.65	20.47	0.7	0.13	6.44
		32	72.95	0.57	18.44	0.59	0.16	6.73
		37	73.74	0.52	17.94	0.62	0.16	6.51
	AI	22	0	20.81	66.38	2.64	0.57	8.26
		27	0	23.49	63.21	2.58	0.6	8.88
		32	0	24.46	61.33	2.28	0.64	9.75
		37	0	25.43	60.31	2.13	0.6	10.23
DaylightRoad2_3840x2160_60_10b	LD	22	31.41	2.3	57.06	5.02	0.05	3.82
		27	32.51	2.33	56.44	4.77	0.05	3.57
		32	34.54	2.49	54.55	4.32	0.06	3.75
		37	37.25	2.61	51.72	3.86	0.06	4.22
	AI	22	0	14.65	73.91	5.22	0.35	4.29
		27	0	14.96	73.71	4.99	0.36	4.47
		32	0	15.36	73.02	5.03	0.39	4.69
		37	0	15.86	71.91	4.64	0.39	5.8

Table. A3 VVC Decoder complexity break-down of different sequences, for Motion Compensation (MC), Intra Prediction (IP), Inverse Transform/ Inverse Quantization (IT/IQ), Entropy Decoding (ED), Loop Filters (LF), and Memory operations (Mem).

Seq	Conf	QP	MC	IP	IT/IQ	ED	LF	Mem
BQTerrace_1920x1080_60	LD	22	18.81	0.45	6.19	27.06	29.82	5.37
		27	21.5	0.6	3.29	14.17	33.27	10.72
		32	25.65	0.42	2.55	9.06	34.62	10
		37	27.98	0.94	1.06	4.8	31.73	14.85
	RA	22	21.74	1.26	4.14	23.86	29.98	6.99
		27	29.82	1.69	2.33	12.31	34.57	7.3
		32	39.04	2.2	1.83	7.29	29.46	7.73
		37	41.11	2.68	1.34	5.47	26.6	7.39
	AI	22	0	11.09	8.22	39.47	24.74	3.63
		27	0	13.83	6.82	34.49	28.11	5.97
		32	0	14.43	12.38	21.8	32.12	7.88
		37	0	15.32	6.93	19.45	36.41	10.41
BasketballDrive_1920x1080_50	LD	22	15.79	3.2	8.23	18.26	32.72	7.34
		27	19.19	2.9	7.13	12.72	35.81	7.97
		32	21.96	2.28	9.43	9.11	33.67	9.6
		37	24.28	1.57	5.24	8.08	34.59	7
	RA	22	21.35	4.66	5.66	17.9	32.33	6.9
		27	27.5	4.51	5.52	10.01	32.39	8.5
		32	30.89	3.14	6.22	6.54	31.97	7.38
		37	37.65	2.97	2.97	5.86	32	6.33
	AI	22	0	11.58	9.71	31.49	28.2	9.27
		27	0	9.69	8.89	29.66	34.64	5.72
		32	0	15.99	11.42	15.22	39.61	7.62
		37	0	16.51	9.88	10.04	41.27	12.56
Cactus_1920x1080_50	LD	22	21.34	0.82	6.86	20.33	31.01	6.46
		27	22.13	2	6.92	10.66	35.61	8.47
		32	24.69	1.08	4.49	7.66	37.89	7.55
		37	24.46	0.65	6.06	6.82	33.9	9.76
	RA	22	21.99	2.6	6.38	19.34	30.21	7.39
		27	29.39	1.84	4.07	10.71	33.05	7.68
		32	30.62	1.57	3.84	7.66	34.55	7.98
		37	32.39	4.08	2.91	7.42	28.55	5.6
	AI	22	0	13	10.54	37.21	24.05	5.27
		27	0	15.65	11.17	26.24	33.33	3.89
		32	0	14.59	7.29	22.33	35.24	10.34
		37	0	15.19	6.85	18.63	38.01	9.9
Johnny_1280x720_60	LD	22	22.65	0	3.63	10.49	35.66	6.46
		27	23.39	0	4.07	7.2	29.24	10.18
		32	25.71	0.61	2.45	4.29	24.49	4.9
		37	27.33	1.48	0.74	5.17	25.55	6.16
	RA	22	29.91	1.26	2.02	9.31	35.75	7.29
		27	35.73	2.32	1.39	5.11	30.63	6.03
		32	35.49	0.58	0.57	6.87	20.01	10.87
		37	35.47	1.87	1.87	6.08	18.03	6.84
	AI	22	0	8.22	5.48	34.22	28.77	9.58
		27	0	15.01	10.04	23.4	33.41	1.67
		32	0	9.45	11.32	11.32	35.91	11.34
		37	0	10.93	17.53	13.12	32.9	4.36
KristenAndSara_1280x720_60	LD	22	15.45	1.22	4.47	13.32	32.99	9.36
		27	21.96	0.49	2.47	8.29	34.05	10.86
		32	23.96	0.58	1.74	4.69	32.75	6.96
		37	28	0.7	1.4	4.73	19.62	7.71
	RA	22	34.58	1.18	1.97	7.85	32.6	4.32
		27	34.03	1.39	2.31	4.62	32.69	6.01
		32	34.38	1.14	1.14	7.59	19.58	5.69
		37	42.38	1.19	1.79	5.67	21.32	3.58
	AI	22	0	7.7	14.1	30.75	32.07	1.28
		27	0	13.62	6.05	19.18	33.31	4.54
		32	0	12.74	8.66	19.16	30.73	12.2
		37	0	7.27	11.63	10.65	39.81	13.56
DaylightRoad2_3840x2160_60_10b	LD	22	6.15	4.26	4.95	45.14	18.38	3.13
		27	7.87	3.97	5.2	43.6	21.05	3.58
		32	8.74	4	4.88	40.57	24.35	3.71
		37	9.98	3.72	4.79	37.73	26.78	4.11
	AI	22	0	7.93	6.92	43.75	17.02	3.79
		27	0	6.79	6.27	47.71	17.96	3.13
		32	0	6.5	8.64	46.26	18.23	5.19
		37	0	6.94	11.42	41.67	20.77	6.15

Table. A4 HEVC Decoder complexity break-down

Seq	Conf	QP	MC	IP	IT/IQ	ED	LF	Mem
BQTerrace_1920x1080_60	LD	22	32.16	0.52	6.51	19.4	15.79	6.22
		27	37.83	0.67	5.09	7.19	16.65	9.71
		32	43.09	0.87	2.69	2.93	13.37	10.21
		37	45.75	0.88	1.23	1.43	11.79	10.17
	RA	22	31.28	3.02	6.52	16.15	16.23	6.14
		27	38.38	2.32	3.85	6.99	14.15	9.16
		32	44.46	2.21	2.71	3.52	11.64	8.35
		37	46.1	2.44	1.6	1.56	10.79	8.38
	AI	22	0	20.16	10.71	29.56	13.32	4.17
		27	0	22.76	11.73	21.9	18.52	5.63
		32	0	23.97	12.43	17.04	21.87	5.34
		37	0	28.89	10.08	11.43	22.98	6.56
BasketballDrive_1920x1080_50	LD	22	29.18	3.99	12.05	12.01	17.04	7.01
		27	33.12	3.95	11.26	6	16.51	8.22
		32	35.07	2.77	9.42	4.41	14.69	9.04
		37	37.16	3.07	7.08	2.2	14.88	8.89
	RA	22	28.94	6.87	9.03	10.1	16.78	7.55
		27	35.35	4.84	8.32	5.45	14.37	8.07
		32	38.26	5.14	5.55	3.27	14.03	8.07
		37	39.39	4.17	5.51	2.18	13.41	8.35
	AI	22	0	19.91	16.31	21.57	17.04	5.47
		27	0	23.01	17.65	11.6	21.69	5.99
		32	0	24.3	18.02	8.2	23.04	6.6
		37	0	23.41	19.71	5.88	22	7.87
Cactus_1920x1080_50	LD	22	24.84	1.75	9.37	15.42	18.23	8.53
		27	25.76	1.48	9.37	7.98	18.13	10.32
		32	26.79	1.95	7.66	3.8	17.38	11.02
		37	23.56	1.81	7.05	2.6	17.02	11.79
	RA	22	26.15	4.43	6.25	13.43	17.88	8.83
		27	29.7	4.42	6.81	6.59	15.15	8.98
		32	31.05	3.85	5.27	3.27	14.93	10.82
		37	32.26	3.1	4.85	2.18	14.44	10.92
	AI	22	0	20.53	12.26	27.13	15.27	4.55
		27	0	24.19	14.1	17.1	21.04	5.19
		32	0	24.62	14.5	13.02	22.96	6.26
		37	0	26.33	14.42	8.15	22.89	7.79
Johnny_1280x720_60	LD	22	26.88	0.35	4.59	6.51	17.02	10.35
		27	28.17	0.71	3.75	1.83	14.13	12.03
		32	25.45	0.7	1.83	1.47	13.86	11.81
		37	19.54	0.69	1.96	0.61	14.34	15.09
	RA	22	30.83	2.01	3.06	6.22	14.83	8.66
		27	32.62	2.16	2.74	1.77	12.43	11.53
		32	32.26	1.8	1.92	1.52	13.03	9.84
		37	31.07	2.27	1.17	1.11	11.74	10.64
	AI	22	0	21.65	14.62	13.63	20.79	6.26
		27	0	26.01	12.43	10.03	21.3	6.54
		32	0	25.56	12.45	6.77	22.59	6.15
		37	0	25.79	11.84	5.31	23.55	7.87
KristenAndSara_1280x720_60	LD	22	29.88	0.74	5.33	5.44	18.51	8.96
		27	28.95	0.72	3.34	1.97	15.1	12.62
		32	25.06	0.82	3.18	1.84	16.35	13.1
		37	25.42	1.04	0.72	0.8	14.86	13.41
	RA	22	31.52	2.35	3.25	5.24	16.78	9.73
		27	32.67	2.11	2.03	2.55	13.49	10.18
		32	34.34	2.25	1.95	1.32	13.11	8.95
		37	30.81	2.44	1.04	0.75	12.96	11.59
	AI	22	0	22.62	13.03	15.96	21.51	5.84
		27	0	23.27	12.91	13.57	22.34	6.33
		32	0	24.54	14.1	9.13	22.98	5.27
		37	0	25.51	12.97	6.63	22.26	7.53
DaylightRoad2_3840x2160_60_10b	LD	22	7.31	7.22	4.01	39.6	9.4	4.1
		27	7.91	8.33	5.78	39.97	11.94	4.64
		32	9.88	10.01	5.23	34.69	13.82	5.31
		37	8.97	10.27	5.95	33.63	15.16	5.44
	AI	22	0	17.39	4.5	37.72	10.93	3.6
		27	0	18.02	5.17	37.95	11.8	3.48
		32	0	21.09	4.51	35.96	12.83	3.71
		37	0	20.79	5.63	34.63	14.15	4.59