Temporal Action Localization Demo

Detecting the PoleVault action segments on the timeline of video

Detecting the GolfSwing action segments on the timeline of video

Dataset

Dataset	Video Number	train	validation	test	instances	classes
THUMOS14	413	-	200	213	6,363	20
ActivityNet-v1.3	19994	10,024	4,926	5,044	30791	200

Experimental Results

THUMOS14

Method	Conference	[email protected]	[email protected]	[email protected]	[email protected]	[email protected]	[email protected]	[email protected]
DBS	AAAI-2019	56.7	54.7	50.6	43.1	34.3	24.4	14.7
BSN	ECCV-2018	-	-	53.5	45.0	36.9	28.4	20.0
AGCN	AAAI-2020	59.3	59.6	57.1	51.6	38.6	28.9	17.0
GTAN	CVPR-2019	69.1	63.7	57.8	47.2	38.8	-	-
BMN	ICCV-2019	-	-	56.0	47.4	38.8	29.7	20.5
DBG	AAAI-2020	-	-	57.8	49.4	39.8	30.2	21.7
TAL-Net	CVPR-2018	59.8	57.1	53.2	48.5	42.8	33.8	20.8
PGCN	ICCV-2019	69.5	67.8	63.6	57.8	49.1	-	-
PBRNet	AAAI-2020	-	-	58.5	54.6	51.3	41.8	29.5
G-TAD	CVPR-2020	-	-	66.4	60.4	51.6	37.6	22.9
our method 1	-	74.5	72.3	68.6	62.8	54.4	41.4	27.8
our method 2	-	75.7	73.6	70.0	64.8	55.3	42.3	27.2
our method 3	-	77.2	75.2	71.4	66.2	58.2	44.4	27.2

ActivityNet-v1.3

Method	Conference	[email protected]	[email protected]	[email protected]	IoU@Avg
AGCN	AAAI-2020	30.4	-	-	-
TAL-Net	CVPR-2018	38.23	18.30	1.30	20.22
DBS	CVPR-2019	43.2	25.8	6.1	26.1
PGCN	ICCV-2019	42.90	28.14	2.47	26.99
BSN	ECCV-2018	46.45	29.96	8.02	30.03
BMN	ICCV-2019	50.07	34.78	8.29	33.85
G-TAD	CVPR-2020	50.36	34.60	9.02	34.09
GTAN	CVPR-2019	52.61	34.14	8.91	34.31
PBRNet	AAAI-2020	53.96	34.97	8.98	35.01

Related Papers

2020

• [DBG] Fast Learning of Temporal Action Proposal via Dense Boundary Generator - Chunming Lin et al, AAAI 2020. [code]
• [G-TAD] G-TAD: Sub-Graph Localization for Temporal Action Detection - Mengmeng Xu et al, CVPR 2020. [code]
• [PBRNet] Progressive Boundary Refinement Network for Temporal Action Detection - Qinying Liu et al, AAAI 2020.
• [AGCN] Graph Attention based Proposal 3D ConvNets for Action Detection - Jun Li et al, AAAI 2020.

2019

• [PGCN] Graph Convolutional Networks for Temporal Action Localization - Runhao Zeng et al, ICCV 2019. [code]
• [RAM] Relation Attention for Temporal Action Localization - Peihao Chen et al, TMM 2019.
• [BMN] BMN: Boundary-Matching Network for Temporal Action Proposal Generation - Tianwei Lin et al, ICCV 2019.
• [GTAN] Gaussian Temporal Awareness Networks for Action Localization - Fuchen Long et al, CVPR 2019.
• [DBS] Video Imprint Segmentation for Temporal Action Detection in Untrimmed Videos - Zhanning Gao et al, AAAI 2019.
• [C-TCN] Deep Concept-wise Temporal Convolutional Networks for Action Localization - Xin Li et al, arXiv 2019.