Merge pull request #22 from hmorimitsu/gma

Gma

README.md

@@ -26,6 +26,7 @@ This is still under development, so some things may not work as intended. I plan
 - DICL-Flow [https://arxiv.org/abs/2010.14851](https://arxiv.org/abs/2010.14851)
 - FlowNet - [https://arxiv.org/abs/1504.06852](https://arxiv.org/abs/1504.06852)
 - FlowNet2 - [https://arxiv.org/abs/1612.01925](https://arxiv.org/abs/1612.01925)
+- GMA - [https://arxiv.org/abs/2104.02409](https://arxiv.org/abs/2104.02409)
 - HD3 - [https://arxiv.org/abs/1812.06264](https://arxiv.org/abs/1812.06264)
 - IRR - [https://arxiv.org/abs/1904.05290](https://arxiv.org/abs/1904.05290)
 - LCV - [https://arxiv.org/abs/2007.11431](https://arxiv.org/abs/2007.11431)
@@ -35,7 +36,8 @@ This is still under development, so some things may not work as intended. I plan
 - MaskFlownet [https://arxiv.org/abs/2003.10955](https://arxiv.org/abs/2003.10955)
 - PWCNet - [https://arxiv.org/abs/1709.02371](https://arxiv.org/abs/1709.02371)
 - RAFT - [https://arxiv.org/abs/2003.12039](https://arxiv.org/abs/2003.12039)
-- ScopeFlow -  [https://arxiv.org/abs/2002.10770](https://arxiv.org/abs/2002.10770)
+- ScopeFlow - [https://arxiv.org/abs/2002.10770](https://arxiv.org/abs/2002.10770)
+- SCV - [https://arxiv.org/abs/2104.02166](https://arxiv.org/abs/2104.02166)
 - STaRFlow -  [https://arxiv.org/abs/2007.05481](https://arxiv.org/abs/2007.05481)
 - VCN - [https://papers.nips.cc/paper/2019/file/bbf94b34eb32268ada57a3be5062fe7d-Paper.pdf](https://papers.nips.cc/paper/2019/file/bbf94b34eb32268ada57a3be5062fe7d-Paper.pdf)
 

docs/source/models/checkpoint_list.csv

@@ -9,6 +9,10 @@ flownetcs-things-4bdecffa.ckpt,FlowNet2-CS_checkpoint,
 flownetcss-things-b42e67d0.ckpt,FlowNet2-CSS_checkpoint,
 flownets-things-98cde14d.ckpt,FlowNet2-S_checkpoint,
 flownetsd-things-c5f3124e.ckpt,FlowNet2-SD_checkpoint,
+gma-chairs-d4ec321d.ckpt,gma-chairs.pth,https://github.com/zacjiang/GMA
+gma-things-90aafb63.ckpt,gma-things.pth,
+gma-sintel-98d6f3d0.ckpt,gma-sintel.pth,
+gma-kitti-8ca3ec80.ckpt,gma-kitti.pth,
 hd3-chairs-0d46c9fd.ckpt,hd3f_chairs-04bf114d.pth,https://github.com/ucbdrive/hd3
 hd3-kitti-6eb77dd3.ckpt,hd3f_chairs_things-462a3896.pth,
 hd3-sintel-10689995.ckpt,hd3f_chairs_things_kitti-41b15827.pth,
@@ -51,6 +55,12 @@ scopeflow-chairs-ebfaa62d.ckpt,c1.ckpt,https://github.com/avirambh/ScopeFlow
 scopeflow-kitti-a20c434d.ckpt,kitti_comb.ckpt,
 scopeflow-sintel-21a91683.ckpt,sintel_comb.ckpt,
 scopeflow-things-70e22d63.ckpt,t3.ckpt,
+scv-eighth-chairs-8ba57294.ckpt,eighth/scv-chairs.pth,https://github.com/zacjiang/SCV
+scv-eighth-things-9c893323.ckpt,eighth/scv-things.pth,
+scv-quarter-chairs-4726627e.ckpt,quarter/scv-chairs.pth,
+scv-quarter-kitti-e86c7953.ckpt,quarter/scv-kitti.pth,
+scv-quarter-sintel-2d9b4a05.ckpt,quarter/scv-sintel.pth,
+scv-quarter-things-0dac9b66.ckpt,quarter/scv-things.pth,
 starflow-kitti-34b9a3ed.ckpt,StarFlow_kitti,https://github.com/pgodet/star_flow
 starflow-sintel-3c06b844.ckpt,StarFlow_sintel,
 starflow-things-d3966a93.ckpt,StarFlow_things,

docs/source/models/models_list.rst

@@ -33,6 +33,17 @@ Flownet
 
 - Model names: ``flownets``, ``flownetc``, ``flownet2``, ``flownetcs``, ``flownetcss``, ``flownetsd``
 
+GMA
+---
+
+`[source code] <https://github.com/hmorimitsu/ptlflow/tree/main/ptlflow/models/gma>`__
+
+- Paper: **Learning to Estimate Hidden Motions with Global Motion Aggregation** - `https://arxiv.org/abs/2104.02409 <https://arxiv.org/abs/2104.02409>`_
+
+- Reference code: `https://github.com/zacjiang/GMA <https://github.com/zacjiang/GMA>`_
+
+- Model names: ``gma``
+
 HD3
 ---
 
@@ -145,6 +156,17 @@ ScopeFlow
 
 - Model names: ``scopeflow``
 
+SCV
+---
+
+`[source code] <https://github.com/hmorimitsu/ptlflow/tree/main/ptlflow/models/scv>`__
+
+- Paper: **Learning Optical Flow from a Few Matches** - `https://arxiv.org/abs/2104.02166 <https://arxiv.org/abs/2104.02166>`_
+
+- Reference code: `https://github.com/zacjiang/SCV <https://github.com/zacjiang/SCV>`_
+
+- Model names: ``scv4``, ``scv8``
+
 STaRFlow
 --------
 

docs/source/results/metrics_all.csv

@@ -9,6 +9,10 @@ flownetcs,things,4.164,0.735,0.857,0.892,0.14,9.498,3.21,0.337,0.763,0.6,0.882,0
 flownetcss,things,4.021,0.754,0.864,0.898,0.132,9.299,3.061,0.366,0.782,0.617,0.889,0.711,0.919,0.372,0.108,,,2.989,0.809,0.901,0.925,0.096,7.863,2.096,0.412,0.84,0.671,0.926,0.758,0.946,0.318,0.072,,,4.657,0.601,0.79,0.841,0.202,,11.901,0.491,0.657,0.711,0.338,
 flownets,things,5.244,0.567,0.793,0.851,0.205,11.214,4.153,0.23,0.584,0.517,0.816,0.633,0.874,0.475,0.182,,,3.958,0.588,0.82,0.876,0.178,9.464,2.943,0.242,0.607,0.546,0.845,0.665,0.9,0.446,0.152,,,7.723,0.212,0.561,0.683,0.435,,14.812,0.236,0.479,0.58,0.519,
 flownetsd,things,7.821,0.656,0.781,0.821,0.219,14.408,6.687,0.313,0.674,0.523,0.802,0.611,0.841,0.47,0.198,,,7.616,0.687,0.8,0.836,0.2,13.937,6.483,0.333,0.707,0.552,0.821,0.642,0.856,0.441,0.179,,,17.258,0.207,0.414,0.495,0.586,,24.21,0.27,0.424,0.489,0.576,
+gma,chairs,4.135,0.721,0.886,0.914,0.11,10.129,3.002,0.381,0.747,0.657,0.912,0.734,0.936,0.331,0.085,,,2.371,0.8,0.927,0.949,0.069,7.022,1.529,0.456,0.828,0.712,0.954,0.791,0.97,0.273,0.044,,,4.6,0.364,0.722,0.821,0.268,,9.983,0.38,0.639,0.725,0.352,
+gma,things,2.867,0.846,0.912,0.932,0.084,7.397,2.031,0.529,0.874,0.728,0.934,0.79,0.951,0.26,0.063,,,1.41,0.902,0.956,0.969,0.041,4.679,0.808,0.599,0.933,0.795,0.977,0.853,0.985,0.191,0.022,,,2.07,0.703,0.889,0.93,0.097,,4.754,0.63,0.815,0.862,0.166,
+gma,sintel,1.384,0.885,0.944,0.961,0.052,4.108,0.91,0.606,0.91,0.794,0.962,0.852,0.975,0.191,0.035,,,0.723,0.925,0.969,0.979,0.028,2.889,0.363,0.659,0.953,0.835,0.986,0.886,0.992,0.15,0.012,,,1.313,0.803,0.938,0.964,0.045,,1.549,0.769,0.92,0.951,0.053,
+gma,kitti,6.577,0.762,0.858,0.885,0.14,13.73,5.215,0.4,0.79,0.6,0.884,0.677,0.908,0.389,0.115,,,4.75,0.809,0.896,0.917,0.102,11.076,3.559,0.438,0.841,0.646,0.923,0.721,0.941,0.342,0.076,,,1.526,0.812,0.937,0.96,0.049,,0.767,0.859,0.958,0.977,0.022,
 hd3,chairs,9.722,0.605,0.834,0.857,0.163,18.102,8.202,0.281,0.628,0.558,0.863,0.637,0.882,0.432,0.135,,,4.918,0.768,0.902,0.918,0.096,11.97,3.57,0.341,0.803,0.631,0.934,0.713,0.945,0.358,0.065,,,12.219,0.312,0.574,0.635,0.423,,21.716,0.268,0.483,0.533,0.515,
 hd3,kitti,44.813,0.591,0.698,0.72,0.301,57.818,42.809,0.278,0.607,0.47,0.715,0.537,0.736,0.522,0.284,,,37.062,0.64,0.732,0.75,0.267,49.044,35.034,0.296,0.662,0.501,0.752,0.568,0.768,0.49,0.247,,,1.262,0.827,0.936,0.959,0.048,,1.943,0.726,0.902,0.937,0.067,
 hd3,sintel,1.603,0.86,0.931,0.951,0.065,5.007,1.033,0.488,0.894,0.732,0.956,0.811,0.97,0.254,0.041,,,2.311,0.892,0.941,0.953,0.058,7.353,1.299,0.508,0.93,0.737,0.968,0.804,0.975,0.253,0.032,,,6.301,0.647,0.814,0.849,0.181,,15.291,0.566,0.707,0.739,0.29,
@@ -51,6 +55,10 @@ scopeflow,chairs,3.95,0.812,0.886,0.909,0.11,9.882,2.884,0.415,0.843,0.634,0.913
 scopeflow,kitti,10.458,0.705,0.811,0.841,0.187,16.912,9.423,0.361,0.727,0.572,0.832,0.651,0.86,0.418,0.167,0,,8.111,0.753,0.847,0.872,0.152,15.348,6.695,0.389,0.779,0.606,0.87,0.681,0.893,0.385,0.129,0,,1.002,0.852,0.95,0.969,0.036,,1.337,0.81,0.933,0.958,0.045,
 scopeflow,sintel,2.461,0.85,0.917,0.938,0.079,6.752,1.721,0.507,0.879,0.718,0.939,0.789,0.956,0.268,0.057,0.762,,1.63,0.895,0.947,0.96,0.051,5.769,0.885,0.544,0.927,0.753,0.969,0.818,0.978,0.233,0.03,0.78,,2.076,0.749,0.905,0.939,0.079,,6.084,0.646,0.813,0.853,0.168,
 scopeflow,things,3.269,0.813,0.895,0.92,0.102,8.326,2.365,0.435,0.843,0.662,0.919,0.742,0.941,0.326,0.078,0.726,,1.832,0.872,0.936,0.953,0.061,6.235,1.024,0.491,0.906,0.722,0.961,0.797,0.973,0.265,0.037,0.754,,3.465,0.671,0.849,0.892,0.139,,9.784,0.556,0.725,0.775,0.266,
+scv4,chairs,4.897,0.735,0.887,0.91,0.11,11.262,3.664,0.421,0.759,0.668,0.911,0.738,0.93,0.321,0.086,,,2.201,0.839,0.939,0.955,0.058,7.053,1.275,0.509,0.869,0.743,0.964,0.809,0.975,0.243,0.034,,,6.25,0.355,0.691,0.785,0.303,,13.192,0.391,0.63,0.698,0.365,
+scv4,kitti,7.102,0.751,0.837,0.862,0.162,14.108,5.763,0.409,0.777,0.601,0.859,0.674,0.881,0.389,0.14,,,6.617,0.803,0.875,0.893,0.123,13.3,5.282,0.449,0.834,0.643,0.9,0.711,0.914,0.346,0.099,,,3.127,0.824,0.932,0.952,0.055,,2.498,0.824,0.93,0.953,0.046,
+scv4,sintel,2.646,0.878,0.93,0.945,0.066,6.905,1.808,0.596,0.905,0.773,0.95,0.824,0.962,0.215,0.047,,,1.529,0.934,0.966,0.974,0.032,5.395,0.727,0.669,0.963,0.83,0.985,0.874,0.989,0.157,0.015,,,2.527,0.817,0.931,0.954,0.055,,3.591,0.764,0.902,0.931,0.072,
+scv4,things,3.849,0.826,0.892,0.915,0.105,9.543,2.728,0.508,0.854,0.706,0.915,0.765,0.934,0.283,0.083,,,1.796,0.888,0.942,0.959,0.056,6.172,0.944,0.594,0.92,0.788,0.964,0.843,0.976,0.199,0.036,,,4.232,0.711,0.85,0.885,0.143,,9.847,0.624,0.755,0.791,0.237,
 starflow,kitti,7.231,0.671,0.812,0.849,0.187,14.124,5.966,0.32,0.693,0.556,0.835,0.643,0.871,0.435,0.163,0.566,,5.011,0.73,0.852,0.884,0.145,11.722,3.743,0.349,0.757,0.594,0.879,0.68,0.908,0.396,0.119,0.564,,1.712,0.757,0.919,0.949,0.064,,2.818,0.662,0.855,0.9,0.116,
 starflow,sintel,2.022,0.838,0.916,0.939,0.08,5.965,1.375,0.48,0.867,0.712,0.938,0.79,0.957,0.274,0.058,0.729,,1.6,0.881,0.943,0.958,0.055,5.565,0.893,0.515,0.915,0.745,0.966,0.816,0.977,0.243,0.032,0.749,,3.545,0.689,0.86,0.901,0.128,,7.819,0.59,0.763,0.811,0.223,
 starflow,things,3.584,0.796,0.891,0.918,0.105,8.654,2.665,0.423,0.825,0.663,0.915,0.744,0.938,0.324,0.081,0.703,,1.822,0.862,0.936,0.953,0.062,6.033,1.031,0.479,0.896,0.726,0.96,0.802,0.973,0.261,0.038,0.735,,4.145,0.635,0.823,0.869,0.166,,9.74,0.535,0.713,0.766,0.276,

docs/source/results/speed_benchmark-all.csv

@@ -1,32 +1,35 @@
 Model,Params,Time(ms)
-dicl,11226036,203.662
-flownet2,162518834,197.049
-flownetc,39175298,81.775
-flownetcs,77870620,104.898
-flownetcss,116565942,129.86
-flownets,38676506,16.515
-flownetsd,45371666,28.897
-hd3,39561975,119.342
-hd3_ctxt,39942647,124.485
-irr_pwc,6362092,308.341
-irr_pwcnet,8639230,58.236
-irr_pwcnet_irr,3354146,63.723
-lcv_raft,5323328,271.876
-lcv_raft_small,1006674,73.975
-liteflownet,5379613,140.006
-liteflownet2,6429120,57.766
-liteflownet2_pseudoreg,6492907,68.43
-liteflownet3,7524188,101.811
-liteflownet3_pseudoreg,7587975,112.374
-liteflownet3s,8005810,104.016
-liteflownet3s_pseudoreg,8069597,114.595
-maskflownet,20655716,125.261
-maskflownet_s,10514256,71.534
-pwcnet,8243008,50.501
-pwcdcnet,9374274,62.267
-raft,5257536,266.73
-raft_small,990162,75.557
-scopeflow,6362092,330.811
-starflow,4772256,272.533
-vcn,10310781,293.394
-vcn_small,8370804,99.136
+dicl,11226036,98.89
+flownet2,162518834,134.466
+flownetc,39175298,50.588
+flownetcs,77870620,61.348
+flownetcss,116565942,78.742
+flownets,38676506,11.257
+flownetsd,45371666,18.575
+gma,5879873,172.245
+hd3,39561975,73.798
+hd3_ctxt,39942647,74.583
+irr_pwc,6362092,164.908
+irr_pwcnet,8639230,31.728
+irr_pwcnet_irr,3354146,35.898
+lcv_raft,5323328,133.956
+lcv_raft_small,1006674,45.429
+liteflownet,5379613,82.569
+liteflownet2,6429120,32.58
+liteflownet2_pseudoreg,6492907,40.102
+liteflownet3,7524188,55.053
+liteflownet3_pseudoreg,7587975,62.607
+liteflownet3s,8005810,56.656
+liteflownet3s_pseudoreg,8069597,64.378
+maskflownet,20655716,66.67
+maskflownet_s,10514256,37.186
+pwcnet,8243008,28.271
+pwcdcnet,9374274,33.085
+raft,5257536,133.857
+raft_small,990162,45.269
+scopeflow,6362092,174.195
+scv4,5236240,933.896
+scv8,5347264,341.227
+starflow,4772256,139.875
+vcn,10310781,149.529
+vcn_small,8370804,54.778

docs/source/results/speed_plot.rst

@@ -9,7 +9,7 @@ Inference speed vs. Trainable parameters
 Environment
 -----------
 
-- GPU: Tesla T4
+- GPU: RTX 3060Ti
 
 - CUDA: 11.2
 

docs/source/results/summarized_metrics-epe.csv

@@ -9,25 +9,29 @@ flownetcs,things,4.164,3.131,5.028,12.517
 flownetcss,things,4.021,2.989,4.657,11.901
 flownets,things,5.244,3.958,7.723,14.812
 flownetsd,things,7.821,7.616,17.258,24.21
+gma,chairs,4.135,2.371,4.6,9.983
+gma,things,2.867,1.41,2.07,4.754
+gma,sintel,1.384,0.723,1.313,1.549
+gma,kitti,6.577,4.75,1.526,0.767
+hd3,things,6.501,3.214,6.854,14.505
+hd3,sintel,1.603,2.311,6.301,15.291
 hd3,chairs,9.722,4.918,12.219,21.716
 hd3,kitti,44.813,37.062,1.262,1.943
-hd3,sintel,1.603,2.311,6.301,15.291
-hd3,things,6.501,3.214,6.854,14.505
-hd3_ctxt,things,4.421,2.072,4.645,9.959
-hd3_ctxt,sintel,1.737,2.103,5.058,13.45
 hd3_ctxt,chairs,5.792,3.727,13.695,22.971
 hd3_ctxt,kitti,7.858,6.016,0.999,1.536
+hd3_ctxt,sintel,1.737,2.103,5.058,13.45
+hd3_ctxt,things,4.421,2.072,4.645,9.959
+irr_pwc,sintel,2.443,1.85,2.581,7.968
 irr_pwc,chairs_occ,3.947,2.315,3.887,10.672
 irr_pwc,kitti,8.171,7.447,1.128,1.522
-irr_pwc,sintel,2.443,1.85,2.581,7.968
 irr_pwc,things,3.404,1.856,3.55,9.508
 irr_pwcnet,things,4.411,3.09,5.967,14.707
 irr_pwcnet_irr,things,4.052,2.734,5.145,12.983
 lcv_raft,chairs,4.034,2.282,4.371,9.213
 lcv_raft,things,2.981,1.761,2.509,6.13
+liteflownet,sintel,1.845,1.419,3.661,10.354
 liteflownet,things,4.024,2.504,4.532,11.477
 liteflownet,kitti,5.917,4.553,1.164,1.783
-liteflownet,sintel,1.845,1.419,3.661,10.354
 liteflownet2,sintel,1.92,1.495,1.648,3.233
 liteflownet2_pseudoreg,kitti,5.668,4.509,1.025,1.389
 liteflownet3,sintel,1.884,1.41,1.674,3.41
@@ -42,18 +46,22 @@ pwcdcnet,sintel,2.328,1.808,2.072,3.159
 pwcdcnet,things,4.213,2.676,4.582,10.994
 pwcnet,sintel,2.82,2.255,3.327,6.249
 pwcnet,things,4.827,3.358,5.551,12.669
-raft,things,3.009,1.507,2.261,5.468
-raft,sintel,1.571,0.871,1.341,1.631
 raft,chairs,4.296,2.197,4.594,9.749
 raft,kitti,6.293,4.687,1.271,0.779
+raft,sintel,1.571,0.871,1.341,1.631
+raft,things,3.009,1.507,2.261,5.468
 raft_small,things,3.548,2.19,3.618,8.636
 scopeflow,chairs,3.95,2.569,4.094,11.975
 scopeflow,kitti,10.458,8.111,1.002,1.337
 scopeflow,sintel,2.461,1.63,2.076,6.084
 scopeflow,things,3.269,1.832,3.465,9.784
+scv4,chairs,4.897,2.201,6.25,13.192
+scv4,kitti,7.102,6.617,3.127,2.498
+scv4,sintel,2.646,1.529,2.527,3.591
+scv4,things,3.849,1.796,4.232,9.847
+starflow,things,3.584,1.822,4.145,9.74
 starflow,kitti,7.231,5.011,1.712,2.818
 starflow,sintel,2.022,1.6,3.545,7.819
-starflow,things,3.584,1.822,4.145,9.74
 vcn,chairs,3.96,2.801,4.444,10.773
 vcn,kitti,9.196,5.934,1.141,1.455
 vcn,sintel,2.251,1.595,2.209,4.314

docs/source/results/summarized_metrics-epe_outlier.csv

@@ -9,25 +9,29 @@ flownetcs,things,4.164,0.14,3.131,0.103,5.028,0.218,12.517,0.356
 flownetcss,things,4.021,0.132,2.989,0.096,4.657,0.202,11.901,0.338
 flownets,things,5.244,0.205,3.958,0.178,7.723,0.435,14.812,0.519
 flownetsd,things,7.821,0.219,7.616,0.2,17.258,0.586,24.21,0.576
+gma,chairs,4.135,0.11,2.371,0.069,4.6,0.268,9.983,0.352
+gma,things,2.867,0.084,1.41,0.041,2.07,0.097,4.754,0.166
+gma,sintel,1.384,0.052,0.723,0.028,1.313,0.045,1.549,0.053
+gma,kitti,6.577,0.14,4.75,0.102,1.526,0.049,0.767,0.022
+hd3,things,6.501,0.137,3.214,0.07,6.854,0.203,14.505,0.272
+hd3,sintel,1.603,0.065,2.311,0.058,6.301,0.181,15.291,0.29
 hd3,chairs,9.722,0.163,4.918,0.096,12.219,0.423,21.716,0.515
 hd3,kitti,44.813,0.301,37.062,0.267,1.262,0.048,1.943,0.067
-hd3,sintel,1.603,0.065,2.311,0.058,6.301,0.181,15.291,0.29
-hd3,things,6.501,0.137,3.214,0.07,6.854,0.203,14.505,0.272
-hd3_ctxt,things,4.421,0.116,2.072,0.058,4.645,0.159,9.959,0.24
-hd3_ctxt,sintel,1.737,0.062,2.103,0.054,5.058,0.141,13.45,0.269
 hd3_ctxt,chairs,5.792,0.139,3.727,0.086,13.695,0.505,22.971,0.57
 hd3_ctxt,kitti,7.858,0.169,6.016,0.126,0.999,0.038,1.536,0.052
+hd3_ctxt,sintel,1.737,0.062,2.103,0.054,5.058,0.141,13.45,0.269
+hd3_ctxt,things,4.421,0.116,2.072,0.058,4.645,0.159,9.959,0.24
+irr_pwc,sintel,2.443,0.08,1.85,0.054,2.581,0.091,7.968,0.202
 irr_pwc,chairs_occ,3.947,0.113,2.315,0.071,3.887,0.18,10.672,0.304
 irr_pwc,kitti,8.171,0.179,7.447,0.143,1.128,0.039,1.522,0.052
-irr_pwc,sintel,2.443,0.08,1.85,0.054,2.581,0.091,7.968,0.202
 irr_pwc,things,3.404,0.104,1.856,0.062,3.55,0.146,9.508,0.264
 irr_pwcnet,things,4.411,0.129,3.09,0.091,5.967,0.219,14.707,0.361
 irr_pwcnet_irr,things,4.052,0.129,2.734,0.089,5.145,0.232,12.983,0.358
 lcv_raft,chairs,4.034,0.115,2.282,0.073,4.371,0.277,9.213,0.367
 lcv_raft,things,2.981,0.087,1.761,0.052,2.509,0.114,6.13,0.197
+liteflownet,sintel,1.845,0.073,1.419,0.049,3.661,0.125,10.354,0.235
 liteflownet,things,4.024,0.118,2.504,0.074,4.532,0.191,11.477,0.311
 liteflownet,kitti,5.917,0.156,4.553,0.118,1.164,0.041,1.783,0.065
-liteflownet,sintel,1.845,0.073,1.419,0.049,3.661,0.125,10.354,0.235
 liteflownet2,sintel,1.92,0.077,1.495,0.053,1.648,0.062,3.233,0.1
 liteflownet2_pseudoreg,kitti,5.668,0.155,4.509,0.118,1.025,0.035,1.389,0.046
 liteflownet3,sintel,1.884,0.073,1.41,0.051,1.674,0.068,3.41,0.114
@@ -42,18 +46,22 @@ pwcdcnet,sintel,2.328,0.085,1.808,0.061,2.072,0.075,3.159,0.104
 pwcdcnet,things,4.213,0.128,2.676,0.091,4.582,0.217,10.994,0.341
 pwcnet,sintel,2.82,0.115,2.255,0.085,3.327,0.152,6.249,0.217
 pwcnet,things,4.827,0.156,3.358,0.117,5.551,0.252,12.669,0.367
-raft,things,3.009,0.083,1.507,0.043,2.261,0.098,5.468,0.175
-raft,sintel,1.571,0.057,0.871,0.031,1.341,0.047,1.631,0.058
 raft,chairs,4.296,0.116,2.197,0.07,4.594,0.294,9.749,0.36
 raft,kitti,6.293,0.145,4.687,0.104,1.271,0.044,0.779,0.023
+raft,sintel,1.571,0.057,0.871,0.031,1.341,0.047,1.631,0.058
+raft,things,3.009,0.083,1.507,0.043,2.261,0.098,5.468,0.175
 raft_small,things,3.548,0.108,2.19,0.07,3.618,0.158,8.636,0.261
 scopeflow,chairs,3.95,0.11,2.569,0.073,4.094,0.173,11.975,0.317
 scopeflow,kitti,10.458,0.187,8.111,0.152,1.002,0.036,1.337,0.045
 scopeflow,sintel,2.461,0.079,1.63,0.051,2.076,0.079,6.084,0.168
 scopeflow,things,3.269,0.102,1.832,0.061,3.465,0.139,9.784,0.266
+scv4,chairs,4.897,0.11,2.201,0.058,6.25,0.303,13.192,0.365
+scv4,kitti,7.102,0.162,6.617,0.123,3.127,0.055,2.498,0.046
+scv4,sintel,2.646,0.066,1.529,0.032,2.527,0.055,3.591,0.072
+scv4,things,3.849,0.105,1.796,0.056,4.232,0.143,9.847,0.237
+starflow,things,3.584,0.105,1.822,0.062,4.145,0.166,9.74,0.276
 starflow,kitti,7.231,0.187,5.011,0.145,1.712,0.064,2.818,0.116
 starflow,sintel,2.022,0.08,1.6,0.055,3.545,0.128,7.819,0.223
-starflow,things,3.584,0.105,1.822,0.062,4.145,0.166,9.74,0.276
 vcn,chairs,3.96,0.123,2.801,0.087,4.444,0.197,10.773,0.333
 vcn,kitti,9.196,0.207,5.934,0.146,1.141,0.041,1.455,0.053
 vcn,sintel,2.251,0.088,1.595,0.061,2.209,0.1,4.314,0.175

ptlflow/__init__.py

@@ -16,7 +16,7 @@
 # limitations under the License.
 # =============================================================================
 
-__version__ = '0.2.3'
+__version__ = '0.2.4'
 
 import logging
 from argparse import Namespace
@@ -35,6 +35,7 @@
 from ptlflow.models.flownet.flownetcss import FlowNetCSS
 from ptlflow.models.flownet.flownets import FlowNetS
 from ptlflow.models.flownet.flownetsd import FlowNetSD
+from ptlflow.models.gma.gma import GMA
 from ptlflow.models.hd3.hd3 import HD3, HD3Context
 from ptlflow.models.irr.pwcnet import IRRPWCNet
 from ptlflow.models.irr.pwcnet_irr import IRRPWCNetIRR
@@ -52,6 +53,13 @@
 from ptlflow.models.vcn.vcn import VCN, VCNSmall
 from ptlflow.utils.utils import config_logging
 
+try:
+    from ptlflow.models.scv.scv import SCVEighth, SCVQuarter
+except ImportError as e:
+    print(e)
+    SCVEighth = None
+    SCVQuarter = None
+
 config_logging()
 
 
@@ -63,6 +71,7 @@
     'flownetcss': FlowNetCSS,
     'flownets': FlowNetS,
     'flownetsd': FlowNetSD,
+    'gma': GMA,
     'hd3': HD3,
     'hd3_ctxt': HD3Context,
     'irr_pwc': IRRPWC,
@@ -84,6 +93,8 @@
     'raft': RAFT,
     'raft_small': RAFTSmall,
     'scopeflow': ScopeFlow,
+    'scv4': SCVQuarter,
+    'scv8': SCVEighth,
     'starflow': StarFlow,
     'vcn': VCN,
     'vcn_small': VCNSmall,

ptlflow/models/gma/LICENSE

@@ -0,0 +1,14 @@
+
+            DO WHAT THE FUCK YOU WANT TO PUBLIC LICENSE
+                    Version 2, December 2004
+
+ Copyright (C) 2004 Sam Hocevar <[email protected]>
+
+ Everyone is permitted to copy and distribute verbatim or modified
+ copies of this license document, and changing it is allowed as long
+ as the name is changed.
+
+            DO WHAT THE FUCK YOU WANT TO PUBLIC LICENSE
+   TERMS AND CONDITIONS FOR COPYING, DISTRIBUTION AND MODIFICATION
+
+  0. You just DO WHAT THE FUCK YOU WANT TO.

ptlflow/models/gma/README.md

@@ -0,0 +1,24 @@
+# GMA
+
+## Original code
+
+[https://github.com/zacjiang/GMA](https://github.com/zacjiang/GMA)
+
+## Code license
+
+See [LICENSE](LICENSE).
+
+## Pretrained weights license
+
+Not specified.
+
+## Citation
+
+```
+@inproceedings{jiang2021learning,
+  title={Learning to Estimate Hidden Motions with Global Motion Aggregation},
+  author={Jiang, Shihao and Campbell, Dylan and Lu, Yao and Li, Hongdong and Hartley, Richard},
+  booktitle={ICCV},
+  year={2021}
+}
+```