Autotracking of stationary objects

[jakeycrx]

Hi,

My PTZ tends to return the home position when the tracked object doesn't move a lot. I know I could increase the autotracking timeout, but I prefer to leave it on 10 seconds in case it overshoots .

I do have the detect fps set to 10 fps, so would adjusting the stationary interval and/or threshold help at all?

Example video (It was called over by a spotter)

The scores weren't great, but I have my min score set low.

        cat:
          min_score: 0.5
          threshold: 0.75

[hawkeye217]

Autotracking will continue following an object, even if it becomes stationary - as long as Frigate's object tracker itself is tracking the object. So yeah, probably playing with both of those parameters would help.

[jakeycrx]

I'm still having issues with this. I have bumped my scores up a bit due to lots of training through Frigate+.

        cat:
          min_score: 0.6
          threshold: 0.75

There are 2 good examples that happened today:

Video 1

It looks like the score was still 63.7% when the camera was commanded to the home position at 9:44:43

Object Lifecycle says the cat left at 9:44:32

Video 2

In this case it looks like it lost track of the cat, but it initially had a really strong score, so it seems a bit odd that it lost track of it.

[hawkeye217]

If I had to guess, the issue here is probably more related to the camera movement and the scene itself than it is to the detection score of the object. The entire scene shifts, so Frigate has to calculate where an object will be after the camera moves. The number of points, edges, and contours in the image plays a huge role on how successful this calculation is.

If you are using autotracking with zooming, the calculation is much more important. The roof doesn't have too many sharp edges and contours, so the homography calculation likely won't work well.

If you aren't using zooming, the calculation is simpler and only uses coordinate translation. Still, a decent number of edges are required for this to be the most accurate.

This is just one of the downsides of "poor man's autotracking" and trying to make it workable for all of the hardware that Frigate can run on.

[jakeycrx]

I also have another camera (non-PTZ) set further back that also loses track when the cat sits still for a little while:

[hawkeye217]

That one I'd probably guess is model related.

[NickM-27]

would be great to see the config to see what filters are set. This is likely a case where lowering the min_score a bit would probably help

[jakeycrx]

The min score is already down at 0.6

        cat:
          min_score: 0.6
          threshold: 0.75