[Config Support]: How to correct aspect ratio in live view

[idxlics]

Describe the problem you are having

My camera has a 704x576 substream used for detection and live view.
The correct aspect ratio should be 16:9 or 1024x576 and if I use

    detect:
      width: 1024
      height: 576

then it works fine for detection.

I would also want it to be corrected for live view and tried using

ffmpeg:rtsp://...#video=h264#width=1024#height=576

from #11115 but with no luck, both detection and live view get errors after applying this fix. Any suggestion?

Version

0.14.1-f4f3cfa

Frigate config file

mqtt:
  enabled: false

detectors:
  coral:
    type: edgetpu
    device: pci

birdseye:
  enabled: false

ffmpeg:
  hwaccel_args: preset-vaapi
  input_args: preset-rtsp-restream
  output_args:
    record: preset-record-generic
  retry_interval: 60

detect:
  enabled: true
  fps: 6

record:
  enabled: true
  retain:
    days: 3
    mode: all
  events:
    retain:
      default: 14
      mode: active_objects

snapshots:
  enabled: true
  retain:
    default: 14

go2rtc:
  streams:
    test_cam_1:
      - rtsp://user:[email protected]:554/Streaming/Channels/1
    test_cam_2:
      - ffmpeg:rtsp://user:[email protected]:554/Streaming/Channels/2#video=h264#width=1024#height=576

    backdoor_1:
      - rtsp://user:[email protected]:554/Streaming/Channels/1
    backdoor_2:
      - ffmpeg:rtsp://user:[email protected]:554/Streaming/Channels/2#video=h264#width=1024#height=576
    backdoor_3:
      - rtsp://user:[email protected]:554/Streaming/Channels/3

cameras:
  test_cam:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/test_cam_1
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/test_cam_2
          roles:
            - detect

    live:
      stream_name: test_cam_2

  backdoor:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/backdoor_1
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/backdoor_2
          roles:
            - detect

    live:
      stream_name: backdoor_2

    zones:
      Backdoor:
        coordinates: 0.159,0.674,0,0.74,0,1,1,1,1,0.682,0.794,0.626,0.647,0.791,0.357,0.983
        loitering_time: 10
        inertia: 3
    review:
      alerts:
        required_zones: Backdoor
      detections:
        required_zones: Backdoor
version: 0.14

Relevant Frigate log output

2025-01-18 18:26:11.928087917  [INFO] Preparing Frigate...
2025-01-18 18:26:11.934782130  [INFO] Starting Frigate...
2025-01-18 18:26:12.645183995  [2025-01-18 18:26:12] frigate.app                    INFO    : Starting Frigate (0.14.1-f4f3cfa)
2025-01-18 18:26:12.645449002  [2025-01-18 18:26:12] frigate.util.config            INFO    : Checking if frigate config needs migration...
2025-01-18 18:26:12.656512419  [2025-01-18 18:26:12] frigate.util.config            INFO    : frigate config does not need migration...
2025-01-18 18:26:33.892170605  [2025-01-18 18:26:33] peewee_migrate.logs            INFO    : Starting migrations
2025-01-18 18:26:33.892536861  [2025-01-18 18:26:33] peewee_migrate.logs            INFO    : There is nothing to migrate
2025-01-18 18:26:33.911162203  [2025-01-18 18:26:33] frigate.app                    INFO    : Recording process started: 390
2025-01-18 18:26:33.911166889  [2025-01-18 18:26:33] frigate.app                    INFO    : Recording process started: 392
2025-01-18 18:26:33.912517136  [2025-01-18 18:26:33] frigate.app                    INFO    : go2rtc process pid: 98
2025-01-18 18:26:33.925622731  [2025-01-18 18:26:33] detector.coral                 INFO    : Starting detection process: 418
2025-01-18 18:26:33.963726158  [2025-01-18 18:26:33] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as pci
2025-01-18 18:26:33.967100000  [2025-01-18 18:26:33] frigate.app                    INFO    : Output process started: 420
2025-01-18 18:26:33.967102338  [2025-01-18 18:26:33] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2025-01-18 18:26:33.967103376  [2025-01-18 18:26:33] frigate.app                    INFO    : Camera processor started for test_cam: 435
2025-01-18 18:26:33.967106878  [2025-01-18 18:26:33] frigate.app                    INFO    : Camera processor started for backdoor: 443
2025-01-18 18:26:33.967115421  [2025-01-18 18:26:33] frigate.app                    INFO    : Capture process started for test_cam: 461
2025-01-18 18:26:33.975710878  [2025-01-18 18:26:33] frigate.app                    INFO    : Capture process started for backdoor: 465
2025-01-18 18:26:39.088607463  [2025-01-18 18:26:39] frigate.video                  ERROR   : test_cam: Unable to read frames from ffmpeg process.
2025-01-18 18:26:39.088661451  [2025-01-18 18:26:39] frigate.video                  ERROR   : test_cam: ffmpeg process is not running. exiting capture thread...
2025-01-18 18:26:39.105686903  [2025-01-18 18:26:39] frigate.video                  ERROR   : backdoor: Unable to read frames from ffmpeg process.
2025-01-18 18:26:39.105723159  [2025-01-18 18:26:39] frigate.video                  ERROR   : backdoor: ffmpeg process is not running. exiting capture thread...
2025-01-18 18:26:43.376715000  [2025-01-18 18:26:43] frigate.util.services          ERROR   : Unable to poll intel GPU stats: Failed to detect engines! (No such file or directory)
2025-01-18 18:26:43.376718575  (Kernel 4.16 or newer is required for i915 PMU support.)
2025-01-18 18:26:43.376719722  timeout: the monitored command dumped core
2025-01-18 18:47:11.352926  2025-01-18 18:26:43.376720487
2025-01-18 18:27:48.984834589  [2025-01-18 18:27:48] frigate.record.maintainer      WARNING : Unable to keep up with recording segments in cache for backdoor. Keeping the 6 most recent segments out of 7 and discarding the rest...
2025-01-18 18:27:48.985123856  [2025-01-18 18:27:48] frigate.record.maintainer      WARNING : Unable to keep up with recording segments in cache for test_cam. Keeping the 6 most recent segments out of 7 and discarding the rest...
2025-01-18 18:27:58.994850215  [2025-01-18 18:27:58] frigate.record.maintainer      WARNING : Unable to keep up with recording segments in cache for backdoor. Keeping the 6 most recent segments out of 7 and discarding the rest...
2025-01-18 18:27:58.995155798  [2025-01-18 18:27:58] frigate.record.maintainer      WARNING : Unable to keep up with recording segments in cache for test_cam. Keeping the 6 most recent segments out of 7 and discarding the rest...
2025-01-18 18:28:09.005049395  [2025-01-18 18:28:09] frigate.record.maintainer      WARNING : Unable to keep up with recording segments in cache for backdoor. Keeping the 6 most recent segments out of 7 and discarding the rest...
2025-01-18 18:28:09.005351784  [2025-01-18 18:28:09] frigate.record.maintainer      WARNING : Unable to keep up with recording segments in cache for test_cam. Keeping the 6 most recent segments out of 7 and discarding the rest...
2025-01-18 18:28:19.014014537  [2025-01-18 18:28:19] frigate.record.maintainer      WARNING : Unable to keep up with recording segments in cache for backdoor. Keeping the 6 most recent segments out of 7 and discarding the rest...
2025-01-18 18:28:19.014243998  [2025-01-18 18:28:19] frigate.record.maintainer      WARNING : Unable to keep up with recording segments in cache for test_cam. Keeping the 6 most recent segments out of 7 and discarding the rest...
2025-01-18 18:28:29.023563848  [2025-01-18 18:28:29] frigate.record.maintainer      WARNING : Unable to keep up with recording segments in cache for backdoor. Keeping the 6 most recent segments out of 7 and discarding the rest...
2025-01-18 18:28:29.023707209  [2025-01-18 18:28:29] frigate.record.maintainer      WARNING : Unable to keep up with recording segments in cache for test_cam. Keeping the 6 most recent segments out of 7 and discarding the rest...
2025-01-18 18:28:34.029710929  [2025-01-18 18:28:34] watchdog.backdoor              ERROR   : Ffmpeg process crashed unexpectedly for backdoor.
2025-01-18 18:28:34.029762660  [2025-01-18 18:28:34] watchdog.backdoor              ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2025-01-18 18:28:34.029775688  [2025-01-18 18:28:34] ffmpeg.backdoor.detect         ERROR   : rtsp://127.0.0.1:8554/backdoor_2: Invalid data found when processing input
2025-01-18 18:28:34.046312319  [2025-01-18 18:28:34] watchdog.test_cam              ERROR   : Ffmpeg process crashed unexpectedly for test_cam.
2025-01-18 18:28:34.046389304  [2025-01-18 18:28:34] watchdog.test_cam              ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2025-01-18 18:28:34.046391306  [2025-01-18 18:28:34] ffmpeg.test_cam.detect         ERROR   : rtsp://127.0.0.1:8554/test_cam_2: Invalid data found when processing input
2025-01-18 18:28:39.033970676  [2025-01-18 18:28:39] frigate.record.maintainer      WARNING : Unable to keep up with recording segments in cache for backdoor. Keeping the 6 most recent segments out of 7 and discarding the rest...
2025-01-18 18:28:39.034241090  [2025-01-18 18:28:39] frigate.record.maintainer      WARNING : Unable to keep up with recording segments in cache for test_cam. Keeping the 6 most recent segments out of 7 and discarding the rest...
2025-01-18 18:28:39.146368897  [2025-01-18 18:28:39] frigate.video                  ERROR   : backdoor: Unable to read frames from ffmpeg process.
2025-01-18 18:28:39.146412530  [2025-01-18 18:28:39] frigate.video                  ERROR   : backdoor: ffmpeg process is not running. exiting capture thread...
2025-01-18 18:28:39.164179795  [2025-01-18 18:28:39] frigate.video                  ERROR   : test_cam: Unable to read frames from ffmpeg process.
2025-01-18 18:28:39.164224398  [2025-01-18 18:28:39] frigate.video                  ERROR   : test_cam: ffmpeg process is not running. exiting capture thread...

Relevant go2rtc log output

2025-01-18 18:26:11.929935896  [INFO] Preparing new go2rtc config...
2025-01-18 18:26:12.142451581  [INFO] Starting go2rtc...
2025-01-18 18:26:12.218080281  18:26:12.217 INF go2rtc platform=linux/amd64 revision=b2399f3 version=1.9.2
2025-01-18 18:26:12.218083781  18:26:12.217 INF config path=/dev/shm/go2rtc.yaml
2025-01-18 18:26:12.218085210  18:26:12.217 INF [rtsp] listen addr=:8554
2025-01-18 18:26:12.218086411  18:26:12.217 INF [webrtc] listen addr=:8555/tcp
2025-01-18 18:26:12.218138985  18:26:12.218 INF [api] listen addr=:1984
2025-01-18 18:26:21.926979890  [INFO] Starting go2rtc healthcheck service...

Frigate stats

No response

Operating system

Debian

Install method

Docker Compose

docker-compose file or Docker CLI command

services:
  frigate:
    container_name: frigate
    #privileged: true # this may not be necessary for all setups
    restart: unless-stopped
    stop_grace_period: 30s
    image: ghcr.io/blakeblackshear/frigate:stable
    shm_size: "128mb" # update for your cameras based on calculation above
    devices:
      - /dev/apex_0:/dev/apex_0 # Passes a PCIe Coral, follow driver instructio>
      - /dev/dri/renderD128:/dev/dri/renderD128 # For intel hwaccel, needs to b>
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /home/user/frigate/config:/config
      - /storage2/camera:/media/frigate
      - /storage1/exports:/media/frigate/exports
      - type: tmpfs # Optional: 1GB of memory, reduces SSD/SD Card wear
        target: /tmp/cache
        tmpfs:
          size: 1000000000
    ports:
      - "8971:8971"
      # - "5000:5000" # Internal unauthenticated access. Expose carefully.
      - "8554:8554" # RTSP feeds
      - "8555:8555/tcp" # WebRTC over tcp
      - "8555:8555/udp" # WebRTC over udp
    environment:
      FRIGATE_RTSP_PASSWORD: "password"

Object Detector

Coral

Screenshots of the Frigate UI's System metrics pages

No response

Any other information that may be helpful

Frigate running in Docker on Debian vm on Proxmox host.
hwaccel is working normally with vGPU passthrough despite "Unable to poll intel GPU stats" in log.

[NickM-27]

if you want to have the original aspect ratio in live view it would be more CPU efficient to just use the main stream for live instead of transcoding the sub stream

[idxlics]

My ISP limits the upload speed of my internet connection to around 2Mbps but the main stream is at about 8Mbps.
So it would be impossible to use the main stream for live when I am out.
Also tried using another substream at 1280x720 for live, still too bandwidth-consuming.

[NickM-27]

you may be better off not using the fast live views and instead just using jsmpeg then