How to get audio on the live view?

[akcasoy]

Describe the problem you are having

I am not trying to have a 2-way-audio, which is way more complicated than i expected, especially with my Reolink Doorbell (on the newest Firmwares).

I just want to get audio on the live view on my Home Assistant Frigate Lovelace Card. On Frigate UI, when i click on a cam, i have audio (I have defined the live stream in frigate config). But not on the HA Card.

I have the simplest form of frigate-card config:

  type: custom:frigate-card
  cameras:
    - camera_entity: camera.doorbell

This is how the card looks like now (i do not have any progress bar or speaker icon):

My Recordings have audio. I can also scroll through those alerts on this card, and have audio while playing those. At this time, the card is shown a bit different to me: smaller timestamp, and with a media player progress bar, there i can also control the volume:

Version

0.14.1-f4f3cfa

Frigate config file

mqtt:
  host: 192.168.178.6
  user: xxxxxx
  password: xxxxxxx

audio:
  enabled: true

detect:
  enabled: true

record:
  enabled: true

ffmpeg:
  hwaccel_args: preset-vaapi
  output_args:
    record: preset-record-generic-audio-aac

detectors:
  coral:
    type: edgetpu
    device: usb

objects:
  track:
    - person
    - dog
    - cat
    - umbrella

go2rtc:
  streams:
    reolink_doorbell:
      - ffmpeg:http://192.168.178.114/flv?port=1935&app=bcs&stream=channel0_main.bcs&user=admin&password=password#video=copy#audio=copy#audio=opus
      - rtsp://admin:[email protected]/Preview_01_sub
    reolink_doorbell_sub:
      - ffmpeg:http://192.168.178.114/flv?port=1935&app=bcs&stream=channel0_ext.bcs&user=admin&password=password

cameras:
  doorbell:
    live:
      stream_name: reolink_doorbell
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/reolink_doorbell
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/reolink_doorbell_sub
          input_args: preset-rtsp-restream
          roles:
            - audio
            - detect
version: 0.14

Relevant Frigate log output

2024-10-22 15:19:58.678520850  [INFO] Preparing Frigate...
2024-10-22 15:19:58.695770647  [INFO] Starting Frigate...
2024-10-22 15:20:00.238113092  [2024-10-22 15:20:00] frigate.app                    INFO    : Starting Frigate (0.14.1-f4f3cfa)
2024-10-22 15:20:00.243091041  [2024-10-22 15:20:00] frigate.util.config            INFO    : Checking if frigate config needs migration...
2024-10-22 15:20:00.249883509  [2024-10-22 15:20:00] frigate.util.config            INFO    : frigate config does not need migration...
2024-10-22 15:20:12.183242018  [2024-10-22 15:20:12] peewee_migrate.logs            INFO    : Starting migrations
2024-10-22 15:20:12.191665565  [2024-10-22 15:20:12] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-10-22 15:20:12.203877946  [2024-10-22 15:20:12] frigate.app                    INFO    : Recording process started: 352
2024-10-22 15:20:12.203881354  [2024-10-22 15:20:12] frigate.app                    INFO    : Recording process started: 354
2024-10-22 15:20:12.207169574  [2024-10-22 15:20:12] frigate.app                    INFO    : go2rtc process pid: 111
2024-10-22 15:20:12.237430510  [2024-10-22 15:20:12] detector.coral                 INFO    : Starting detection process: 381
2024-10-22 15:20:12.243968802  [2024-10-22 15:20:12] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
2024-10-22 15:20:12.244780255  [2024-10-22 15:20:12] frigate.app                    INFO    : Output process started: 383
2024-10-22 15:20:12.276206645  [2024-10-22 15:20:12] frigate.app                    INFO    : Camera processor started for doorbell: 400
2024-10-22 15:20:12.292377658  [2024-10-22 15:20:12] frigate.app                    INFO    : Camera processor started for defne_cam: 401
2024-10-22 15:20:12.293993564  [2024-10-22 15:20:12] frigate.app                    INFO    : Capture process started for doorbell: 406
2024-10-22 15:20:12.315510625  [2024-10-22 15:20:12] frigate.app                    INFO    : Capture process started for defne_cam: 411
2024-10-22 15:20:12.315514377  [2024-10-22 15:20:12] frigate.app                    INFO    : Audio process started: 421
2024-10-22 15:20:14.865048623  [2024-10-22 15:20:14] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found

Relevant go2rtc log output

2024-10-22 15:19:58.679191191  [INFO] Preparing new go2rtc config...
2024-10-22 15:19:59.117597040  [INFO] Starting go2rtc...
2024-10-22 15:19:59.238969587  15:19:59.238 INF go2rtc platform=linux/amd64 revision=b2399f3 version=1.9.2
2024-10-22 15:19:59.239338512  15:19:59.239 INF config path=/dev/shm/go2rtc.yaml
2024-10-22 15:19:59.240061966  15:19:59.239 INF [api] listen addr=:1984
2024-10-22 15:19:59.240554578  15:19:59.240 INF [rtsp] listen addr=:8554
2024-10-22 15:19:59.241005733  15:19:59.240 INF [webrtc] listen addr=:8555/tcp
2024-10-22 15:20:08.675476981  [INFO] Starting go2rtc healthcheck service...

Frigate stats

No response

Operating system

Proxmox

Install method

Docker Compose

docker-compose file or Docker CLI command

version: "3.9"
services:
  frigate:
    container_name: frigate
    privileged: true # this may not be necessary for all setups
    restart: unless-stopped
    image: ghcr.io/blakeblackshear/frigate:stable
    shm_size: "64mb" # update for your cameras based on calculation above
    devices:
      - /dev/bus/usb:/dev/bus/usb
      - /dev/dri/renderD128:/dev/dri/renderD128 # For intel hwaccel, needs to be updated for your hardware
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /media/frigate/config:/config
      - /media/frigate/storage:/media/frigate
      - type: tmpfs # Optional: 1GB of memory, reduces SSD/SD Card wear
        target: /tmp/cache
        tmpfs:
          size: 1000000000
    ports:
      - "8971:8971"
      - "5000:5000" # Internal unauthenticated access. Expose carefully.
      - "8554:8554" # RTSP feeds
      - "8555:8555/tcp" # WebRTC over tcp
      - "8555:8555/udp" # WebRTC over udp
    environment:
      FRIGATE_RTSP_PASSWORD: "test1234"

Object Detector

Coral

Screenshots of the Frigate UI's System metrics pages

No response

Any other information that may be helpful

No response

[NickM-27]

This should be posted on the frigate card repo

[akcasoy]

This should be posted on the frigate card repo

sorry..

[akcasoy]

@NickM-27 i could not find any page where i can post questions about the configuration of the HA Card.. do u know if there exist sth. like that?

[NickM-27]

https://github.com/dermotduffy/frigate-hass-card