0.15 beta 2 generative AI home assistant notification.

[clsferguson]

Set up to use signal messenger.

edit: updated the automation with a bug fix.

alias: Notification of camera events
triggers:
  - topic: frigate/events
    trigger: mqtt
conditions:
  - condition: template
    value_template: "{{ trigger.payload_json['type'] == 'end' }}"
  - condition: template
    value_template: "{{ trigger.payload_json['after']['entered_zones'] | length > 0 }}"
actions:
  - variables:
      event_id: "{{ trigger.payload_json['after']['id'] }}"
      camera: "{{ trigger.payload_json['after']['camera'] }}"
      label: "{{ trigger.payload_json['after']['label'] }}"
  - wait_for_trigger:
      - topic: frigate/tracked_object_update
        value_template: >
          {{ value_json['type'] == 'description' and value_json['id'] ==
          event_id }}
        variables:
          event_id: "{{ event_id }}"
        trigger: mqtt
    timeout: "10"
    continue_on_timeout: true
  - choose:
      - conditions:
          - condition: template
            value_template: "{{ wait.trigger is defined }}"
        sequence:
          - variables:
              description: "{{ wait.trigger.payload_json['description'] }}"
          - data:
              message: >
                {{ description }} - View Snapshot:
                https://pub.domain.com/api/frigate/notifications/{{ event_id
                }}/snapshot.jpg - View clip:
                https://pub.domain.com/api/frigate/notifications/{{ event_id
                }}/clip.mp4
              data:
                verify_ssl: false
                urls:
                  - >-
                    http://10.0.1.11:8123/api/frigate/notifications/{{ event_id
                    }}/thumbnail.jpg
            action: notify.signal
    default:
      - data:
          message: >
            A {{ label }} was detected on the {{ camera }} camera. - View
            Snapshot: https://pub.domain.com/api/frigate/notifications/{{
            event_id }}/snapshot.jpg - View clip:
            https://pub.domain.com/api/frigate/notifications/{{ event_id
            }}/clip.mp4
          data:
            verify_ssl: false
            urls:
              - >-
                http://10.0.1.11:8123/api/frigate/notifications/{{ event_id
                }}/thumbnail.jpg
        action: notify.signal
mode: queued
max: 25

Edit: added a telegram bot notification.

alias: Notification of camera events
triggers:
  - topic: frigate/events
    trigger: mqtt
conditions:
  - condition: template
    value_template: "{{ trigger.payload_json['type'] == 'end' }}"
  - condition: template
    value_template: "{{ trigger.payload_json['after']['entered_zones'] | length > 0 }}"
actions:
  - variables:
      event_id: "{{ trigger.payload_json['after']['id'] }}"
      camera: "{{ trigger.payload_json['after']['camera'] }}"
      label: "{{ trigger.payload_json['after']['label'] }}"
  - wait_for_trigger:
      - topic: frigate/tracked_object_update
        value_template: >
          {{ value_json['type'] == 'description' and value_json['id'] ==
          event_id }}
        variables:
          event_id: "{{ event_id }}"
        trigger: mqtt
    timeout: "15"
    continue_on_timeout: true
  - choose:
      - conditions:
          - condition: template
            value_template: "{{ wait.trigger is not none }}"
        sequence:
          - variables:
              description: "{{ wait.trigger.payload_json['description'] }}"
          - data:
              message: >
                {{ description }} - View Snapshot:
                https://pub.domain.com/api/frigate/notifications/{{ event_id
                }}/snapshot.jpg - View clip:
                https://pub.domain.com/api/frigate/notifications/{{ event_id
                }}/clip.mp4
              data:
                verify_ssl: false
                urls:
                  - >-
                    http://10.0.1.11:8123/api/frigate/notifications/{{ event_id
                    }}/thumbnail.jpg
            action: notify.signal
          - data:
              url: >-
                http://10.0.1.11:8123/api/frigate/notifications/{{ event_id
                }}/thumbnail.jpg
              caption: >
                <b>Camera Alert</b> 🚨

                ├ <i>Camera:</i> {{ camera }} 

                └ <i>Event:</i> ┐

                {{ description }}


                <a href="https://pub.domain.com/api/frigate/notifications/{{
                event_id }}/snapshot.jpg">📷 View Snapshot 📷</a>


                <a href="https://pub.domain.com/api/frigate/notifications/{{
                event_id }}/clip.mp4">🎥 View Clip 🎥</a>
              parse_mode: html
              disable_web_page_preview: true
            action: telegram_bot.send_photo
    default:
      - data:
          message: >
            A {{ label }} was detected on the {{ camera }} camera. - View
            Snapshot: https://pub.domain.com/api/frigate/notifications/{{
            event_id }}/snapshot.jpg - View clip:
            https://pub.domain.com/api/frigate/notifications/{{ event_id
            }}/clip.mp4
          data:
            verify_ssl: false
            urls:
              - >-
                http://10.0.1.11:8123/api/frigate/notifications/{{ event_id
                }}/thumbnail.jpg
        action: notify.signal
      - data:
          target: -123456789 # chat ID
          url: >-
            http://10.0.1.11:8123/api/frigate/notifications/{{ event_id
            }}/thumbnail.jpg
          caption: >
            <b>Camera Alert</b> 🚨

            ├ <i>Camera:</i> {{ camera }}

            └ <i>Event:</i> {{ label }} detected


            <a href="https://pub.domain.com/api/frigate/notifications/{{ event_id
            }}/snapshot.jpg">📷 View Snapshot 📷</a>


            <a href="https://pub.domain.com/api/frigate/notifications/{{ event_id
            }}/clip.mp4">🎥 View Clip 🎥</a>
          parse_mode: html
          disable_web_page_preview: true
        action: telegram_bot.send_photo
  - delay: "00:00:01.2" # rate limit
mode: queued

example in telegram:

[erasmus83]

Have you tried doing this with the frigate/reviews topic rather than events? Scratching my head over that one, but not brilliant with HA Automations.

[clsferguson]

No, I haven't. Not really sure the best thing to do there.

With this one, it will catch the event when it is done, then wait 15 seconds for the gen ai to output a description, if none is sent to the mqtt, it outputs a generic description.