Turning on all devices in room instead of single device

[Mugga6315]

I've the current issue that instead of a single device in a room, the all devices are getting turned on or off.
Here is part of the log:

{'role': 'user', 'message': 'turn on office ceeiling lights'}, {'role': 'assistant', 'message': 'Turning on the office ceiling lights as requested.\n {"name":"HassTurnOn","arguments":{"area":"office"}}'}, {'role': 'user', 'message': 'turn off office ceeiling lights'}, {'role': 'assistant', 'message': 'Turning off the office ceiling lights as requested.\n {"name":"HassTurnOff","arguments":{"area":"office"}}'}, {'role': 'user', 'message': 'turn off office ceeiling lights'}]

I have a device with the alias "office ceeiling lights" which is part of the room with the alias "office".

How can I fix that behaviour. And maybe also in general how are like fine tune the prompt in order to work properly?

[acon96]

What model are you using?

You probably need to alter the model's prompt to tell it to not use the area parameter and reference devices by ID in this scenario. Changing with the system prompt lets you customize the conversation agent's behavior as much as you want.

[Mugga6315]

At the moment I'm using smangrul/llama-3-8b-instruct-function-calling and ollama as the backend.
I think I really would like to keep the area parameter, because if I'm not mistaken this gives me the opportunity for example instruct turn on the lights, and considers in which room I'm currently at.

I just wondering if there are any examples on how to fine tune the prompt for different things. I'm constantly trying to use LLM for home assistant, but keep going back to the default, because of hallucination or just turning on the wrong devices.

For example also something easy like "what is the current time" gives be plain wrong answer, even the variables in prompt are giving the correct time. And asking slighty different "what is the time" gives me nothing "I'm sorry, but I don't have a function to display the current time".

Don't get me wrong that I'm complaining here or something, I really love the work and having the possibility to play with stuff like that. But I'm really wondering how to use the integration as a daily driver