How to keep history data from previous solarman?

[Pigi-102]

I have a question: I have the old solarman integration, and quite a lot of historical data that I'm interessed in, but the old integration does not seems to be maintained costantly, or at least seems that it's quite hard to get new feature and request implemented ( or even pull request merged ).
If I install this integration, would my data be keepd or I'm going to start all over again ?
As far as I can understand it should, but I would like to be sure, if possible.
Thanks in advance.

Pigi_102

[PV-Joe]

Look here how to merge history:
https://github.com/davidrapan/ha-solarman/wiki/Naming-Scheme

[Pigi-102]

Interesting !
So I should diff the new and old yaml for the inverter definitions to find the differences, and then apply them as you described ?
As I use a definition file made by myself ( basically the sofar_g3hyd.yaml modified to remove all stuff from 3Phase version, to make it single phase ), I could do the same thing, but keeping my names ( for the existing sensor names ) and this should makes a transparent passage .
Am I correct ?

[PV-Joe]

Check if there is a definition yaml for your device here:

https://github.com/davidrapan/ha-solarman/wiki/Supported-Devices

I think you can use your old yaml as well.
Put it in a new folder called custom in the same directory of the other definitions so it won‘t be deleted or overwritten by future updates.

Do a full backup before you start. Then you can test and if it doesn’t deserve your needs you can restore.

This integration is tons better than the old one. I‘m using it with a Deye inverter and it‘s 100% stable and fetches data every 5 seconds.

Good luck!

[Jan-Ole-Menz]

Hello,

I migrated today to this integration and my today's and total values are now tracked in a different entity, how to I merge them back together?

Example:

Old: wechselrichter_daily_energy_sold
New: wechselrichter_today_energy_export

[Jan-Ole-Menz]

I didn't change my dashboard, and it looks perferctly fine outside of today 5 PM

Exemple of how yesterday looks right now:

[Jan-Ole-Menz]

Secondly... you can adjust the data in the developer tools > STATISTICS tab by clicking on the little graph icon. Selecting problematic time point using datetime picker and putting zeroes instead those wrong values.

will try that

[davidrapan]

Still.. somewhere in the HA docs is stated that sensors used in dashboard should be without any external resets. I think it's cause of the time zones and such so it is fully in control of the HA to decide when new day starts. 😉

And internal clocks of solarman are also highly unreliable. (Whole solarman is fking mess though...)

Edit: Changing it from Today sensors to Total sensors should not cause you any history loss or anything. As it is tied to the history of the sensor itself. 😉

[PV-Joe]

Your inverter is a Deye SUN 12K Hybrid right?

You have to choose the following definition file:

https://github.com/davidrapan/ha-solarman/blob/main/custom_components/solarman/inverter_definitions/deye_sg04lp3.yaml

It works perfect for my Deye SUN 8K Hybrid.

[Jan-Ole-Menz]

I now restored this morning's backup, as a lot of data seemed quite messed up, as well as automations and also messed up stuff after HA (influx DB, ..).

After restoring the backup I did the following: (gentle reminder for everyone to create a backup of their data before they migrate to this)

Extract current device configuration.

Relinked the following ID's: (probably not all) "daily" --> "today", ***_total_load_power --> ***_load_power, ***_total_grid_power --> ***_grid_power, "sold" --> "export", "bought" --> "import", "battery_soc" --> "battery"

Restarted HA

Deleted the solarman device

Restarted HA

Delete Solarman HACS integration

Restarted HA

Downloaded and installer this integration

Restarted HA

Added device

[philmassie]

Thanks so much for all the work on this integration @davidrapan . And also thanks for all your patience going over how to switch from the old to this new integration.
Reading over various posts I was still a little nervous about losing data, and how HA would handle history when a device got deleted.
I did lose a little bit of data during the process, in sort of unexpected ways. It seems like every entity that I renamed lost it's short term stats. But not entirely. For eg.
solarman battery, when you click the entity, there appears to be ~5 minutely data for the entire day.

When I click show more though, there is only short term data since the rename.

This isn't that important, but its confusing to me how this works.

Nevertheless, I put together my overly-anxious-dummies guide, based on the above discussion. maybe it will help someone else. Use at your own risk of course and YMMMV.

Thanks again

1. go through the old and new {inverter_model}.yaml files comparing entity names

   • this is pretty tedious, VSCode compare files can help.

   • Isolate all the entities that have different names. In my case there were about 40 to change and VSCode looked like this:
     

   • the entity ID will be the name in lower case, with underscores instead of spaces and no with a 'solarman' prefix

   • eg "Daily Production" > "Today Production"

   • entity IDs were solarman_daily_production > solarman_today_production

2. Make a note of your inverter IP, port, serial number
   • Settings > Devices and services > Solarman Integration (old) > Configure
3. Make a backup
4. Rename all the entity IDs to match the new IDs
   • Settings > Devices and services > Solarman Integration (old) > 85 entities (yours may differ)
   • One entity at a time, search > select > gear wheel > change the Entity ID to match what the new one will be
   • Dont worry about the friendly names, the new integration seems to take care of these when you install it
5. Restart HA
6. Make a backup - last one
7. Delete the old Solarman device
   • Settings > Devices and services > Solarman Integration (old) > Devices > 3dots > Delete
   • Take a breath. My long term stats were still there, all the entities were gone from the UI though.
8. Restart HA
9. Delete old Solarman HACS integration
   • HACS > find the integration > 3dots > Remove
10. Restart HA
11. Install new solarman integration
12. Restart HA
13. Add your device
    • Settings > Devices and services > Add Integration > search for solarman
    • Wizard will prompt you for info about your inverter. Mine was prepropulated which was nice
    • Change the "Device name" to "solarman" so that all the entities get the same prefix as your old ones

That's it. I was relieved that everything went smoothly.

[davidrapan]

Hi @philmassie!

For eg. solarman battery, when you click the entity, there appears to be ~5 minutely data for the entire day.

It's mentioned on the wiki: https://github.com/davidrapan/ha-solarman/wiki#-changes in point number 2. HA's recorder has default sampling rate of 5 minutes.

Nevertheless, I put together my overly-anxious-dummies guide, based on the above discussion. maybe it will help someone else. Use at your own risk of course and YMMMV.

Awesome! I'll send anyone who will struggle with it to this post! Thanks for your very thorough step by step guide! 👍

Wizard will prompt you for info about your inverter. Mine was prepropulated which was nice

That's thanks to the solarman discovery build in the integration. 😉