Restore lost data for orgs inherited from org1

[mahalakshme]

• Restore parent concepts from prerelease or latest backup if any available
• Issue has occurred as part of release 5.1.2 which was done before November 30

[petmongrels]

All data to be sent is uploaded here - https://drive.google.com/drive/u/4/folders/1gsrLmsvpZ6gbqxHEQb8zYRwUuQ0ALrWh
all code is here - https://github.com/avniproject/data-fixes/tree/main/ck-ihmp-data-loss

[himeshr]

Regarding the update of lastModifiedDateTime values, such as the following assignment:

last_modified_date_time = current_timestamp + (interval '1 millisecond'/100)

present in
https://github.com/avniproject/data-fixes/blob/3da55337f76ba7934e483cd45ea9cf1df8ec4f09/ck-ihmp-data-loss/ck/fix.sql#L10

https://github.com/avniproject/data-fixes/blob/3da55337f76ba7934e483cd45ea9cf1df8ec4f09/ck-ihmp-data-loss/ihmp/fix.sql#L20

Since 'current_timestamp' value remains fixed for all sql commands within a single transaction, we should also have made use of entity "id" value to ensure that the timestamps are slightly different for each entity to avoid skipping entities during sync fetch.

last_modified_date_time = current_timestamp + (id * (interval '1 millisecond'/100))

[himeshr]

This would only ever be a partial restore of the data to a version available for the data of recovery. Rest of the data has to be reworked on by the organisations.

Apart from data fix done as part of this card, @mahalakshme, @petmongrels and @vinayvenu are there some additional checks we could put in place to avoid these issues in future.

[himeshr]

This would only ever be a partial restore of the data to a version available for the data of recovery. Rest of the data has to be reworked on by the organisations.

Apart from data fix done as part of this card, @mahalakshme, @petmongrels and @vinayvenu are there some additional checks we could put in place to avoid these issues in future.

After discussion, came to know of NPE being thrown in case Concept is not found during save of an Entity with observations.
This would avoid these kind of issues in future.

[mahalakshme]

@himeshr @vinayvenu Once this(data recovery and data to be collected is sent) is done, also reply to the corresponding tickets:
https://avni.freshdesk.com/a/tickets/3323 : avniproject/avni-product#1446
https://avni.freshdesk.com/a/tickets/3326 : avniproject/avni-client#1220