When syncing multiple CIS controllers, shared static routes override each other

[skenderidis]

Setup Details

CIS Version : 2.18.1 (and 2.19.0)

Description

A customer has multiple CIS deployed on the same cluster. they are using the staticroutes (with Flannel) and they are using --shared-static-routes=true.
When we deploy CIS-1 we see the first route being created in the Common partition

k8s-rancher1-10.1.20.21 |   10.222.1.0 | 255.255.255.0 10.221.1.0 255.255.255.0

When we deploy CIS-2 we see the first route getting delete and being replaced by CIS-2 route
k8s-rancher2-10.1.20.22 |   10.222.1.0 | 255.255.255.0 10.222.1.0 255.255.255.0

When we are NOT using --shared-static-routes=true then both routes are getting created on their respective partition

I have attached logs when the second CIS gets created. You can see that it detects the route from the first CIS

2025/01/13 14:42:09 [DEBUG] [2025-01-13 14:42:09,951 __main__ DEBUG] NET Config: {"routes": [{"name": "k8s-rancher2-10.1.20.22", "network": "10.222.1.0/24", "gw": "10.1.20.22"}]}



2025/01/13 14:42:09 [DEBUG] [2025-01-13 14:42:09,797 icontrol.session DEBUG] RESPONSE::STATUS: 200 Content-Type: application/json;charset=utf-8 Content-Encoding: None Text: '{"kind":"tm:net:route:routecollectionstate","selfLink":"https://localhost/mgmt/tm/net/route?$filter=partition+eq+Common&ver=16.1.4.2","items":[{"kind":"tm:net:route:routestate","name":"default","partition":"Common","fullPath":"/Common/default","generation":1,"selfLink":"https://localhost/mgmt/tm/net/route/~Common~default?ver=16.1.4.2","gw":"10.1.10.1","mtu":0,"network":"default"},{"kind":"tm:net:route:routestate","name":"k8s-rancher1-10.1.20.21","partition":"Common","fullPath":"/Common/k8s-rancher1-10.1.20.21","generation":4021,"selfLink":"https://localhost/mgmt/tm/net/route/~Common~k8s-rancher1-10.1.20.21?ver=16.1.4.2","gw":"10.1.20.21","mtu":0,"network":"10.221.0.0/24"}]}'


2025/01/13 14:42:09 [INFO] [2025-01-13 14:42:09,897 f5_cccl.resource.resource INFO] Deleting IcrRoute: /Common/k8s-rancher1-10.1.20.21

2025/01/13 14:42:09 [DEBUG] [2025-01-13 14:42:09,949 f5_cccl.service.manager DEBUG] Deleted k8s-rancher1-10.1.20.21 in 0.05214 seconds.

Expected behaviour

Both routes need to exist on Common partition
problem.txt

[trinaths]

Created [CONTCNTR-5134] for internal tracking.