Would OPAL client subscribe external data sources response topic?

[h9ing]

Hi

My OPAL Server OPAL_DATA_CONFIG_SOURCES was setting like this:
{ "external_source_url": "https://your-api.com/path/to/api/endpoint" }

And my OPAL client would get this response from external_source_url:
{ "entries": [ { "url": "https://api.yourservice.com/v1/data", "topics": [ "test_topic" ], "dst_path": "", "headers": { "Authorization": "jwt1" } } ] }

(My OPAL client didn't set any OPAL_DATA_TOPICS)

I got my policy data from this entry url indeed. And I think OPAL client would subscribe topic "test_topic".
I called OPAL server "Publish Data Update Event API" to notify OPAL client topic "test_topic" was update, but OPAL client didn't
receive any notification to fetch policy data.

So is OPAL client does not subscribe external data sources response topic originally?
But if it does not subscribe external data sources response topic, why I still need to put topic in entries response?

Thank you!

[orweis]

Hi @9ing can you share your OPAL-server and OPAL-client logs?
Would make it easier to try and find the issue.

I called OPAL server "Publish Data Update Event API" to notify OPAL client topic "test_topic" was update, but OPAL client didn't

This sounds like the client isn't connected correctly to the server, try to see in the logs if it connected and with each topics

[h9ing]

Hi @orweis, here is my log. Thank you!

• OPAL server log:

• OPAL server log:
  

• external data sources response:

• notify to OPAL server topic update request

[asafc]

Hi @9ing, excellent question!

You did the external config redirect beautifully, but the fetching of this config is the "base config" or "complete picture" data that OPAL client will fetch after every fresh connection to OPAL server (i.e: on first connection, or after a disconnect and reconnect).

OPAL client also has a separate mechanism for real time updates, and the data topics matter here.

• Your OPAL client subscribed to the topic policy_data, but not to the topic test_topic.
• Therefore OPAL client does not listen when you publish to the test_topic topic.
• The solution for that is to set the OPAL_DATA_TOPICS env var to test_topic.

Hope that helps, let me know if you have more questions.

[h9ing]

Hi @asafc!

You did the external config redirect beautifully, but the fetching of this config is the "base config" or "complete picture" data that OPAL client will fetch after every fresh connection to OPAL server (i.e: on first connection, or after a disconnect and reconnect).

I may have misunderstood. I think OPAL client would subscribe the topic test_topic which in external data sources response entries automatic.
So it means Opal client would not subscribe the topic which in external data sources response entries. The only way let OPAL client to subscribe topic is setting OPAL_DATA_TOPICS, right?

But why we still need to put the topic in external data sources response entry body?

Thank you!

[asafc]

You are correct, OPAL_DATA_TOPICS is the only way to subscribe.

The reason topics are also included by the external data sources is technical (we use the same json schema for both objects) and I recognize it might be confusing. We are working on improving the API in that area.

[h9ing]

OK, I see. Thank you for your help！😀