Remote write to Grafana with basic auth

[deggja]

Hello guys,

Overview:

I'm attempting to configure my Grafana Agent running on my external VMs to remote write to my Grafana instance running in AKS. Right now, I have enabled the node exporter integration and it is writing metrics and my dashboards are working fine.

However, I want to implement some security. I want to enable basic authentication on the remote write - so that the metrics are only remote written if the username and password I specify in the agent.yaml is correct.

What I've done:

Added the following to my Grafana Agent yaml:

basic_auth:
        username: 'username'
        password: 'password'

In addition to this, I've edited the data source in my grafana instance to use basic auth with different username and password. Doing this I was thinking that it should now stop working - as the password and username in my agent.yaml is different from that specified in the data source.

However, it is still writing metrics.. Seems like it is basically just ignoring the basic auth block. I suppose I am missing something extremely fundamental here. Could someone point me in the right direction?

[deggja]

I solved this. I was using Grafana Mimir as a datasource in Grafana, yet I was configuring the basic auth for Grafana and not Mimir (so that was my mistake). I then attempted to configure basic auth on the nginx loadbalancer in front of Mimir and received some more errors. Turns out that was because of me not pulling the latest helm image because of this fix (https://github.com/grafana/helm-charts/pull/1278/files).

Everything works now.