500 Internal Server Error nginx After update

[Delitants]

Clicked Update in web GUI, after page refresh seeing 500.

Manual update gives no errors.
Nginx has NOthing useful.
2024/01/10 20:46:02 [notice] 42#42: gracefully shutting down
2024/01/10 20:46:02 [notice] 38#38: exiting
2024/01/10 20:46:02 [notice] 42#42: exiting
2024/01/10 20:46:02 [notice] 43#43: exiting
2024/01/10 20:46:02 [notice] 39#39: exiting
2024/01/10 20:46:02 [notice] 36#36: exiting
2024/01/10 20:46:02 [notice] 37#37: exiting
2024/01/10 20:46:02 [notice] 39#39: exit
2024/01/10 20:46:02 [notice] 43#43: exit
2024/01/10 20:46:02 [notice] 38#38: exit
2024/01/10 20:46:02 [notice] 42#42: exit
2024/01/10 20:46:02 [notice] 37#37: exit
2024/01/10 20:46:02 [notice] 36#36: exit
2024/01/10 20:46:02 [notice] 41#41: gracefully shutting down
2024/01/10 20:46:02 [notice] 41#41: exiting
2024/01/10 20:46:02 [notice] 41#41: exit
2024/01/10 20:46:02 [notice] 40#40: gracefully shutting down
2024/01/10 20:46:02 [notice] 40#40: exiting
2024/01/10 20:46:02 [notice] 40#40: exit
2024/01/10 20:46:02 [notice] 1#1: signal 17 (SIGCHLD) received from 38
2024/01/10 20:46:02 [notice] 1#1: worker process 38 exited with code 0
2024/01/10 20:46:02 [notice] 1#1: worker process 43 exited with code 0
2024/01/10 20:46:02 [notice] 1#1: signal 29 (SIGIO) received
2024/01/10 20:46:02 [notice] 1#1: signal 17 (SIGCHLD) received from 42
2024/01/10 20:46:02 [notice] 1#1: worker process 37 exited with code 0
2024/01/10 20:46:02 [notice] 1#1: worker process 36 exited with code 0
2024/01/10 20:46:02 [notice] 1#1: worker process 42 exited with code 0
2024/01/10 20:46:02 [notice] 1#1: signal 29 (SIGIO) received
2024/01/10 20:46:02 [notice] 1#1: signal 17 (SIGCHLD) received from 37
2024/01/10 20:46:02 [notice] 1#1: signal 17 (SIGCHLD) received from 40
2024/01/10 20:46:02 [notice] 1#1: worker process 40 exited with code 0
2024/01/10 20:46:02 [notice] 1#1: signal 29 (SIGIO) received
2024/01/10 20:46:02 [notice] 1#1: signal 17 (SIGCHLD) received from 39
2024/01/10 20:46:02 [notice] 1#1: worker process 39 exited with code 0
2024/01/10 20:46:02 [notice] 1#1: signal 29 (SIGIO) received
2024/01/10 20:46:02 [notice] 1#1: signal 17 (SIGCHLD) received from 41
2024/01/10 20:46:02 [notice] 1#1: worker process 41 exited with code 0
2024/01/10 20:46:02 [notice] 1#1: signal 29 (SIGIO) received

[10/Jan/2024:20:52:01 +0000] "GET /server/ HTTP/2.0" 500 572 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/119.0.0.0 Safari/537.36"

btcpay-update.sh
Already up to date.
Using default tag: latest
latest: Pulling from btcpayserver/docker-compose-generator
Digest: sha256:cac4608887334a54d4d554b209c58410ff8459cf347b0e269918612e66e135ac
Status: Image is up to date for btcpayserver/docker-compose-generator:latest
docker.io/btcpayserver/docker-compose-generator:latest
Crypto: btc, ltc, doge, xmr
Lightning: lnd
ReverseProxy: nginx
Generating /app/Generated/docker-compose.generated.yml
Selected fragments:
nginx
btcpayserver
litecoin
bitcoin
bitcoin-lnd
dogecoin
monero
opt-save-storage-xs
opt-add-btctransmuter
opt-add-configurator
opt-add-thunderhub
opt-mempoolfullrbf
opt-add-tor
nginx-https
opt-add-zmq
nbxplorer
postgres
btcpayserver-nginx
Generated /app/Generated/pull-images.sh
Generated /app/Generated/save-images.sh
Generated /app/Generated/docker-compose.generated.yml

Installed bitcoin-cli.sh to /usr/local/bin: Command line for your Bitcoin instance
Installed bitcoin-lncli.sh to /usr/local/bin: Command line for your Bitcoin LND instance
Installed dogecoin-cli.sh to /usr/local/bin: Command line for your Dogecoin instance
Installed litecoin-cli.sh to /usr/local/bin: Command line for your Litecoin instance
Installed btcpay-clean.sh to /usr/local/bin: Command line for deleting old unused docker images
Installed btcpay-down.sh to /usr/local/bin: Command line for stopping all services related to BTCPay Server
Installed btcpay-restart.sh to /usr/local/bin: Command line for restarting all services related to BTCPay Server
Installed btcpay-setup.sh to /usr/local/bin: Command line for restarting all services related to BTCPay Server
Installed btcpay-up.sh to /usr/local/bin: Command line for starting all services related to BTCPay Server
Installed btcpay-admin.sh to /usr/local/bin: Command line for some administrative operation in BTCPay Server
Installed btcpay-update.sh to /usr/local/bin: Command line for updating your BTCPay Server to the latest commit of this repository
Installed changedomain.sh to /usr/local/bin: Command line for changing the external domain of your BTCPay Server
[+] Running 18/0
✔ Container btcpayserver_dogecoind Running 0.0s
✔ Container btcpayserver_litecoind Running 0.0s
✔ Container tor Running 0.0s
✔ Container btcpayserver_monerod Running 0.0s
✔ Container tor-gen Running 0.0s
✔ Container generated_postgres_1 Running 0.0s
✔ Container generated-configurator-1 Running 0.0s
✔ Container btcpayserver_monero_wallet Running 0.0s
✔ Container btcpayserver_bitcoind Running 0.0s
✔ Container generated_nbxplorer_1 Running 0.0s
✔ Container btcpayserver_lnd_bitcoin Running 0.0s
✔ Container generated_lnd_bitcoin_rtl_1 Running 0.0s
✔ Container nginx Running 0.0s
✔ Container generated_bitcoin_thub_1 Running 0.0s
✔ Container generated_btcpayserver_1 Running 0.0s
✔ Container nginx-gen Running 0.0s
✔ Container letsencrypt-nginx-proxy-companion Running 0.0s
✔ Container btctransmuter Running 0.0s
Total reclaimed space: 0B

[Delitants]

10-listen-on-ipv6-by-default.sh: info: /etc/nginx/conf.d/default.conf differs from the packaged version

docker exec -it nginx bash
cat /etc/nginx/conf.d/default.conf

server {
client_max_body_size 100M;
server_name btc.ott.blue;
listen 443 ssl ;
http2 on;
access_log /var/log/nginx/access.log vhost;
return 500;
ssl_certificate /etc/nginx/certs/default.crt;
ssl_certificate_key /etc/nginx/certs/default.key;
}

Cloudflare in use.

[Delitants]

LE certificate was 2 months past due, after recent update it started to show 500. Somehow few months it was OK with expired LE cert. LE is not updating not behind CloudFlare, nor without it.
Fixed 500 error by connecting a tunnel https://docs.btcpayserver.org/Docker/cloudflare-tunnel/

[Waldorf3]

Had same problem, behind cloudflare proxy. After disabling cloudflare proxy and restarting the btcpay server it worked again. A pity, as cloudflare ads another layer of security.