Выявил проблему с ipv6. С конфигом по умолчанию, nginx не слушает порты 80 / 443 на ipv6 адресе.
>nmap 2001:0db8:85a3:0:0:8a2e:0370:7334 -6 -p 443
Starting Nmap 7.80 ( https://nmap.org ) at 2022-07-01 14:33 MSK
Nmap scan report for 2a00-.cloudvps.regruhosting.ru
Host is up (0.044s latency).
PORT STATE SERVICE
443/tcp closed https
Nmap done: 1 IP address (1 host up) scanned in 2.64 seconds
>nmap 2001:0db8:85a3:0:0:8a2e:0370:7334 -6 -p 80
Starting Nmap 7.80 ( https://nmap.org ) at 2022-07-01 14:33 MSK
Nmap scan report for 2a00-cloudvps.regruhosting.ru
Host is up (0.037s latency).
PORT STATE SERVICE
80/tcp closed http
Nmap done: 1 IP address (1 host up) scanned in 0.18 seconds
>nmap 2001:0db8:85a3:0:0:8a2e:0370:7334 -6 -p 443
Starting Nmap 7.80 ( https://nmap.org ) at 2022-07-01 15:05 MSK
Nmap scan report for 2a00-.cloudvps.regruhosting.ru
Host is up (0.037s latency).
PORT STATE SERVICE
443/tcp open https
Nmap done: 1 IP address (1 host up) scanned in 0.13 seconds
>nmap 2001:0db8:85a3:0:0:8a2e:0370:7334 -6 -p 80
Starting Nmap 7.80 ( https://nmap.org ) at 2022-07-01 15:05 MSK
Nmap scan report for 2a00-cloudvps.regruhosting.ru
Host is up (0.078s latency).
PORT STATE SERVICE
80/tcp open http
Nmap done: 1 IP address (1 host up) scanned in 0.18 seconds
Для pool и push-конфигов, конечно, тоже нужно добавить строки с нужными портами.