Hallelujah, I got a success on the connection test! And was able to get a player to Connect.
It seems like it was a firewall issue where the port 1802 was allowed as an inbound rule but not outbound.
It was Windows Defender that was causing it specifically.