Instead of writing multiple server blocks repeatedly in configuration, we can simplified configuration using nginx map module ie: source: taken from nginx mailinglist
Like many other reverse proxying mechanism, the configuration is quite simple. All we need is just website that's lived in ipv4, and Nginx with IPv6 capabled network.