That 1ms advantage comes from how the server waits for network packets. It has nothing to do with where the server is located.
The ping times of the nodes add up even if the server has a good connection.
A small simplified example:
Let's assume these peer-to-peer latencies:
A-B 200...