Is latency strictly up to the Internet Gods?

http://imgur.com/UirlHhY

The only thing valid i could find on the internet was to create a registry entry for Acknowledgements in the TCP Stack