When  a distributed application is running in-house the IT has a lot of control over the environment. They know exactly about the hardware and resources available:

network bandwith available
network latency

Now move to EC2 and other than some vague figures there is very little documented.
The guys at RighScale did some tests for ‘EC2-EC2′ bandwidth and ‘EC2-S3′ [...]