In the past year, Google search has dramatically increased the speed of search results, not that you would notice, since they were already quite fast.
They did so by increasing the number of sites around the world from which it serves client queries, re-purposing existing infrastructure to change the physical way that Google processes web searches. From October 2012 to late July 2013, the number of locations serving Google's search infrastructure increased from from a little less than 200 to a little more than 1400, and the number of ISPs grew from just over 100 to more than 850, which reflects Google utilizing client networks, like Time Warner Cable, that it already relied on for hosting content like videos on YouTube, and reusing them to relay — and speed up — user requests and responses for search and ads.
Previously, if you submitted a search request to Google, your request would go directly to a Google data center, but now they have turned their content-hosting infrastructure into a search infrastructure as well. Your search request will first go to the regional network, which relays it to the Google data center. While this might seem like it would make the search take longer by adding in another step, the process actually speeds up searches.
Data connections typically need to "warm up" to get to their top speed – the continuous connection between the client network and the Google data center eliminates some of that warming up lag time. In addition, content is split up into tiny packets to be sent over the Internet – and some of the delay that you may experience is due to the occasional loss of some of those packets. By designating the client network as a middleman, lost packets can be spotted and replaced much more quickly.
The team developed a new method of tracking down and mapping servers, identifying both when they are in the same datacenter and estimating where that datacenter is. They also identify the relationships between servers and clients, and just happened to be using it when Google made its move.
Delayed web responses lead to decreased user engagement, fewer searches, and lost revenue, they say. Google's rapid expansion tackles major causes of slow transfers head-on. The strategy seems to have benefits for web users, ISPs and Google, according to the team. Users have a better web browsing experience, ISPs lower their operational costs by keeping more traffic local, and Google is able to deliver its content to web users quicker.
Next, the team will attempt to quantify exactly what the performance gains are for using this strategy, and will try to identify under-served regions.