The Latest Google Search Index is 50% Fresher than Previous Google Indexes
Early Google indexes were updated every 4 months. By today’s standards that is a stale index. Around 2000 Google began indexing every month in a process called the 'Google dance' that took a week to 10 days and would provide different results when searching for the same term across the web but hitting different global Google data centers. Google has introduced a new web indexing system called Caffeine, which delivers results that are closer to live by analyzing the web in small portions and updating the index on a continuous basis. “Caffeine
lets us index web pages on an enormous scale,” writes Carrie Grimes on the official Google Blog. "Caffeine takes up nearly 100 million gigabytes of storage in one database and adds new information at a rate of hundreds of thousands of gigabytes per day." Now not only does Caffeine
provide results that are 50% fresher than Google's last index, adds Grimes, but the new search index provides a robust foundation that will make it possible for Google to build a faster and more comprehensive search engine that scales with the growth of information online."