Yahoo Expands Its Search Engine Index

In a major expansion, Yahoo Inc. (Nasdaq:YHOO - news) said Monday that its online search engine index now spans more than 20 billion Web documents and images, nearly double the material scanned by rival Google Inc.

Yahoo's expansion doesn't necessarily mean it produces more useful results than Google, which has long been considered the Internet's most comprehensive database.

But the breakthrough gives the Sunnyvale-based company the bragging rights to a widely watched measurement for assessing the power of an Internet search engine.

Yahoo said its index, boosted by a recent upgrade, covers 20.8 billion online "objects," comprised of about 19.2 billion documents and 1.6 billion images.

By comparison, Google said it tracks 11.3 billion objects. That figure consists of the nearly 8.2 billion Web pages that Google proudly touts on its home page and 2.1 billion images, with the remainder of material coming from its group discussions.

Until Monday, Yahoo hadn't publicly disclosed the size of its search index, but industry estimates had placed the figure somewhere between 6 billion and 8 billion.

"This is a great reason for more people to check us out," said Eckart Walther, Yahoo's vice president of products. "We are more comprehensive than anyone else out there."

In a statement late Monday, Google spokesman Nate Tyler questioned whether the size of Yahoo's search index had really surpassed its own. "We welcome innovation in search, but as of this afternoon we have not been able to verify a substantial increase to Yahoo's web index via their search results," Tyler said.

Verifying the index claims of the search engines is virtually impossible because there is no official auditing system, said Danny Sullivan, editor of industry newsletter Search Engine Watch.

Nevertheless, supplanting Mountain View-based Google as the biggest search engine should give Yahoo a potent marketing weapon in a tense duel for industry leadership, predicted Forrester Research analyst Charlene Li. "The Google brand stands for search and (Yahoo's) strategy has been to undercut that brand," she said.

Yahoo has had its sights set on Google since early last year when it introduced its own search technology and index to end a business partnership between the two companies.

For the previous 3 1/2 years, Yahoo had been licensing its search results through Google — an arrangement that helped turn its rival into one of the Internet's biggest success stories.

Since the split, Google has maintained a comfortable lead over Yahoo, even as its challenger continued to roll out new features that impressed industry analysts. Through June, Google held a 36.9 percent share of the U.S. search engine market with Yahoo at 30.4 percent, according to comScore Networks.

Generating searches is crucial for both companies because the requests spur revenue-producing ads alongside the results. The strategy has proven highly effective for both companies, with Google earning $712 million through the first half of while year and Yahoo earning $959 million during the same time.

While index size is an important factor in the search engine equation, other components, including the relevancy of the results and the freshness of the index, are even more significant, both Li and Sullivan said.

"You could add a billion pages about Britney Spears and that doesn't mean the quality of results will be any better," Sullivan said. "There have been times when other search indexes have expanded, and the results have actually gotten worse."