Why You Shouldn’t Trust comScore’s Numbers for Search Engine Market Share [Data]

It’s important for digital marketers to have accurate numbers and the real story on search engine market share. Search engine market share impacts our marketing spend, campaign objectives, and bottom line. So, why is there a discrepancy? This article will shed some important light on that.

comScore is an industry standard for big data. The company regularly releases search engine market share numbers that are often cited as the authoritative word in the search industry. Currently, comScore puts Google’s share as 67%. However, a Conductor study of more that 100 million organic search visits found that 85% of traffic came from Google versus Yahoo and Bing. In fact, many researchers in search find that their numbers of search engine share don’t line up with comScore’s.

Not long ago we posted an article on the Conductor blog musing about the future of Microsoft’s Bing. In it, we cited comScore’s search engine market share numbers as proof that Microsoft was struggling to capture market share from the incumbent, Google.

Several readers, mostly SEO practitioners (as opposed to executives), reached out to question the use of comScore’s search engine market share numbers, saying their experiences with their own sites’ analytics were that comScore’s attribution of Google’s share is low – some said *very* low. One reader said one of his sites had 82% of traffic come from Google, and another had 92%.

The Real Answer Matters to Practitioners and Executives Alike

Where the truth lies when it comes to search engine market share matters more than just knowing how to talk intelligently about it at the next industry conference mixer. It matters because the size of non-Google share determines whether resources are allocated to optimizing, tracking, and generally giving mind share to any search engine that doesn’t start with ‘G’ and end in ‘oogle’.

comScore’s numbers also create a split between executives and practitioners. Executives point to the established authority’s lower Google share and practitioners point to the considerably higher share they are seeing in their web analytics.

In the words of one seasoned SEO Manager:

“Where that [comScore’s market share numbers] causes trouble is when comScore/ qSearch numbers are known to executives, and analytics professionals come in and show their statistics and the discrepancy is observed. I’ve had multiple executives comment to me that our numbers don’t reflect “reality” – “reality” of course being the comScore/qSearch numbers.”

The reader closed by urging us to do research on search engine market share by analyzing a large set of natural search visits from a diverse collection of sites and publish the findings so the digital marketing community – both executives and practitioners alike – can benefit from the analysis and be better informed about how best to approach search market share.

The Search Engine Market Share Debate: Just a Big Misunderstanding?

Before we dive into the findings, we should mention that this post is not intended to discredit comScore. The issue is more a misapprehension than anything else. As I understand it, comScore’s methodology for calculating search engine market share involves including all entity sites in traffic calculations. That means that searches at all of the web properties owned by Microsoft or Yahoo, not just their search engines, get bundled into the results.

Marketers may expect that comScore numbers reflect only search engine market share, basically an aggregate of sites’ web analytics. They don’t realize that this is only part of what comScore considers in its calculations. This could explain the discrepancies. In that case, we’re not actually disagreeing about market share. We’re talking about two different number sets.

I am hope that one way or another this post validates the data – that is often cited as authoritative in the industry. Hopefully digital marketers and executives alike will find the analysis valuable, and it will settle the search market share argument once and for all.

And, if anyone at comScore wants to reach out to correct my explanation of their methodology or to clarify the discrepancies between comScore’s numbers and what many are seeing in their own analytics, you can reach me at nsafran [at] conductor [dot] com.

85% of Organic Search Visits Comes from Google

We analyzed 6 months worth of data from 63 websites – a mix of B2B and B2C. We looked at more than 100 million organic search visits, segmenting traffic into ‘Google’, ‘Bing’, ‘Yahoo’, and ‘Other’ buckets. 85% of overall organic search traffic came from Google, while 6% came from Bing and 5% from Yahoo. We saw no statistically meaningful difference in search traffic distribution for B2B vs. B2C sites. When compared to comScore’s 67% of Google share, we can see the cause for concern.

Nearly 3⁄4 of Websites Receive 80% or More of Search Traffic from Google

Looking at a distribution of the sites’ Google search traffic by ‘traffic buckets’ (e.g. the percentage of sites receiving 75% or above of traffic from Google vs 80% or above etc), we see that the sweet spot seems to be between 75-80%, with nearly 3⁄4’s (73%) of websites analyzed receiving 80% or more of their search traffic from Google. If you bucket all of the sites that received 85% or more traffic from Google, still, more than half (54%) of all websites received their search traffic from Google as opposed to other search engines.

We Might Be Underestimating Google’s Search Engine Market Share

Actually, those sites with high percentages of traffic from Google could be even higher. A scatter plot of the data shows that a handful of outliers with less than 50% of Google traffic are bringing down the percentage of sites in ‘high percentage buckets’ (above). These outliers receive less than half of their traffic from Google, with the remaining half coming roughly evenly from equal parts Bing and Yahoo. These may be sites that have been penalized by Google or those who have taken a focused approach to specifically optimizing for Yahoo and Bing, but we left them in our analysis so as to accurately reflect a random sampling of web sites.

Believe in the Power of Your Own Analytics

Our analysis of more than 100 million search visits showed that 85% of total visits come from Google. Almost 3⁄4’s of sites we analyzed receive 80% or more of their search traffic from Google. When placed side by side with comScore’s published 67%, it is enough to give marketers pause.

If you’re an SEO practitioner, use this analysis to present an alternative view on search traffic distribution to executives who champion comScore’s numbers as gospel. If you’re an executive, this can be a valuable alternative data set to help you make informed decisions about resource allocation and search strategy. With this analysis, both executives and practitioners should now feel more comfortable basing their tactics and strategy decisions on their own traffic data even if those numbers reflect a Google share that is vastly greater than the industry standard comScore.

Read more: Don’t Blindly Trust the Data