Vanity searching in vain

Tom Foremski has an interesting post this week about the apparent shrinking scale of Google’s search results.

It turns out that searches on his own name are yielding fewer and fewer results over time.  That understandably surprised Foremski since he’s both prolific and widely referenced.

Foremski is mostly concerned with the fact that this is happening.  “Clearly,” he concludes, “the number of results that Google claims is bogus.”

“What’s going on?” he then asks, and his commenters suggest a number of likely explanations in response.

But whatever the reason, Foremski’s observation makes clear that Google search statistics have dubious validity as measures of scale. And yet journalists, myself included, use them all the time as a shorthand way of measuring impact.

Our model is citations. These certainly have validity when measured against complete and comprehensively indexed sets of data. An example would be a full archive of a particular newspaper’s articles.  You can clearly state that a particular word was used, say, in the New York Times x times in 2005 and y times in 2010.

Citations are also important in science where they help measure impact of a researcher’s work. It genuinely means something to say someone is the most cited psychologist, for example, in the world.

Google, I’m sure, doesn’t mind us thinking that it, too, offers a pretty-much complete and comprehensive data set along with a true count of the number of citations in that data set.

But both the comprehensiveness of the set and the reliability of the count seem to be in fairly constant flux.

There’s solace here for Foremski — his vanity search results may not truly measure his reach (and, along with it, his impact) online.

For the rest of us there’s a lesson, too: that we need to swallow the citation counts we find on Google with a healthy dose of salt.  And I guess we need to be looking for new kind of vanity index to use from now on.

Advertisements

3 Comments

Filed under Analysis, journalism, technology

3 responses to “Vanity searching in vain

  1. i haven’t been on the silicon valley but i would really love to visit that place. i bet that it is a very exciting place to visit ”.

  2. I really prefer what you post in this article. Really insightful and intelligent. One challenge though. I’m running Internet explorer with Debian and parts of your current layout pieces are a little wonky. I realize it’s not a standard set up. Yet still it’s something to retain in view. I trust that it can help and always keep in the very best quality writing.

  3. you are truly a good webmaster. The site loading pace is incredible. It kind of feels that you are doing any unique trick. Also, The contents are masterwork. you’ve done a wonderful process on this matter!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s