Datawocky: How Google Measures Search Quality - 0 views
-
The heart of the matter is this: how do you measure the quality of search results
-
The first is that we have all been trained to trust Google and click on the first result no matter what. So ranking models that make slight changes in ranking may not produce significant swings in the measured usage data. The second, more interesting, factor is that users don't know what they're missing.
-
here's the shocker -- these metrics are not very sensitive to new ranking models! When Google tries new ranking models, these metrics sometimes move, sometimes not, and never by much
- ...1 more annotation...