There are three factors in determining the quality of a spidering search engine
(SE).
-
SQ (spider quality): The spider must come by frequently and must crawl deep.
Must honor robots.txt. The results of spidering must then be rolled into online
database quickly.
-
SR (search engine results page): The SERP must then show relevant results based
off the data they have collected from the spider. Summary must give info on
whether to click through or not. Page must be pleasant. 404s must be few and
far between.
-
CS (customer service): Response from a human to questions in a quick and
reasonable manner. Free and easy submit pages.
Let's call my ranking system the Xoc Scale (XS). It awards an engine up to 5
points for SQ, and 5 more for SR. Now you could also give points for Customer
Service (CS), but the End-User (EU) doesn't care much about that, and the EU is
picking the SE. So a CS score is placed in parens, but doesn't count toward XS
ranking.
EUs are slow to change SEs, but if they continue to get bad results, they
eventually decide to change, and they try a few engines, listen to friends,
etc. So I believe the Xoc Scale eventually determines which engine they will
likely switch to.
Based off this, and my own subjective analysis of my log files, I rate them like
this:
-
Google: Spider is excellent, crawls deep. The database takes four weeks to
update, which could be better and makes Google not good for looking for
fast-breaking news. 4.5SQ. SERP is relevant. Usually the page I'm looking for
is in the top few listings, and rarely after position 20. Listings could be a
little clearer and allow better information to decide if I want to
click-through. 4.5SR. Customer Service seems good and responsive in the one
contact I've had with them, although the final outcome of what the engineers
did could be slightly better; still they did something to their algorithm based
on my request within 4 weeks. 4.5CS. FINAL RANKING: 9.0XS
(4.5CS)
-
Fast: Spider is excellent, crawls deep. In my experience it crawls non-PDF
files and dynamic content deeper and more frequently than Google. All pages
that it finds get indexed. Needs PDF and dynamic content results. 4.5SQ. SR,
though, needs a lot of work. The top results are just not relevant and pages
that I'm looking for are frequently buried deep. 3.0SR. Submit page is fine,
have had no dealings with customer service. Not enough info to rate CS. FINAL
RANKING: 7.5XS(?CS)
-
AltaVista: Spider is good when you can get it, but not as good as Google or
Fast. Results are slow to make their way into the database. 3.0SQ. Result pages
are easy to read, but relevancy has declined a huge amount. 3.0SR. Customer
Service got back to me in a few hours on my one contact with them. Submit page
works well. 4.5CS (although others may feel different). FINAL RANKING:
6.0XS(4.5CS)
-
Inktomi: Spider is slow. Usually hits my home page once every couple of days,
then goes away. Results are even slower to get online. 2SQ. Results page are
relatively easy to read, and relevancy seems good, although outdated. 3.5SR.
Have had no contact with CS. FINAL RANKING: 5.5XS(?CS)
-
Excite: Spider is slow. Usually hits my home page once every couple of days,
then goes away. Results are even slower to get online. 2SQ. Results page allow
a lot of spam, and because of slow updates have a lot of 404s. 2.5SR. No
contact with CS. 2SQ. FINAL RANKING: 4.5XS(?CS)
-
Northern Light: Spider comes by frequently. Crawls moderately deep. Don't have
enough info on how frequently it updates the database. 3.0?SQ. I find the SERP
hard on the eyes and relevancy is extremely low. 1.5SR No contact with CS. FINAL
RANKING: 4.5?XS(?CS)
Last updated 2001-04-17
|