spider : Java Glossary

spider

Search engines wander over the Internet discovering new or changed html pages. They index the words of declared keywords in them. This sniffing process is called spidering.

The Altavista people used to distribute a free personal spider, Discover 1.1 that would index your local hard disk or arbitary websites. Then you could find stuff in them with the Discover search engine. I use a similar too called called Copernic for searching the complete JDK documentation and Javadoc.

Keywords

The trick to attracting visitors to your website is to help the search engines find what you have to offer so they will have it on tap in their indexes when people ask for it. This means you have to consider two things:

What do I have to offer? How can I describe it in ways that summarises it, expecially highighting its uniqueness?
What questions are people going to ask for which I have a ready made answer? Make sure the important, and especially unusual words in those queries appear both in text body of your web pages and in the keywords header.

Don’t cheat. Don’t lie. Don’t mislead. Above all, don’t litter your pages with spider food. 100% honesty helps and impresses the search engine companies and they reward you with higher preferential ranking. All those companies who offer to use deception to artifically boost your search enginge rankings may work for a short while, but they could well ruin your reputation and, consequently, your long term hit rate.

Copernic
Google site map
Lucene
search engine

	You can get the freshest copy of this page from:	or possibly from your local J: drive (Java virtual drive/mindprod.com website mirror)
	http://mindprod.com/jgloss/spider.html	J:\mindprod\jgloss\spider.html
	Please email your feedback for publication, errors, omissions, typos, formatting errors, ambiguities, unclear wording, broken/redirected link reports, suggestions to improve this page or comments to Roedy Green :
	Canadian Mind Products
	mindprod.com IP:[65.110.21.43]
view Blog	Your face IP:[38.107.191.106]
Feedback	You are visitor number 8,357.