spider : Java Glossary

spider

Search engines wander over the Internet discovering new or changed html pages. They index the words of declared keywords in them. This sniffing process is called spidering.

The Altavista people used to distribute a free personal spider, Discover 1.1 that would index your local hard disk or arbitary websites. Then you could find stuff in them with the Discover search engine. I use a similar too called called Copernic for searching the complete JDK (Java Development Kit) documentation and Javadoc.

Keywords

The trick to attracting visitors to your website is to help the search engines find what you have to offer so they will have it on tap in their indexes when people ask for it. This means you have to consider two things:

What do I have to offer? How can I describe it in ways that summarises it, expecially highighting its uniqueness?
What questions are people going to ask for which I have a ready made answer? Make sure the important, and especially unusual words in those queries appear both in text body of your web pages and in the keywords header.

Don’t cheat. Don’t lie. Don’t mislead. Above all, don’t litter your pages with spider food. 100% honesty helps and impresses the search engine companies and they reward you with higher preferential ranking. All those companies who offer to use deception to artifically boost your search enginge rankings may work for a short while, but they could well ruin your reputation and, consequently, your long term hit rate.

Copernic
Lucene
search engine
sitemap

	available on the web at:	http://mindprod.com/jgloss/spider.html
	optional Replicator mirror of mindprod.com on local hard disk J:	J:\mindprod\jgloss\spider.html
	Please email your feedback for publication, letters to the editor, errors, omissions, typos, formatting errors, ambiguities, unclear wording, broken/redirected link reports, suggestions to improve this page or comments to Roedy Green : . If you want your message, your name or email kept confidential, not considered for public posting, please explicitly specify that. Unless you state otherwise, I will treat your message as a letter to the editor that I may or may not publish in the feedback section. After that, it will be too late to retract it. If you disagree with something I said, especially when sending an ad-hominem attack, a rant composed mainly of obscenities or a death threat, please quote the offending passage and cite the web page where you found it, tell me why you think it is wrong, and, if possible, provide some supporting evidence. I can’t very well fix erroneous or ambiguous text if I can’t find it.
Blog	Canadian Mind Products IP:[65.110.21.43] Your face IP:[50.17.109.248]
Feedback	You are visitor number 10,710.