How Search Engine Spider Work?
Mood:  happy
Topic: Seo
A search engine spider is a robot that crawls around the world wide web. They are also sometimes called crawlers. They use an algorithmic programme that follows links throughout the net searching for new content. This then fetches the new web pages and adds them to the search engine indexes. Google is a crawler-based search engine, as it relies on spiders to automatically create its listings.

When a search engine robot visits your Web page, it is important to understand a few things if you are hoping to get your Web page indexed. Search Engine Robots are simply software programs that come out to your Web page, capture certain data and then return that data to the search engine from where it came.

So what are spiders for? Their primary purpose at one time was to make a list of all the web pages that could be found on the web, using the word 'web' in the true sense of the word, as URLs that can be resolved by search engines, as opposed to the internet, which is the railroad track that these sites use to communicate and connect with each other.

Spiders look for links, page ranking and refreshment of your site among many, many more aspects of your website and each page on it. Nobody except the spider designers know exactly what they are looking for. Spiders are genius mathematicians, and they use mathematical statistical analysis to come to a decision on your site. You can work out part of that equation based on results you see, but you will never crack the code.

However, spiders are fat and lazy and get tired easily. The whole World Wide Web is vast, and a spider cannot, or refuses to, crawl more than 20% of it. It is important, then, that you make sure that you are one of that 20% by screaming at it to stop and jump into your part of the web. That is what your keywords do. Once they get there you need more than keywords to keep them there, and that is where your meta tags and content get working.

If the spider encounters a link, it will record the data and send another bot to follow that particular link, again recording all the data along the way. This is why outbound and inbound links are so important. As spiders are going from one website to the other and it so happens that the link that the spider is on keeps going back to your site, search engines will value your website more. Improving your ranking.

Remember that spiders and crawlers do not need to be submitted to for them to find you. There are actually good reasons not to use submission software but you are wiser to link to a new site from a Blog or another site that you know is already being indexed. Remember that you will still need to submit to directories though because there, you are dealing with human editors and not robots.

Read about social bookmarking, also read about social bookmark and manual social bookmarking