Crawler : Spider

It is also known as spidering. It is an automated computer program which browses all the sites of internet thoroughly. It keeps the data of the sites and continues crawling of these sites in case of getting some updations of those sites. Now a question may arise why search engines use web crawler. There is a lot of reason behind using web crawler. Some of them are noted here like the following –

1. Generally a search engine uses crawler to the sites to get up to date data and to take all the data to its memory through copying pages of those sites.
2. To check both the external and internal links of the pages of those sites.
3. To verify and validate the HTML code of those pages.
4. To collect different types of information from different types of site pages.

Generally a search engine uses some policies for crawling data like some of these. Focused policy is to search the similarity of a particular theme. Selection policy is used by the search engines to index more than 50% content of the pages of a particular site. But this policy is not so good one. Url normalization policy is to prevent crawling a same information more than one time. Re-visit policy is used for crawler through which search engines collects data after a certain period of time from a same site to get the probable updation or deletaion of data.

Search Engine Crawler	Search Engine Name
Googlebot	Google
Yahoo Slrup	Yahoo
MSNbot	Bing
GRUP	Wikipedia

These are the crawlers of the top most and famous search engines we are using in our day to day purpose.

Increase Visitors

Here are some helpful tips for increasing publicity or increasing traffic.

1. Write about your product or blog or site in the GPT forum.
2. Inform your relatives and friends about your product or blog or site.
3. Change the referral link using HTML link.
4. You can make some postering in your locality so that it can attract the visitors.
5. Use Use SEO method to increase your traffic.
   
6. You can also write a blog about your product or website.
7. You can write different forums about your website and product and can give the referral link there.
8. Search for a team who want to earn easily through online and give your referral link to them.
9. Write some classified advertise like craiglist etc.
10. Attach link after your youtube video.
11. You can add a text file (.txt) into every RAR file you will make RAR and give your site url there and advertise there to increase visitors.
12. Send your referral link in different email through attaching site address in signature.
13. Send your referral link in your using server with some more description of your link through boot/micro process.
14. Make your own site that is try to use a domain site to increase more traffic.
15. Inform about your link through yahoo messenger, AIM and some others messengers.
16. Transfer your referral link with high page ranked website in search engine.
17. Advertise your site into some other popular website pages.
18. Advertise in online games sites to increase visitors.
19. Make visiting card and include your referral link or website there.
20. You can buy 'Paid To Sign Up' or 'Paid To Join' from the other GPT site.
21. You can buy some expired domains with constant visitors.
22. Visit the site www.realstat.info
    
23. Buy some text links from some blogs, forums and groups.
24. Increase some attractive facilities of your site like some extra gift for visiting your site.
25. Add your referral link with different file sharing program to increase traffic in your site.
26. Transfer visitors with one another.
27. Advertise your site through Google Adwords.
28. Write about your referral link in the social networking site like facebook, myspace, twitter, tagged, hi5, freindster, wink, stylehive etc.
29. Add your referral link in Crashcrate.
30. Bring your site at the first 10 list of the search engine through SEO.
31. Update your site regularly and try to make it attractive to the visitors.
32. Add 'Alt tag' with your website, blog or keywords. Because these 'Alt tag' will be easily found by search engine.
33. You can advertise you site in www.stormpay.com and can get some valuable visitors.
34. You can take a e-book with a weebsite in auction from e-bay.
35. Before sending ebay product attach your referral link to increase visitors.
36. Use www.reftraders.com to increase your site traffic.
    
37. Sign up the virtual gaming site named www.entrecard.com.
38. Add your site with different earning blog.
39. Sign up again in the site www.getref.com
40. Add your site to the craiglist.
41. Make free visiting card on www.vistaprint.com