Register | FAQ | Members List | Calendar | Search | Today's Posts | Mark Forums Read |
Google Robots to Crawl This is a discussion on Google Robots to Crawl within the Google Optimisation forums, part of the Search Engine Optimisation (SEO) category; Google uses two robots to crawl web content , these have been dubbed the freshbot and deepbot after their general purpose. ... |
| |||
![]() Google uses two robots to crawl web content , these have been dubbed the freshbot and deepbot after their general purpose. Deepbot is the once a month deep crawl of web content that results in the main Google index. The freshbot crawls the web on a continuous basis and is responsible for the Everflux effect. It finds content that is updated frequently such as news sites , forums, blogs and other websites. It appears that when Google finds a new page it checks it frequently at first to see if there are regular updates. If there are the site is added to the list of pages to be visited by the freshbot. more... | Deepbot | Google | Electrical Product | Trade Fair World | Karthi SEO | Ads karthi | Rig Veda | BYPD | Link Building | Learning Disabilities |
| |||
![]() Thanks for the info. It's nice see people sharing their ideas.. it gives me reason to join quality forums. ![]()
__________________ think online marketing |
| |||
![]() The software design to index internet mechanically is known as spider, crawler or robots. Spiders are the software program which crawl the website, tracking the various links between pages and sites, assembling the data which the search engine filters and adds to its database. Search engine stores data in database. Outsourcing, Human Resources Management, Offshore Staffing, Website Design, Software Development |
| |||
![]() Thanks for nice information... ____________ Apply for Loans | International Job | Jobs in Abroad | Call Center Services |