Ask Questions & Get Answers at ibibo sawaal

Ask your Question in Computers & Technology

Character(s) remaining:  160
 
Ask now
Home Ask Question Answer Questions My Q&A CategoriesAsk the experts Expert leader board

Home » Computers & Internet » Computers & Technology » Question

 

What is Crawler? 

Asked in Computers & Technology at 7:27 AM on November 20, 2007

Tags: crawler

! This question is closed
Report abuse
Poo
Poo
Profile | Q&A

crawler also known as a "Web crawler," "spider," "ant," "robot" (bot) and "intelligent agent," a crawler is a program that searches for information on the Web. Crawlers are widely used by Web search engines to index all the pages on a site by following the links from page to page. The search engine then summarizes the content and adds the links to their indexes. They are also used to locate Web pages that sell a particular product or to find blogs that have opinions about a product.

Answered by saixaero , an ibibo Master, at 4:33 PM on November 24, 2007

Report Abuse |  Rate this : 00
saixaero
saixaero

A program that automatically fetches Web pages. Spiders are used to feed pages to search engines. It's called a spider because it crawls over the Web. Another term for these programs is webcrawler. Because most Web pages contain links to other pages, a spider can start almost anywhere. As soon as it sees a link to another page, it goes off and fetches it.

Answered by mrmister , an ibibo Citizen, at 7:29 PM on November 21, 2007

Report Abuse |  Rate this : 00
mrmister
mrmister

its a program used by search engines to โ€œcrawlโ€ the web by following links from page to page. This is how most search engines โ€œfindโ€ the web pages that they place in their index. Also referred to as a spider or robot.

Answered by Cindy , an ibibo Advisor, at 8:49 AM on November 20, 2007

Report Abuse |  Rate this : 00
Cindy
Cindy

Crawler is a special software program, commonly used by search engines, that travels the Internet looking for new Web Pages and recording their address. Also called spiders.

Answered by nisha , an ibibo Master, at 8:45 AM on November 20, 2007

Report Abuse |  Rate this : 00
nisha
nisha

A web crawler (also known as web spider) is a program which browses the World Wide Web in a methodical, automated manner. A web crawler is one type of bot. Web crawlers not only keep a copy of all the visited pages for later processing - for example by a search engine but also index these pages to make the search narrower.

Answered by deep , an ibibo Master, at 7:53 AM on November 20, 2007

Report Abuse |  Rate this : 00
deep
deep

Related Search

 

Crawler

Well,A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. The major search engines on the Web all have such a program, which is also known as a "spider" or a "bot." Crawlers are typically programmed to visit sites that have been submitted by their owners as new or updated. Entire sites

Posted in Computers & Technology by kash at 4:40 PM on May 10, 2008
Tags definition

How does a web crawler work?

well, A crawler needs a starting point, which would be a web address, a URL. In order to browse the internet, we use the HTTP network protocol, which allows us to talk to web servers and download or upload data from and to it. The crawler browses this URL and then seeks for hyperlinks a tag in the HTML language. Then the crawler browses those links and moves on the same way. Up to here

Posted in Computers & Technology by Aryan Gusain at 10:14 PM on July 02, 2008
Tags crawler, work

if i open a blog how can i include it in google and other search engines

Web site policy makers who use robots.txt files as gatekeepers to specify what is open and what is off limits to Web crawlers favor Google over other search engines, say Penn State researchers whose are not an official standard, but by informal agreement, they regulate Web crawlers -- also known as "spiders" and "bots" -- which mine the Web 24/7 for everything from the latest news to e

Posted in Computers & Technology by ravi at 2:36 AM on June 24, 2008
Tags open, blog, include, google, search, engines

How Internet Search engines work ?

that are powered by robots called crawlers; ants or spiders and those that are powered by human submissions; and those that are a hybrid of the two.Crawler-based search engines are those that use automated software agents called crawlers that visit a Web site, read the information on the actual site, read the sites meta tags and also follow the links that the site connects to performing indexing on all linked Web

Posted in Computers & Technology by stainzz at 5:26 AM on May 07, 2008
Tags searchengines

What is Crawler?

A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. The major search engines on the Web all have such a program, which is also known as a spider or a bot. Crawlers are typically programmed to visit sites that have been submitted by their owners as new or updated. Entire sites or specific pages can

Posted in Computers & Technology by khushi at 10:41 AM on November 14, 2007
Tags crawler

What is a spider?

accessible resources such as Web pages and files in public FTP archives. Spiders contribute their discoveries to a database, which Internet users can search by using search engines such as Lycos or WebCrawler spiders working in parallel.AS DEFINED IN :http://www.webopedia.com/TE RM/s/spider.html...an insect...well, A web crawler / Spider is a program or automated script which browses the World Wide Web in a

Posted in Computers & Technology by Aryan Gusain at 8:14 PM on July 11, 2008
Tags spider

Web crawler what does it mean???

A web crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. The major search engines on the Web all have such a program, which is also known as a "spider" or a "bot." Crawlers are typically programmed to visit sites that have been submitted by their owners as new or updated. Entire sites

Posted in Computers & Technology by arun nair at 1:54 AM on December 25, 2008
Tags web, crawler, mean

Define Crawler

crawler is a search engine that gather listings by automatically crawling the web. A search engines crawler also called a spider or robot, follows links to web pages. It makes copies of the web pages found and stores these in the search engines index....A web crawler is a program or automated script which browses the World Wide Web in a methodical, automated manner. Many sites, in particular search

Posted in Computers & Technology by Sid at 12:20 AM on January 21, 2008
Tags definition

What is a Web Crawler?

A web crawler is a relatively simple, automated program, or script, that methodically scans or "crawls" through Internet pages to create an index of of the data its looking for. Alternative names for a web crawler include web spider, web robot, bot, crawler and automatic indexer.A web crawler can be used for many purposes. Probably the most common use associated with the term is related

Posted in Computers & Accessories by shobasharma at 7:14 PM on November 01, 2008
Tags web, crawler

What are the best research sites on the Internet for any topic?

called a wanderer, crawler, robot, worm, spider. Indexing is created from the collected files, e.g., title, full text, size, URL, etc. There is no selection criteria for the collection of files, though database of Internet files collected by a computer program called a wanderer, crawler, robot, worm, spider. Indexing is created from the collected files, e.g., title, full text, size, URL, etc

Posted in Computers & Technology by Aryan Gusain at 6:30 PM on June 20, 2008
Tags best, research, sites, internet, topic
More such questions ยป
Categories
View All
sawaal signature