Explain what a crawler is and what it does.

What will be an ideal response?


A crawler searches the World Wide Web for URLs and tokens. The main work of crawler is to build an index (a list of tokens) that are associated with the page. For each token, the crawler creates a list of the URLs associated with that token.

Computer Science & Information Technology

You might also like to view...

This where the switch forward plane is separate from the control plane, allowing the switch fabric to span multiple locations.

What will be an ideal response?

Computer Science & Information Technology

??Each OneNote notebook is divided into sections, also called Section Tabs. __________________

Answer the following statement true (T) or false (F)

Computer Science & Information Technology

The ______ compares adjacent items and exchanges them if they are out of order.

a) selection sort b) binary search c) bubble sort d) quicksort

Computer Science & Information Technology

Java is an example of a(n) _____________ language, in which single program statements accomplish more substantial tasks.

a) machine b) assembly c) high-level d) None of the above.

Computer Science & Information Technology