Zobacz książki o podobnej tematyce

Więcej informacji o SharpSpider: A Continuous, Parallel and Distributed Spider

• Dane szczegółowe
• Opis
• Ulubione w innej kategorii

Za ten zakup dostaniesz 149 punkty

Opis

Search engines have become so indispensable that §they rank second only to e-mail as the most popular §online activity. To respond to queries in a timely §fashion, search engines make use of large indices of §word occurrences on Web pages to cross-reference §websites to keywords. Such indices are maintained by §spiders, a special kind of computer program that §browses the Web autonomously. However, due to a §variety of technological limitations, a single §spider has proven insufficient to maintain a search §engine's index. Hence, in this book, we review §several alternatives to split a spider's work into §multiple processes, and define a methodology to §preserve an up-to-date index of the Web. §SharpSpider, our prototype spider, has been §evaluated using the resources of PlanetLab, a §globally distributed platform for developing and §deploying planetary-scale services. Despite the §utilisation of very modest equipment, we have §performed large crawls of the Web, distributing the §workload amongst various computers spread across §different continents. The statistics derived from §our research offer valuable insight into the nature §of educational Web resources.

Szczegóły książki

• Pełny tytuł: SharpSpider: A Continuous, Parallel and Distributed Spider
• Podtytuł: Design and implementation of software to navigate the Web autonomously
• Autor: Marco Palomino
• Język: Angielski
• Oprawa: Miękka
• Liczba stron: 160
• EAN: 9783639148862
• ID: 06823440
• Wydawca: VDM Verlag Dr. Müller
• Waga: 255 g
• Wymiary: 220 × 150 × 10 mm
• Rok wydania: 2009

Ulubione w innej kategorii

---

---

---