Spidering Hacks

[SYMBOL] [A] [B] [C] [D] [E] [F] [G] [H] [I] [J] [K] [L] [M] [N] [O] [P] [Q] [R] [S] [T] [U] [V] [W] [X] [Y] [Z]

Aas, Gisle  

AbleShoppers  

absolute URLs  

Accept-Charset headers  

Accept-Encoding HTTP header  

Accept-Language headers  

acceptable use policies  

       consequences of violating  

Acceptable Use Policy (AUP)  

accessing particular URLs  

ActiveState's ActivePerl  

advertisers and geotargeting  

aggregating data   2nd  

AIM (AOL Instant Messenger)  

Alexa  

       scraping competitive data  

All Consuming   2nd  

       book metadata and weblog mentions  

        friends and recommendations  

        most-mentioned lists  

       personal book lists  

AlltheWeb.com   2nd   3rd  

AltaVista

       Prisma  

       search request to  

Amazon.com  

       Alexa  

       ASIN   2nd  

       Associates account  

       Associates sales statistics, publishing  

       combining information from FreeDB and  

               presenting results  

       customer advice, scraping  

       graphing Sales Rank  

               multiple  

       navigating  

       product reviews

               email alert for new  

               scraping  

       recommendations, sorting by rating  

        related products  

       searching for authors  

       Web Services

               searching code  

               XML and  

America at Work, America at Leisure project (Library of Congress)  

Ampache  

AmphetaDesk   2nd   3rd  

Andromeda   2nd  

AOL Instant Messenger (AIM)  

Apache

       combined log format  

       Xerces for Java  

Apache::MP3 module   2nd  

arbitrary classification systems  

Artymiak, Jacek ( contributor )

       bio  

       Hack #46, Spidering the Yahoo! Catalog  

       Hack #75, Trendspotting with Geotargeting  

       Hack #76, Getting the Best Travel Route by Train  

ASIN (Amazon.com Standard Identification Number)   2nd  

Audioscrobbler

       limitations  

       Related Artists link  

       retrieving recommendations  

AUP (Acceptable Use Policy)  

authentication  

authors, searching across multiple sites for  

       Amazon.com  

       gathering tools  

       Library of Congress  

       presenting results  

       Project Gutenberg  

automating tasks  

       with cron  

Категории