Spidering Hacks

Hacks #1-7

Hack  1.   A Crash Course in Spidering and Scraping

Hack  2.   Best Practices for You and Your Spider

Hack  3.   Anatomy of an HTML Page

Hack  4.   Registering Your Spider

Hack  5.   Preempting Discovery

Hack  6.   Keeping Your Spider Out of Sticky Situations

Hack  7.   Finding the Patterns of Identifiers