Author of the post - definitely check out Scrapy if you're going to be doing a recurring scrape (daily or something). It has a much higher learning curve, but the amount of features built into the framework makes it really nice for larger scraping projects.
