Web scraping frameworks?
davehodg at gmail.com
Fri Mar 7 11:48:40 GMT 2014
OK, so I've worked out the DSL and am successfully scraping a page.
It's taking a second to parse each page. Seems a bit much.
Installing HTML::TreeBuilder::LibXML seemed like a good idea but didn't
make any difference.
Any ideas on switches I can flip to make things faster?
On Tue, Mar 4, 2014 at 9:44 PM, Dave Cross <dave at dave.org.uk> wrote:
> On 04/03/14 21:33, DAVID HODGKINSON wrote:
>> Does something exist?
>> If it doesn't does anyone want to help make it happen?
>> I *really* don't want to have to write the code all over again ten
> Something like Web::Scraper, perhaps?
More information about the london.pm