Web scraping frameworks?

Dave Hodgkinson davehodg at gmail.com
Fri Mar 7 11:48:40 GMT 2014


OK, so I've worked out the DSL and am successfully scraping a page.

It's taking a second to parse each page. Seems a bit much.

Installing HTML::TreeBuilder::LibXML seemed like a good idea but didn't
make any difference.

Any ideas on switches I can flip to make things faster?


On Tue, Mar 4, 2014 at 9:44 PM, Dave Cross <dave at dave.org.uk> wrote:

> On 04/03/14 21:33, DAVID HODGKINSON wrote:
>
>>
>> Does something exist?
>>
>> If it doesn't does anyone want to help make it happen?
>>
>> I *really* don't want to have to write the code all over again ten
>> times...
>>
>
> Something like Web::Scraper, perhaps?
>
>   https://metacpan.org/pod/Web::Scraper
>
> Dave...
>
>


More information about the london.pm mailing list