Web scraping frameworks?
Dave Hodgkinson
davehodg at gmail.com
Fri Mar 7 11:48:40 GMT 2014
OK, so I've worked out the DSL and am successfully scraping a page.
It's taking a second to parse each page. Seems a bit much.
Installing HTML::TreeBuilder::LibXML seemed like a good idea but didn't
make any difference.
Any ideas on switches I can flip to make things faster?
On Tue, Mar 4, 2014 at 9:44 PM, Dave Cross <dave at dave.org.uk> wrote:
> On 04/03/14 21:33, DAVID HODGKINSON wrote:
>
>>
>> Does something exist?
>>
>> If it doesn't does anyone want to help make it happen?
>>
>> I *really* don't want to have to write the code all over again ten
>> times...
>>
>
> Something like Web::Scraper, perhaps?
>
> https://metacpan.org/pod/Web::Scraper
>
> Dave...
>
>
More information about the london.pm
mailing list