Optimising perl

Minty mintywalker at gmail.com
Fri Jun 23 12:48:46 BST 2006

On 6/23/06, alex at owal.co.uk <alex at owal.co.uk> wrote:
> Can anyone suggest some reading for optimising perl? (This is inherited
> code so dont blame me for lazy algorythms used :-)


and the associated http://www.oreilly.com/catalog/perldbi/


My personal fav is throwing in Storable as a caching layer, but that
might not help if you are hitting memory limits.

> We are building huge hashes in memory which we might tie to disk, or (my
> preference) tie to a memcached database. This gets us around the 4Gb
> memory limit in the perl binary we are using by spreading the memory
> across two processes.

Hashes have a (not tiny, when used for lots of data, or complex nested
structures) overhead - you are optimizing for fast lookups.  Play
around (and do some simple tests).  Eg, having a much smaller hash
with nothing other than a lookup key -> some kinda pointer/key, which
you can then use to grab the real data from disk (optionally with a
(Storable) disk access cache layer).

Also, have you considered using the DB (more) directly?  ie, less
in-perl-custom-caching, and more handing off the hard part to the

More information about the london.pm mailing list