On Ubuntu Hardy Heron (8.04), these instructions didn’t work and instead I followed the pointers in here: http://articles.slicehost.com/2008/4/25/ubuntu-hardy-setup-page-2
sudo locale-gen en_GB.UTF-8
…
sudo /usr/sbin/update-locale LANG=en_GB.UTF-8