Re: [tlug] unable to create local copy utf8 encodedJapanese MySQLdata

[Edward Middleton <edward@example.com>]

David Riggs wrote:
> The html entities can be converted in emacs/mule-ucs with Turnbull's 
> twister: 
This is the perl one liner from the [1]"UTF-8 and Unicode FAQ for
Unix/Linux" .  You should convert it to utf-8[2] first though.

  perl -C -pe 's/&\#(\d+);/chr($1)/ge;s/&\#x([a-fA-F\d]+);/chr(hex($1))/ge;'


Edward

1 http://www.cl.cam.ac.uk/~mgk25/unicode.html#perl
2. iconv -f iso88591 -t utf8 oldfile > newfile