My WordPress was so old that everything was still latin1. None of the updates converted it. I decided to manually change the charsets to utf8 at least. Described it here: http://blog.markheadrick.com/2015/04/27/blog-updated-to-wordpress-v4-2-1-and-other-changes/
Server does have MySQL 5.5.42-cll though.