watt (watt__lv) wrote in lj_dev,

unicode characters display problem

eeeep!!! Help!

I run a livejournal based site in Latvia: http://journal.bad.lv/

Last night something happened on my server, and now lots of user entries are displayed as unicode strings, instead of showing correct national characters! It looks almost like the good UTF8 strings have been run through UTF8 convertor again, effectively escaping all the multi-byte utf8 characters... for example what should look like "Товарищ, знай - пройдет она И демократия и гласность," may become "Товарищ, знай - пройдет она И демократия и гласность,"

Weird thing is, it does not happen for all users, and does not happen in all views. For example, LASTN view may be messed up, but if you open the individual entry (in comment mode) everything is OK again. And friends can see your entry allright on their friend pages.

Here's some links:
http://journal.bad.lv/~agressor/ - Lastn view bad, but his entries look OK through friends pages (http://journal.bad.lv/users/actionman/friends)

http://journal.bad.lv/users/trz/ - both Lastn and Friends pages text is messed up, but if you visit individual entry (http://journal.bad.lv/users/trz/120705.html) it looks OK.

I don't know if it's S2 or style related at all, but one user switched his S2 style and his friends view fixed itself.

I know [agressor]'s problem is not related to style at all - I tried switching his journal to S2 and to different S1 style, but it did not help.

I verified that in USER table their "oldenc" pref is not set to some encoding (I am talking about these 2 users, but there are number of others also affected).

I don't recall any code changes that went live yesterday that would break this. Currently I suspect some subversive DB corruption may be causing this (or some subversive user setting??).

Again, the entry text in database is fine, because it displays OK on most views. I must figure out why it becomes garbled on few other views.

So... maybe you have any pointers where I should look first?

  • Post a new comment


    Anonymous comments are disabled in this journal

    default userpic

    Your reply will be screened

    Your IP address will be recorded