UTF8 Fonts damaged when importing database from 1.6.1

[uddhavadasa]

Upgraded to the SVN trunk version last week. I upgraded from my 1.6.1 installation, and all my UTF8 fonts got damaged:

[brettp]

Did you make any changes to core in your 1.6.1 installation? There are a few changes floating around the community site that will break the migration.

[uddhavadasa]

Hello Brett,

I only have one core change, which doesn't disable a new user on registration (for siteaccess). This problem happens with all forum discussion titles, usernames, etc.

Regards,
Uddhava dasa

[brettp]

Could you provide a bit of information about your upgrade procedure? Specifically:

• Were you restoring the database from a backup and then updating?
• If so, did you use SET NAMES utf8 on the backup?

[uddhavadasa]

Hello Brett,

I simply used the same database for 1.6.1, and changed the scripts to 1.7, so there was no backup restore. After that i ran upgrade.php so that the main page would not show blank. I haven't tried the latest SVN, should i do that ?

Regards,
Uddhava dasa

[brettp]

Nothing has changed so it wouldn't help. I can't duplicate the problems you're having coming from a 1.6 installation, though. Can you provide a few example characters that were corrupted and I'll test with those specifically?

[uddhavadasa]

Ok Brett, please try this text:

Hare Kṛṣṇa! vāñchā-kalpa-tarubhyaṣ ca kṛpā sindhubhya eva ca
patitānāṁ pāvanebhyo vaiṣṇavebhyo namo namaḥ

Regards,
Uddhava dāsa

[cash]

The mb wrapper was not functioning. I fixed that yesterday. Don't know if this is related.

[uddhavadasa]

Should i do a test with latest SVN release ?

[cash]

Yes, please do test with the latest. I tried the string you pasted with the latest and it worked for me.

[uddhavadasa]

Tried downloading the latest SVN version, but the server seems to be down, or has the URL changed ?

[cash]

The server is no longer https if that is what you are using with your svn client. The addresses here are updated: ​http://docs.elgg.org/wiki/Development/Subversion

Also, the svn nightly page no longer is being updated if you were using that (http://elgg.org/download/nightly/).

[brettp]

I have removed table locking in the database upgrade in [svn:3781] because it doesn't seem fully supported by most servers. Please try again with this revision or higher. Note that because of bug #1424 you will need to restore your database to run the migration again.

[uddhavadasa]

Hello Brett, Cash,

I have tested latest trunk release:
Release - 1.7a1, Version - 2009102801

Although all user icons are not appearing, no more problem with fonts anymore.

Regards,
Uddhava dasa

[brettp]

Thanks for reporting back. Do your usernames contain utf8 characters? (Note: Not the display names, but the names used to login.)

[uddhavadasa]

Hello Brett,

No, none of my usernames have UTF8, only the display names.

Regards,
Uddhava dasa

[brettp]

I'm closing this one off. The problems with icons seems to be unrelated to encoding.
@Uddhava dasa, if you haven't, check out ​http://docs.elgg.org/wiki/DuplicateInstallation for info on how to correct the data storage for imported databases. If icons still don't work (but work on the import before the upgrade) please create a new ticket. Thanks for the help!