Author Topic: Dianemo S: UpdateMedia und Umlauts  (Read 8881 times)

murcel

  • Guru
  • ****
  • Posts: 198
    • View Profile
Dianemo S: UpdateMedia und Umlauts
« on: June 23, 2012, 04:27:10 pm »
This is an issue i had long time ago with linuxmce.
It seems not to be fixed in dianemo.

So if i have utf-8,16 or iso tagged mp3 with an Umlaut in the title or performer, than dianemo will convert it to a different unreadable character.

so how should i tag my files, to have them right in to dianemo?

(don't know, how many times i re-tagged them outside of dianemo)

Marc

Marie.O

  • Administrator
  • LinuxMCE God
  • *****
  • Posts: 3675
  • Wastes Life On LinuxMCE Since 2007
    • View Profile
    • My Home
Re: Dianemo S: UpdateMedia und Umlauts
« Reply #1 on: June 23, 2012, 07:08:04 pm »

murcel

  • Guru
  • ****
  • Posts: 198
    • View Profile
Re: Dianemo S: UpdateMedia und Umlauts
« Reply #2 on: June 24, 2012, 11:25:48 am »
After making those changes, the restart of mysql brings up following error message:


120624 11:24:12 [ERROR] COLLATION 'utf8_general_ci' is not valid for CHARACTER SET 'latin1'
120624 11:24:12 [ERROR] Aborting
120624 11:24:12 [Note] mysqld: Shutdown complete

Marie.O

  • Administrator
  • LinuxMCE God
  • *****
  • Posts: 3675
  • Wastes Life On LinuxMCE Since 2007
    • View Profile
    • My Home
Re: Dianemo S: UpdateMedia und Umlauts
« Reply #3 on: June 24, 2012, 11:55:14 am »
:( - I guess you should go back to your original my.cnf. maybe someone else has another fix. Dianemo seems to be a bit different in this regards from LinuxMCE

murcel

  • Guru
  • ****
  • Posts: 198
    • View Profile
Re: Dianemo S: UpdateMedia und Umlauts
« Reply #4 on: June 24, 2012, 12:22:37 pm »
did that already.
thx anyway

murcel

  • Guru
  • ****
  • Posts: 198
    • View Profile
Re: Dianemo S: UpdateMedia und Umlauts
« Reply #5 on: June 25, 2012, 08:39:33 pm »
Andrew,

can you take a look at that issue please?

Marc

totallymaxed

  • LinuxMCE God
  • ****
  • Posts: 4660
  • Smart Home Consulting
    • View Profile
    • Dianemo - at home with technology
Re: Dianemo S: UpdateMedia und Umlauts
« Reply #6 on: June 25, 2012, 09:11:16 pm »
Andrew,

can you take a look at that issue please?

Marc

Well I suspect that the changes 'recommended' in that ticket have broken something... we'll look into it asap.

All the best

Andrew
Andy Herron,
CHT Ltd

For Dianemo/LinuxMCE consulting advice;
@herron on Twitter, totallymaxed+inquiries@gmail.com via email or PM me here.

Get Dianemo-Rpi2 ARM Licenses http://forum.linuxmce.org/index.php?topic=14026.0

Get RaspSqueeze-CEC or Raspbmc-CEC for Dianemo/LinuxMCE: http://wp.me/P4KgIc-5P

Facebook: https://www.facebook.com/pages/Dianemo-Home-Automation/226019387454465

http://www.dianemo.co.uk

murcel

  • Guru
  • ****
  • Posts: 198
    • View Profile
Re: Dianemo S: UpdateMedia und Umlauts
« Reply #7 on: June 25, 2012, 09:27:44 pm »
Andrew,

the "recommdation" didn't broke anything, i removed it again and system is running as expected.
BUT, the umlaut problem was never working since i am using dianemo. Long time ago we fixed it in linuxmce.

So again:
i am tagging my mp3 - because of the hughiness - outside of dianemo.
In Germany and some other european countries we got some characters, like the german umlaut or french accents etc. If the UpdateMedia finds such a file, it is imported, but the ä ö ü is converted to some other character.

surely it is about the character set. The encoding of the mp3 tags in the files it utf-8 or utf-16.

Furthermore, sometimes after updating tags outside of dianemo (and linuxmce), when e.g. the album title was changed (from bla bla to blabla extended edition), updatemedia seems to save both of the albumtitels to the mp3 (or database), same for performer, and titel.

I know that isn't always a bug, but wanted, in case there are various performer, but in case of album titel and titel, it doesn' make sense at all for me.



totallymaxed

  • LinuxMCE God
  • ****
  • Posts: 4660
  • Smart Home Consulting
    • View Profile
    • Dianemo - at home with technology
Re: Dianemo S: UpdateMedia und Umlauts
« Reply #8 on: June 26, 2012, 12:24:17 am »
Andrew,

the "recommdation" didn't broke anything, i removed it again and system is running as expected.
BUT, the umlaut problem was never working since i am using dianemo. Long time ago we fixed it in linuxmce.

So again:
i am tagging my mp3 - because of the hughiness - outside of dianemo.
In Germany and some other european countries we got some characters, like the german umlaut or french accents etc. If the UpdateMedia finds such a file, it is imported, but the ä ö ü is converted to some other character.

surely it is about the character set. The encoding of the mp3 tags in the files it utf-8 or utf-16.

Furthermore, sometimes after updating tags outside of dianemo (and linuxmce), when e.g. the album title was changed (from bla bla to blabla extended edition), updatemedia seems to save both of the albumtitels to the mp3 (or database), same for performer, and titel.

I know that isn't always a bug, but wanted, in case there are various performer, but in case of album titel and titel, it doesn' make sense at all for me.


Well its good you could back out of the changes cleanly.

One possibility to explain why the suggested fix in 1485 did not seem to work is that you will need to restart the MySQL server (or reboot) after applying it. You could re-apply the fix and restart MySQL server.

Let me know if that fixes the issue.

All the best

Andrew
Andy Herron,
CHT Ltd

For Dianemo/LinuxMCE consulting advice;
@herron on Twitter, totallymaxed+inquiries@gmail.com via email or PM me here.

Get Dianemo-Rpi2 ARM Licenses http://forum.linuxmce.org/index.php?topic=14026.0

Get RaspSqueeze-CEC or Raspbmc-CEC for Dianemo/LinuxMCE: http://wp.me/P4KgIc-5P

Facebook: https://www.facebook.com/pages/Dianemo-Home-Automation/226019387454465

http://www.dianemo.co.uk

uplink

  • Administrator
  • Guru
  • *****
  • Posts: 192
  • Linux and LinuxMCE witchdoctor
    • View Profile
Re: Dianemo S: UpdateMedia und Umlauts
« Reply #9 on: June 26, 2012, 05:46:22 am »
My idea, after reading the thread, is that LinuxMCE changed the database collations at some point, while Dianemo didn't. I get this impression from reading the conflict you get once you make those changes to my.cnf. In my opinion, you shouldn't even need to do that if the collations were right (and if that was what was really causing the problems). I'd have to play with some funny filenames to see what's going on. I've seen it before, with French é characters - I was getting "file not found" on playback because of them. But I didn't really have the time to look into it.

I'm also not totally clear as to what the problem is: do you get "file not found" or is it a display problem, where you get squares where the accented characters are?

Marie.O

  • Administrator
  • LinuxMCE God
  • *****
  • Posts: 3675
  • Wastes Life On LinuxMCE Since 2007
    • View Profile
    • My Home
Re: Dianemo S: UpdateMedia und Umlauts
« Reply #10 on: June 26, 2012, 07:05:55 am »
LinuxMCE changed the collation to UTF-8 a few years ago (that sounds soo old)... Since we did do that change, we haven't seen Umlaut problems until very recently.

murcel

  • Guru
  • ****
  • Posts: 198
    • View Profile
Re: Dianemo S: UpdateMedia und Umlauts
« Reply #11 on: June 26, 2012, 11:06:29 pm »
I'm also not totally clear as to what the problem is: do you get "file not found" or is it a display problem, where you get squares where the accented characters are?

Most of the times its only a mater of display. Doesn't look nice.
Secondly is, that sometimes because of that albums are broken into 2 or more "albums" e.g. "Bäst of", "B|st of " etc.

like possy said before, we did that a long time ago in linuxmce and changed the database.

murcel

  • Guru
  • ****
  • Posts: 198
    • View Profile
Re: Dianemo S: UpdateMedia und Umlauts
« Reply #12 on: June 26, 2012, 11:08:56 pm »
One possibility to explain why the suggested fix in 1485 did not seem to work is that you will need to restart the MySQL server (or reboot) after applying it. You could re-apply the fix and restart MySQL server.

Andrew, of course i did a restart - or better said, i tried to. After that i got the error message posted above.
Even a reboot doesn't fixed it. mysql will not start up causing system not to work right (everything which is related to mysql)

totallymaxed

  • LinuxMCE God
  • ****
  • Posts: 4660
  • Smart Home Consulting
    • View Profile
    • Dianemo - at home with technology
Re: Dianemo S: UpdateMedia und Umlauts
« Reply #13 on: June 26, 2012, 11:16:45 pm »
Andrew, of course i did a restart - or better said, i tried to. After that i got the error message posted above.
Even a reboot doesn't fixed it. mysql will not start up causing system not to work right (everything which is related to mysql

Ok understood. Well it looks like we will have to do a database wide conversation/update for UTF-8 to fix this issue. We're looking into how we approach this and will release an update when we have completed it. It will be at least several weeks away however as we already have a number of other updates scheduled or in development.

All the best

Andrew
Andy Herron,
CHT Ltd

For Dianemo/LinuxMCE consulting advice;
@herron on Twitter, totallymaxed+inquiries@gmail.com via email or PM me here.

Get Dianemo-Rpi2 ARM Licenses http://forum.linuxmce.org/index.php?topic=14026.0

Get RaspSqueeze-CEC or Raspbmc-CEC for Dianemo/LinuxMCE: http://wp.me/P4KgIc-5P

Facebook: https://www.facebook.com/pages/Dianemo-Home-Automation/226019387454465

http://www.dianemo.co.uk

murcel

  • Guru
  • ****
  • Posts: 198
    • View Profile
Re: Dianemo S: UpdateMedia und Umlauts
« Reply #14 on: September 12, 2012, 10:16:24 pm »
Ok understood. Well it looks like we will have to do a database wide conversation/update for UTF-8 to fix this issue. We're looking into how we approach this and will release an update when we have completed it. It will be at least several weeks away however as we already have a number of other updates scheduled or in development.

I digged into it, and it seems that dianemo uses MySql 5.5 something.
Therefor the wiki instructions are not working at all.

http://wiki.linuxmce.org/index.php/Translate_the_GUI_into_another_language

If you follow this to change the database to utf8, you have to take out the "default-character-set=utf8;" in the mysqld section of my.cnf.

Then it will work.
I will change the wiki