Author Topic: About Metadata  (Read 6311 times)

phenigma

  • wants to work for LinuxMCE
  • **
  • Posts: 944
    • View Profile
Re: About Metadata
« Reply #30 on: November 14, 2010, 09:51:30 pm »
Code: [Select]
dcerouter_1013980:~/linuxmce-autotagger# ./autotagger.bin "/home/public/data/videos/test"
connection made!
Media Autotagger v1.1
User Path Entered: /home/public/data/videos/test
./autotagger.bin: symbol lookup error: ./autotagger.bin: undefined symbol: _ZN9QListData11detach_growEPii

Fresh git pull.  Still have the symbol error.

J.

golgoj4

  • NEEDS to work for LinuxMCE
  • ***
  • Posts: 1074
  • hrumpf!
    • View Profile
    • La Smarthomes - SoCal smarthome site
Re: About Metadata
« Reply #31 on: November 14, 2010, 10:06:36 pm »
Code: [Select]
dcerouter_1013980:~/linuxmce-autotagger# ./autotagger.bin "/home/public/data/videos/test"
connection made!
Media Autotagger v1.1
User Path Entered: /home/public/data/videos/test
./autotagger.bin: symbol lookup error: ./autotagger.bin: undefined symbol: _ZN9QListData11detach_growEPii

Fresh git pull.  Still have the symbol error.

J.

Yeah because i made a dumbass update with out checking my work. I just fixed it. I suspect if you ldd what you got there the qtlibs point to /opt/. I Just figured out how to set it specifically to the shared version but I need to explicitly set it to that every time i open up qt creator (which i didnt know). Literally caught and fixed it 5 min before this post.

And sorry for being so sloppy about this. still trying to develop my own internal process.

-golgoj4
« Last Edit: November 14, 2010, 10:16:41 pm by golgoj4 »
Those people who tell you not to take chances, they are all missing what life's all about.

Wiki Hardware Page http://wiki.linuxmce.org/index.php/User:Langstonius

phenigma

  • wants to work for LinuxMCE
  • **
  • Posts: 944
    • View Profile
Re: About Metadata
« Reply #32 on: November 14, 2010, 10:22:30 pm »
Fresh git pull a minute ago and I've got action...

Found the items in my test folder, tagged them and grabbed graphics.  These were movies.  I'm going to try some television and movie folders later on to see what happens.

J.

phenigma

  • wants to work for LinuxMCE
  • **
  • Posts: 944
    • View Profile
Re: About Metadata
« Reply #33 on: November 14, 2010, 10:39:24 pm »
Code: [Select]
dcerouter_1013980:~/linuxmce-autotagger# ./autotagger.bin /home/public/data/videos/Windows\ Share-Public\ \[32\]/TV/Castle\ S01Part1/
connection made!
Media Autotagger v1.1
User Path Entered: /home/public/data/videos/Windows Share-Public [32]/TV/Castle S01Part1
No Subdirectories
Found 10 File(s) and 0 SubDirectories
============================| New File |==============================
.....................Scanned:Castle 01x02 - Nanny McDead.avi
....................PK_File: 44693
------------------Identifying Data-----------------
-------Movie Filter Hits:: |
-------Tv Filter Hits:: 0
------------------TVDB.com Filter--------------
Name=Castle
Guessed Season: 1...Guessed Episode Number: 1
initiating request
got response, reading.
Extended Data for: Castle--Season:1|| Episode: 1
Wrote Data for:Castle
procesing zip files
Deleted xml Zip File
1
Opened Banners File, setting content....Now Searching for images...Found the Episode!
|====Attributes===|
Show: Castle, Season: 1, Episode Number: 1
Episode: Tower Of London And Dover Castle |-----|  Director:
Regular Performers: ||
Guest Stars:
Synopsis:

IMDB: tt0407372 == Rating:
Program ID:||  Show ID: 1477761
Genre(s):
Tv Network: Channel 4
Dvd Info========
Dvd seaon:, Dvd Episode: , Dvd Chapter:
Dvd Disc ID:
|======End========|
-----------------------------Mysql Interaction-------------------
Done! New AttributeID = 34198|| Now for file...Done! New AttributeID = 34199|| Now for file...Done! New AttributeID = 34200|| Now for file...Done! New AttributeID = 34201|| Now for file...Done! New AttributeID = 34202|| Now for file...Done! New AttributeID = 34203|| Now for file...Done! New AttributeID = 34204|| Now for file...Done! New AttributeID = 34205|| Now for file.......done!
Getting Pic for file
file picture processing
No Image here, stopping pre-insert!
Attribute of Picture will be saved: http://www.thetvdb.com/banners/graphical/82607-g.jpg
Getting Pic
---picture processing
wrote picture file data.inserted into picture_table..insert id:23962
Copied to /mediapics...23962.jpg
Thumb created..
inserted into picture_Attribute..
Segmentation fault (core dumped)

Some issues with IDing the episode (gets picked up as 1 instead of 2) and a seg fault...

J.

golgoj4

  • NEEDS to work for LinuxMCE
  • ***
  • Posts: 1074
  • hrumpf!
    • View Profile
    • La Smarthomes - SoCal smarthome site
Re: About Metadata
« Reply #34 on: November 14, 2010, 10:43:28 pm »
Code: [Select]
dcerouter_1013980:~/linuxmce-autotagger# ./autotagger.bin /home/public/data/videos/Windows\ Share-Public\ \[32\]/TV/Castle\ S01Part1/
connection made!
Media Autotagger v1.1
User Path Entered: /home/public/data/videos/Windows Share-Public [32]/TV/Castle S01Part1
No Subdirectories
Found 10 File(s) and 0 SubDirectories
============================| New File |==============================
.....................Scanned:Castle 01x02 - Nanny McDead.avi
....................PK_File: 44693
------------------Identifying Data-----------------
-------Movie Filter Hits:: |
-------Tv Filter Hits:: 0
------------------TVDB.com Filter--------------
Name=Castle
Guessed Season: 1...Guessed Episode Number: 1
initiating request
got response, reading.
Extended Data for: Castle--Season:1|| Episode: 1
Wrote Data for:Castle
procesing zip files
Deleted xml Zip File
1
Opened Banners File, setting content....Now Searching for images...Found the Episode!
|====Attributes===|
Show: Castle, Season: 1, Episode Number: 1
Episode: Tower Of London And Dover Castle |-----|  Director:
Regular Performers: ||
Guest Stars:
Synopsis:

IMDB: tt0407372 == Rating:
Program ID:||  Show ID: 1477761
Genre(s):
Tv Network: Channel 4
Dvd Info========
Dvd seaon:, Dvd Episode: , Dvd Chapter:
Dvd Disc ID:
|======End========|
-----------------------------Mysql Interaction-------------------
Done! New AttributeID = 34198|| Now for file...Done! New AttributeID = 34199|| Now for file...Done! New AttributeID = 34200|| Now for file...Done! New AttributeID = 34201|| Now for file...Done! New AttributeID = 34202|| Now for file...Done! New AttributeID = 34203|| Now for file...Done! New AttributeID = 34204|| Now for file...Done! New AttributeID = 34205|| Now for file.......done!
Getting Pic for file
file picture processing
No Image here, stopping pre-insert!
Attribute of Picture will be saved: http://www.thetvdb.com/banners/graphical/82607-g.jpg
Getting Pic
---picture processing
wrote picture file data.inserted into picture_table..insert id:23962
Copied to /mediapics...23962.jpg
Thumb created..
inserted into picture_Attribute..
Segmentation fault (core dumped)

Some issues with IDing the episode (gets picked up as 1 instead of 2) and a seg fault...

J.

Thank You for posting the output, im going to investigate this right away.
-golgoj4
Those people who tell you not to take chances, they are all missing what life's all about.

Wiki Hardware Page http://wiki.linuxmce.org/index.php/User:Langstonius

golgoj4

  • NEEDS to work for LinuxMCE
  • ***
  • Posts: 1074
  • hrumpf!
    • View Profile
    • La Smarthomes - SoCal smarthome site
Re: About Metadata
« Reply #35 on: November 15, 2010, 12:52:47 am »
Ive made another update to correct both issues as well as another bug is a struct blah blah blah. The segfault was more than likely due to bad error checking on my part with null images for tv shows. The Episode detection issue was related to having a typo in the regex that is as long as my arm ;)

Thanks again and let me know where to send the beer.
-Golgoj4
Those people who tell you not to take chances, they are all missing what life's all about.

Wiki Hardware Page http://wiki.linuxmce.org/index.php/User:Langstonius

phenigma

  • wants to work for LinuxMCE
  • **
  • Posts: 944
    • View Profile
Re: About Metadata
« Reply #36 on: November 15, 2010, 01:33:49 am »
Alright, this time it scanned through each of the episodes but has guessed the episode # to be #1 for each of the 10 episodes in that folder.  The graphic it grabbed for 'Castle' was of a castle and not associated with the show.  :)  I can post (or pastebin) output if you'd like.

current filenames:
Code: [Select]
Castle 01x01 - Flowers for Your Grave.avi
...
Castle 01x10 - A Death in the Family.avi

It worked great on these type of episode names:

Code: [Select]
Chuck.S02E12.Chuck.Versus.the.Third.Dimension.HDTV.avi
Buffy - 6x07 - Once More With Feeling.avi
J.
« Last Edit: November 15, 2010, 01:37:33 am by phenigma »

golgoj4

  • NEEDS to work for LinuxMCE
  • ***
  • Posts: 1074
  • hrumpf!
    • View Profile
    • La Smarthomes - SoCal smarthome site
Re: About Metadata
« Reply #37 on: November 15, 2010, 03:10:10 am »
Alright, this time it scanned through each of the episodes but has guessed the episode # to be #1 for each of the 10 episodes in that folder.  The graphic it grabbed for 'Castle' was of a castle and not associated with the show.  :)  I can post (or pastebin) output if you'd like.

current filenames:
Code: [Select]
Castle 01x01 - Flowers for Your Grave.avi
...
Castle 01x10 - A Death in the Family.avi

It worked great on these type of episode names:

Code: [Select]
Chuck.S02E12.Chuck.Versus.the.Third.Dimension.HDTV.avi
Buffy - 6x07 - Once More With Feeling.avi
J.

Thanks for letting me know so soon! On it being the wrong series, this is commonly a problem with tv series that share the same name but are produced years apart. I would imagine people will run into the same problem with V or Battlestar Galactica and I would really like some input on this quandry.
Possible solutions are:
A. Make it use the most recent series under that name
B. If it finds too many, skip
C. Append the year (2009) in this case to the title.

Option C isnt a good an option because it removes the 'auto' part from the tagging. So i shall have to think about it. Though this is the current work around to this problem.

As far as the detection, i just need to get my regexp right.
-Golgoj4
« Last Edit: November 15, 2010, 03:15:23 am by golgoj4 »
Those people who tell you not to take chances, they are all missing what life's all about.

Wiki Hardware Page http://wiki.linuxmce.org/index.php/User:Langstonius

phenigma

  • wants to work for LinuxMCE
  • **
  • Posts: 944
    • View Profile
Re: About Metadata
« Reply #38 on: November 15, 2010, 03:41:58 am »
Your welcome.  I've run about 1500 movies through it and it has found about 90% of them.  The remaining movies probably just need to be re-named a little.  I've seen a few mis-matches but adding a year to the file's name may fix them up.  Really great so far!

J.

golgoj4

  • NEEDS to work for LinuxMCE
  • ***
  • Posts: 1074
  • hrumpf!
    • View Profile
    • La Smarthomes - SoCal smarthome site
Re: About Metadata
« Reply #39 on: November 15, 2010, 06:46:52 am »
Your welcome.  I've run about 1500 movies through it and it has found about 90% of them.  The remaining movies probably just need to be re-named a little.  I've seen a few mis-matches but adding a year to the file's name may fix them up.  Really great so far!

J.

Thanks :)

Im still trying to improve the detection part though.

-golgoj4
Those people who tell you not to take chances, they are all missing what life's all about.

Wiki Hardware Page http://wiki.linuxmce.org/index.php/User:Langstonius

wombiroller

  • Guru
  • ****
  • Posts: 340
    • View Profile
Re: About Metadata
« Reply #40 on: November 15, 2010, 09:57:24 am »
golgoj4, you're a star. Works a treat for me too! have not tried it out on most of my media because it was already tagged, but with the exception of my documentaries folder (which didn't match of the 100 or so files for obvious reasons) I seem to get about a 90% success rate the rest. No more errors. Is there anything specific you want me to test on?

golgoj4

  • NEEDS to work for LinuxMCE
  • ***
  • Posts: 1074
  • hrumpf!
    • View Profile
    • La Smarthomes - SoCal smarthome site
Re: About Metadata
« Reply #41 on: November 15, 2010, 06:45:13 pm »
golgoj4, you're a star. Works a treat for me too! have not tried it out on most of my media because it was already tagged, but with the exception of my documentaries folder (which didn't match of the 100 or so files for obvious reasons) I seem to get about a 90% success rate the rest. No more errors. Is there anything specific you want me to test on?

Thanks for the vote of confidence :)

At the moment im tweaking some of the innner workings like
-Discovered a bug that doesn't delete the xml zip files properly
-Detecting if files are in a folder with the name of the show.
-Improving some db calls, adding more error checking
-Fix the zip download function

so a couple things left to finish before i try to daemonize it.

I would however like you to check something for me. On any UI1 orbiter, check the sort filters and see if you have one called  'program'. This should now sort tv shows based on tv program. Some awesome person added it, making wading through tv shows a lot easier. Some note on this:

-It doesnt seem to show under UI2

-Because it didn't exist before, most tv shows will not show up under this filter yet. The reason for this is because information was put in the best available slot to provide the most information on screen. So now, that we have a 'program' I can utilize attrubuteType 12 (program) as a useful field. Long story short, it wont hurt to re-run this auto-tagging script over the existing directories

-Going to be looking at some sort of web-admin addition to 'clean' files en masse, allowing for faster tag cleanup in the case of a lot of mis-identifications. Also, the code in the webadmin needs to be changed to reflect the new addition of sort options.

Im sure there is stuff im missing but I wanted to let you know whats on the list of things to do right away.

-golgoj4
Those people who tell you not to take chances, they are all missing what life's all about.

Wiki Hardware Page http://wiki.linuxmce.org/index.php/User:Langstonius

phenigma

  • wants to work for LinuxMCE
  • **
  • Posts: 944
    • View Profile
Re: About Metadata
« Reply #42 on: November 15, 2010, 10:29:13 pm »
You're doing a fine job!  As wombiroller asked: is there anything specific you would like tested?  I'll probably drop & re-create my pluto_media database in the near future to do some other testing so I'll give it a good workout then as well.

J.

golgoj4

  • NEEDS to work for LinuxMCE
  • ***
  • Posts: 1074
  • hrumpf!
    • View Profile
    • La Smarthomes - SoCal smarthome site
Re: About Metadata
« Reply #43 on: November 15, 2010, 11:22:42 pm »
You're doing a fine job!  As wombiroller asked: is there anything specific you would like tested?  I'll probably drop & re-create my pluto_media database in the near future to do some other testing so I'll give it a good workout then as well.

J.

Thanks :)

No at the moment. One of the major things I left off of the list was how to detect old series vs new ones. The only thing i can come up with requires user interaction, and thats not really viable. Dare i say a pop-up on screen that asks the user? Not sure yet but im turning this over and over in my head.

Also, if you have a ui1 orbiter i would love to know if the 'program' sort option is there for you and if you have ui2 anywhere, does it exists there too. Right now i only seem to have it on my ui1 orbiters.

-Golgoj4
Those people who tell you not to take chances, they are all missing what life's all about.

Wiki Hardware Page http://wiki.linuxmce.org/index.php/User:Langstonius

wombiroller

  • Guru
  • ****
  • Posts: 340
    • View Profile
Re: About Metadata
« Reply #44 on: November 16, 2010, 08:31:12 am »
I would however like you to check something for me. On any UI1 orbiter, check the sort filters and see if you have one called  'program'. This should now sort tv shows based on tv program. Some awesome person added it, making wading through tv shows a lot easier. Some note on this:
Hmmm I tried full orbiter regens, but I only have:
Recently Used
Filename
Title
Performer
Genre
Director

I have updated from the Update 2010-10-13 23333 but not the Update 2010-11-01 23388 as I have not got around to fixing the source.list yet.

How long has the program sort been there for?