LinuxMCE Forums

General => Users => Topic started by: golgoj4 on February 14, 2010, 05:25:55 am

Title: Need testers - updated 10-1
Post by: golgoj4 on February 14, 2010, 05:25:55 am
Hello all,

Latest Version
-Multi-language support
-Sets Media type 'Tv Shows' and media subtype. Subtype is selectable between: Standard Def, HD 720, and HD 1080
-Single File, Batch, and Tv Specials

If no-one else can think of any bugs, im planning on opening a trac ticket and ask possy nicely to add it.

Zips are located here
http://langstonball.com/linuxmce-topmenu-31/25-software/59-tvdb-addition-to-the-webadmin (http://langstonball.com/linuxmce-topmenu-31/25-software/59-tvdb-addition-to-the-webadmin)

Installation:
unzip in the root directory, files should land in the appropriate place.

Also. please, pretty please:
if you hit an error, please let me know 3 things:
1. what language you are using
2. what the filename is
3. the error reported.

Thank you to the folks who have been providing feedback so far! Keep it coming and thanks for taking the time.
there is a limit to filesize, so i posted elsewhere:

This should run on 0710 and 0810
Title: Re: Need testers
Post by: golgoj4 on February 16, 2010, 10:18:04 pm
anyone?
Title: Re: Need testers
Post by: cfernandes on February 16, 2010, 10:51:16 pm
Hello ,
i have trie this on 710 but not work


this message apear "Supermassive Fail, Directory Not Created"
Title: Re: Need testers
Post by: Lexje on February 16, 2010, 11:07:27 pm
golgoj4,

I've had a quick look when you posted initially but had no time to react yet.
At first sight this can be an EXTREMELY positive addition to LMCE - Frankly I'm disappointed to see so little reaction.
After initially reading your post, I immediately headed over to TVDB.com or org only to find out their site is being overhauled or such, so I really lack information from that side. I know the forum is up, but don't know for the rest.

My main question would be re: TVDB - will it work worldwide? For German users, Belgian, Dutch, French, Spanish...?

Another question:
Can the script treat DVD collections style Stargate Atlantis S1-D1 ... S1-Dx / S2-D1.. S2-Dx etc. (you get the idea)

Erwin
Title: Re: Need testers
Post by: golgoj4 on February 17, 2010, 12:55:38 am
Hello ,
i have trie this on 710 but not work


this message apear "Supermassive Fail, Directory Not Created"


Sorry to hear that. I should have the zip updated later tonight with the proper code for 0710 or 0810.

*edit*
Checked the code and it should run. Double check permissions and make sure it can actually execute. it need to write temp files for what it downloads while working.
Title: Re: Need testers
Post by: golgoj4 on February 17, 2010, 12:58:26 am
golgoj4,

I've had a quick look when you posted initially but had no time to react yet.
At first sight this can be an EXTREMELY positive addition to LinuxMCE - Frankly I'm disappointed to see so little reaction.
After initially reading your post, I immediately headed over to TVDB.com or org only to find out their site is being overhauled or such, so I really lack information from that side. I know the forum is up, but don't know for the rest.

My main question would be re: TVDB - will it work worldwide? For German users, Belgian, Dutch, French, Spanish...?

Another question:
Can the script treat DVD collections style Stargate Atlantis S1-D1 ... S1-Dx / S2-D1.. S2-Dx etc. (you get the idea)

Erwin

It is designed to work worldwide. They support many languages. I tied it to the lmce install language, but there is a dropdown on the initial search page to change the default.

As far as dvd discs, if you could post the filenames, that would be awesome. However, in the case of you ripping the entire dvd as opposed to the individual episodes...that would require some code changes but TVDB does list dvd seasons and discs so it may be possible.
Title: Re: Need testers
Post by: Lexje on February 17, 2010, 01:06:42 am
Golgoj4,

I don't follow you:

Code: [Select]
As far as dvd discs, if you could post the filenames, that would be awesome. However, in the case of you ripping the entire dvd as opposed to the individual episodes...that would require some code changes but TVDB does list dvd seasons and discs so it may be possible.
What do you mean: post the filenames?
Should these be posted to TVDB?

The TVDB.com website says:
Code: [Select]
Welcome

Back On-Line Soon

February 10, 2010

We have taken our website off-line for a while, to conduct some much-needed maintenance, and to make some improvements to the back-end of our website.

We hope to be back on-line in a few weeks.

Thank you for your patience.

I guess I'll have to wait to find out what and how its all about :-)

Erwin
Title: Re: Need testers
Post by: golgoj4 on February 17, 2010, 01:50:40 am
Golgoj4,

I don't follow you:

Code: [Select]
As far as dvd discs, if you could post the filenames, that would be awesome. However, in the case of you ripping the entire dvd as opposed to the individual episodes...that would require some code changes but TVDB does list dvd seasons and discs so it may be possible.
What do you mean: post the filenames?
Should these be posted to TVDB?

The TVDB.com website says:
Code: [Select]
Welcome

Back On-Line Soon

February 10, 2010

We have taken our website off-line for a while, to conduct some much-needed maintenance, and to make some improvements to the back-end of our website.

We hope to be back on-line in a few weeks.

Thank you for your patience.

I guess I'll have to wait to find out what and how its all about :-)

Erwin

1. What country are you in? Possy said the same thing, yet whenever i go there i dont see the message. Ill have to ask their admins about that.

2. As far as the dvd's what I meant was are you ripping the dvd's? for example most shows have 4 or 5 discs for the season. So are you asking if we can get metadata for those 4 or 5 dvd's? Or are you ripping them from dvd to indvidual files like 'weeds-season1episode1' ?

For the iso's it possible to attatch metadata to them by disc. It would require some adjustments but possible more than likely.

hth
golgoh4
Title: Re: Need testers
Post by: Lexje on February 17, 2010, 09:47:01 am
Golgoj4,

I'm in Belgium, hence my reaction about Germany amongst others. Over here we are off course aware of this... We also have no Schedules direct, which is a pity...

The disc scenario:
Most of the time that would be ripping DVD1 & 2 & n, yes
One of the disadvantages, even if you have proper metadata, is usually you only have ONE DVD sleeve or jacket.
I guess it would be a really 'handy' feature just to be able to stamp '1' '2' etc right on top of this sleeve jpeg or whatever. I know that some people scan the disc image and use that as JPG or PNG, but I'm not very fond of this method. It's really tedious to get them properly straightened out, and mostly hard to read, since it will end up pretty small, so I'd prefer a plain simple number.

I have the same analogous idea with music - say you rip a triple CD , with something like 50 or 60 songs. They will all carry the same image...

As far as iso is concerned:
Are you suggesting we could embed the metadata (ID3 if you like) into the iso?
I guess that would be very nice. I would also 'wish' for this to be available as a cmd to add metadata to already existing iso files instead of re-ripping.

Be glad to (try) to help out on any of these :-)

Erwin
Title: Re: Need testers
Post by: cfernandes on February 17, 2010, 01:03:38 pm
i have to create a directory  tvDBxml  on /var/www/pluto-admin/operations/mediaBrowser.

now search open but with this message !

Warning: preg_match() [function.preg-match]: Compilation failed: missing terminating ] for character class at offset 12 in /var/www/pluto-admin/operations/mediaBrowser/tvdbUtils.php on line 378

Warning: DOMDocument::load() [function.DOMDocument-load]: I/O warning : failed to load external entity "/var/www/pluto-admin/operations/mediaBrowser/tvDBxml/language.xml" in /var/www/pluto-admin/operations/mediaBrowser/tvdbUtils.php on line 288

Warning: Invalid argument supplied for foreach() in /var/www/pluto-admin/operations/mediaBrowser/tvdbUtils.php on line 319
Title: Re: Need testers
Post by: wombiroller on February 17, 2010, 02:46:45 pm
Hi golgoj4,

Thanks for the mod - great addition!

1. I also had to create the directory (was getting the superfail error). I'm not really sure what permissions the files should have though (chmod 774??) so maybe this is why?
2. Now that I have created the directory I can get the tool to work, but I have to manually enter the episode info (it won't guess) - otherwise I get the same error as cfernandes if left blank (cfernandes I am assuming you only get this when fields are left blank?).
3. Also the third drop-down is a blank entry for me (Amazon, IMDB, <whitespace>)

Otherwise works really well - and FAST! I wonder why IMDB and Amazon are so much slower?
Title: Re: Need testers
Post by: cfernandes on February 17, 2010, 02:57:47 pm
hi wombiroller !

i left episode blank !

to resolve de drop-down list i add add text  amazon, imdb,and tvdb  on common.lang.php
$OPTION_CHECK_AMAZON='Amazon'
$OPTION_CHECK_IMDB='IMDB'
$OPTION_CHECK_TVDB='TVDB'
$BUTTON_GET_METADATA='Check'
Title: Re: Need testers
Post by: wombiroller on February 17, 2010, 03:11:52 pm
Ahh - thanks, editing the common.lang.php was all that was needed...

Still no auto "guessed" data though of course...

Yep, I get the same issue if I leave the episode number out, though I guess ideally you'd always want one right?
Title: Re: Need testers
Post by: phenigma on February 17, 2010, 04:35:13 pm
1. What country are you in? Possy said the same thing, yet whenever i go there i dont see the message. Ill have to ask their admins about that.

Same result in Canada.

J.
Title: Re: Need testers
Post by: Lexje on February 17, 2010, 04:53:24 pm
So that you know what we see :-)
C:\Documents and Settings\erwin>nslookup
*** Can't find server name for address 192.168.80.1: Non-existent domain
*** Default servers are not available
Default Server:  UnKnown
Address:  192.168.80.1

> tvdb.com
Server:  UnKnown
Address:  192.168.80.1

Non-authoritative answer:
Name:    tvdb.com
Address:  74.52.16.138
Title: Re: Need testers
Post by: golgoj4 on February 17, 2010, 05:50:41 pm
i have to create a directory  tvDBxml  on /var/www/pluto-admin/operations/mediaBrowser.

now search open but with this message !

Warning: preg_match() [function.preg-match]: Compilation failed: missing terminating ] for character class at offset 12 in /var/www/pluto-admin/operations/mediaBrowser/tvdbUtils.php on line 378

Warning: DOMDocument::load() [function.DOMDocument-load]: I/O warning : failed to load external entity "/var/www/pluto-admin/operations/mediaBrowser/tvDBxml/language.xml" in /var/www/pluto-admin/operations/mediaBrowser/tvdbUtils.php on line 288

Warning: Invalid argument supplied for foreach() in /var/www/pluto-admin/operations/mediaBrowser/tvdbUtils.php on line 319

working on addressing that now and thank you much for taking the time to test!
Title: Re: Need testers
Post by: golgoj4 on February 17, 2010, 06:28:54 pm
also, if its possible for you gentlemen to include what filename its choking on?

as far as site access try http://thetvdb.com, not http://tvdb.com. :)

working on squashing these bugs and the next version, available later today should have batch tagging.
Title: Re: Need testers
Post by: golgoj4 on February 17, 2010, 06:34:46 pm
i have to create a directory  tvDBxml  on /var/www/pluto-admin/operations/mediaBrowser.

now search open but with this message !

Warning: preg_match() [function.preg-match]: Compilation failed: missing terminating ] for character class at offset 12 in /var/www/pluto-admin/operations/mediaBrowser/tvdbUtils.php on line 378

Warning: DOMDocument::load() [function.DOMDocument-load]: I/O warning : failed to load external entity "/var/www/pluto-admin/operations/mediaBrowser/tvDBxml/language.xml" in /var/www/pluto-admin/operations/mediaBrowser/tvdbUtils.php on line 288

Warning: Invalid argument supplied for foreach() in /var/www/pluto-admin/operations/mediaBrowser/tvdbUtils.php on line 319

could you let me know the lang your using and filename? I may not have anticipated all special chars and that may be whats messing you up.
Title: Re: Need testers
Post by: cfernandes on February 17, 2010, 07:31:36 pm
i have titles on portugues(pt_BR)  and english !
Title: Re: Need testers
Post by: golgoj4 on February 17, 2010, 10:30:25 pm
i have titles on portugues(pt_BR)  and english !

could you post a few filenames? im trying to reproduce the preg_match error but cant.
Title: Re: Need testers
Post by: wombiroller on February 18, 2010, 04:08:22 am
Hey golgoj4,

I updated to the new version, everything working fine for single searches (I am using en, based in Australia).

I have a few problems with the batch function. Selecting a folder and ticking the directory option, I leave the episode number blank but have a season name and season number. Once I run it I get this warning:
Code: [Select]
Warning: array_values() [function.array-values]: The argument should be an array in /var/www/lmce-admin/operations/mediaBrowser/tvdbUtils.php on line 213
loop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop started

It still finds the show though. When I select it it gives me the option to confirm all the episode number (which were all already correct!).

Testing on Deadwood, filenames like so: Deadwood.S03.E04.avi - Everything worked a charm, including images episode details etc...!

Testing Carnivale, Filenames like so: Carnivale_-_2x15_-_Ingram,_TX.avi had a few problems.

I get the same warning, but it still finds the show and correctly guesses all the episode numbers.

Once I run the batch I get the output and all the files have had updates. Appears that all the episode specific info is missing though. The following are all blank:
* Episode
* TV Program ID
* TV Series ID
* Synopsis
* Release Date
* No images

Thanks again - the batch function is going to be awesome!

EDIT 1: Season 2 of Deadwood had the same issues as Carnivale - the filenames are a bit different, e.g. - deadwood.210.Advances_None_Miraculous.avi

I had to manually enter the episode numbers for this one (when presented with all file names), but it didn't seem to take...

EDIT 2: White screen in batch mode
I have been tagging a few more shows, but every now and then at the Episode Information screen, after hitting Go I get a white screen with no output. I seem to be able to fix this _only_ by first selecting a single file within the folder - updating the meta data, then going back to the batch option. Does the batch script only work if there is already season information available?
Title: Re: Need testers
Post by: golgoj4 on February 18, 2010, 05:52:25 am
Hey golgoj4,

I updated to the new version, everything working fine for single searches (I am using en, based in Australia).

I have a few problems with the batch function. Selecting a folder and ticking the directory option, I leave the episode number blank but have a season name and season number. Once I run it I get this warning:
Code: [Select]
Warning: array_values() [function.array-values]: The argument should be an array in /var/www/lmce-admin/operations/mediaBrowser/tvdbUtils.php on line 213
loop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop started

It still finds the show though. When I select it it gives me the option to confirm all the episode number (which were all already correct!).

Testing on Deadwood, filenames like so: Deadwood.S03.E04.avi - Everything worked a charm, including images episode details etc...!

Testing Carnivale, Filenames like so: Carnivale_-_2x15_-_Ingram,_TX.avi had a few problems.

I get the same warning, but it still finds the show and correctly guesses all the episode numbers.

Once I run the batch I get the output and all the files have had updates. Appears that all the episode specific info is missing though. The following are all blank:
* Episode
* TV Program ID
* TV Series ID
* Synopsis
* Release Date
* No images

Thanks again - the batch function is going to be awesome!

EDIT 1: Season 2 of Deadwood had the same issues as Carnivale - the filenames are a bit different, e.g. - deadwood.210.Advances_None_Miraculous.avi

I had to manually enter the episode numbers for this one (when presented with all file names), but it didn't seem to take...

EDIT 2: White screen in batch mode
I have been tagging a few more shows, but every now and then at the Episode Information screen, after hitting Go I get a white screen with no output. I seem to be able to fix this _only_ by first selecting a single file within the folder - updating the meta data, then going back to the batch option. Does the batch script only work if there is already season information available?

Thanks for the feedback!
addressing the first issues
This is an actual bug. Only occurs in batch mode, but doesnt really impact it finding anything it wouldnt have already. working on squashing,
Code: [Select]
Warning: array_values() [function.array-values]: The argument should be an array in /var/www/lmce-admin/operations/mediaBrowser/tvdbUtils.php on line 213
this is debug output i forgot to delete (i.e. i fail)
Code: [Select]
loop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop started
Its good to hear that batch mode is working on some directories. It appears I may need to update my filename parsing to catch that config or allow people to enter what their sample filename is as a base...i need to figure that one out. Im more than happy to try, and that update (to catch stuff like -_2x15_- same with deadwood with the digit digit digit arrangment) should be easy but I'd like to come up with a method that a little more reliable than permutations i can think of.

As far as manually entering the season and ep info on the batch page, that is in fact a bug i need to squash and will be looking into immediately. I suspect that the white screen problem is related to it.

Thanks a ton for the feedback. really helps in seeing whats going wrong

Hopefully should have an update tomorrow, though i do have a question for anyone else reading this thread.

if ive got say, stargatatlantis 0206 blabla.avi

shouldnt a pregmatch like
Code: [Select]
"/ (?<=\s[0])\d /"    work to grab the 2 out of that string?

Title: Re: Need testers
Post by: wombiroller on February 18, 2010, 06:34:56 am
Yeah - being able to enter that info (at the Batch screen) and re-download the info would help a lot. Having said that renaming the files isn't the end of the world, especially if they are a bit messy already.

Also - if you are after feature requests I might have some  ;)


1. Ability to specify or modify the Genre
Having succinct Genres is, as I am sure you can attest to, a must. Seems that IMDB, TVDB and all the rest seem to use different iterations of the same Genres. E.g. Sci-Fi or Science Fiction, Action or Action and Adventure... etc. As the orbiters only allow 14 Genres to be visible, I tend not to use some, or combine others. The ability to set these in the batch, or at least _not_ include some found on TVDB would be a great help (to me at least)
2. Ability to set File format: especially in batches (seems a pity to have to go back in to the individual files to set this - maybe an optional dropdown that populates all files in the dir?)

Not sure about the pregmatch sorry.

EDIT: FYI, the White screen issue doesn't seem to be related to file naming issues. I am pretty sure it will happen only when a show doesn't already exist in the DB....
Title: Re: Need testers
Post by: maverick0815 on February 18, 2010, 05:40:24 pm
Wow, this is cool- hats off!
I am using english as language. I had to set file permissions to execute and create tvDBxml  on /var/www/pluto-admin/operations/mediaBrowser
Other than that, its working nicely. I do get some warnings when doing a batch. I also get the same errors as above, if the show name is left blank.
------------------------------
update: it seems it worked only once in batchmode
now I get one warning:
Quote
Warning: array_values() [function.array-values]: The argument should be an array in /var/www/lmce-admin/operations/mediaBrowser/tvdbUtils.php on line 213
loop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop started
it shows the correct show and episodes, but after confirming it just generates a blank page and there are no entries.
Title: Re: Need testers
Post by: golgoj4 on February 18, 2010, 07:17:40 pm
Wow, this is cool- hats off!
I am using english as language. I had to set file permissions to execute and create tvDBxml  on /var/www/pluto-admin/operations/mediaBrowser
Other than that, its working nicely. I do get some warnings when doing a batch. I also get the same errors as above, if the show name is left blank.
------------------------------
update: it seems it worked only once in batchmode
now I get one warning:
Quote
Warning: array_values() [function.array-values]: The argument should be an array in /var/www/lmce-admin/operations/mediaBrowser/tvdbUtils.php on line 213
loop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop started
it shows the correct show and episodes, but after confirming it just generates a blank page and there are no entries.

Thanks for taking the time to test!
If you could, please provide me:
Directory Name:
sample filenames from directory.

Have not figured out what the random white page is, but working on it.

also, part of that output is debug info i forgot to remove as this is still in testing.

Thanks!
Title: Re: Need testers
Post by: maverick0815 on February 18, 2010, 07:54:26 pm
no problem:
filename: Star.Trek.TNG.S01E01.Encounter.At.Farpoint.(Part.1.&.2).avi
location: /home/public/data/videos/Hitachi_HDT72101 (sdb6)-CORE [29]/TV-Shows/Star Trek The Next Generation/Season1
Title: Re: Need testers
Post by: golgoj4 on February 19, 2010, 12:12:59 am
no problem:
filename: Star.Trek.TNG.S01E01.Encounter.At.Farpoint.(Part.1.&.2).avi
location: /home/public/data/videos/Hitachi_HDT72101 (sdb6)-CORE [29]/TV-Shows/Star Trek The Next Generation/Season1

thanks, updated the zip today, hopefully it fixes the white screen of death
Title: Re: Need testers
Post by: wombiroller on February 19, 2010, 02:06:21 am
Warning: array_values() [function.array-values]: The argument should be an array in /var/www/lmce-admin/operations/mediaBrowser/tvdbUtils.php on line 213
loop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop startedloop started
it shows the correct show and episodes, but after confirming it just generates a blank page and there are no entries.

maverick0815 - I get this as well however I can fix it by adding a single file from the same series / folder via the TVDB script first - then going back to the batch. Does this work for you?
Title: Re: Need testers - updated 2-18
Post by: maverick0815 on February 19, 2010, 04:11:43 pm
Great work :-)
If I leave the manual entry blank, I get a warning and no results, if I enter the name of the show, it proceeds nicely in batch mode
I get a warning per file:
Warning: array_values() [function.array-values]: The argument should be an array in /var/www/lmce-admin/operations/mediaBrowser/tvdbUtils.php on line 213

The only other thing I've noticed is the Episodes don't get tagged as TV-Shows, so thats something I will still have to do manually, but all the rest is working
Very good job, my friend.
As a minor suggestion- why don't you create a zip with the files already in the proper filestructure, so anyone trying this out just has to unzip the whole thing to /var.
Title: Re: Need testers - updated 2-18
Post by: golgoj4 on February 19, 2010, 06:51:39 pm
Great work :-)
If I leave the manual entry blank, I get a warning and no results, if I enter the name of the show, it proceeds nicely in batch mode
I get a warning per file:
Warning: array_values() [function.array-values]: The argument should be an array in /var/www/lmce-admin/operations/mediaBrowser/tvdbUtils.php on line 213

The only other thing I've noticed is the Episodes don't get tagged as TV-Shows, so thats something I will still have to do manually, but all the rest is working
Very good job, my friend.
As a minor suggestion- why don't you create a zip with the files already in the proper filestructure, so anyone trying this out just has to unzip the whole thing to /var.

Thanks for the suggestions!

1. The 1st part is working as intended. Basically if it doesn't detect a search term chosen by checkbox AND the manual show entry box is empty, it will just go back to the initial search page

2. Them not being tagged as tv shows is a minor bug that i need to fix. I think code to make that little update got commented out whilst looking for other bugs

4. That array values bug is still eluding me...but it will be squashed :)

3. Great idea about the zip, didnt know you could do that. Thats going to be how I do it from here on out to cut down on the pain. I was thinking about it last night and I had settled on figuring out a shell script, but that sounds nicer.

4. Thanks for the help testing, let me know if you have anymore issues. My next steps are to:
-Make it less ugly
-Have it insert performer and director images
-insert other data including dvd disc & imdb,

5. wombiroller was in irc last night and came across an interesting issue. As he added more metadata, it slowed down the response on his orbiters on the default search. I believe he was able to tweak his mysql settings with assistance...Ill see about getting a link to the documentation.
Title: Re: Need testers - updated 2-18
Post by: MANDINGO on February 19, 2010, 08:54:03 pm
 ;D

As soon as im done with a couple more tests ill post the info and an optimized file for mysql for your testers to test ill keep you posted but so far very good results on speed issues

Thanks

Mandingo
Title: Re: Need testers - updated 2-18
Post by: maverick0815 on February 19, 2010, 10:09:46 pm
I tagged some tv-shows and I noticed something. There are two episode tags - one for the episode number, one for the episode title. Usually the episode number comes first, sometimes however its the episode title thats first. In such a case only the episode number appears in my orbiters.
Interestingly..I have another question- how do you usually select your tv-show and episode? Normally the orbiter uses Title as sort-order and up until now that is how I used it. I was checking in my orbiter and at first I was a bit confused, because all the episodes of my tv-shows were jumbled...until I changed the sort-order to filename.
Maybe its just me, but being able to have them sorted by season then by episode wouldn't be a bad idea...
Title: Re: Need testers - updated 2-18
Post by: phenigma on February 19, 2010, 10:23:04 pm
As soon as im done with a couple more tests ill post the info and an optimized file for mysql for your testers to test ill keep you posted but so far very good results on speed issues

I've been looking at/working on some mysql optimizations along with indexes, there had been discussion and some indexes added to the database back in november but current installs do not seem to be implementing the indexes.  I've also looked at query_cache increases and have achieved some significant speed-up on my queries.  I'm hoping to get the indexes reinstated and a few other tweaks put in at the same time.  I have had a look at what you were doing last nite on IRC and it looks good, some of it is very similar to the steps I have taken.  I'll have a look at the optimizations you release here and see how the align with what I've found as well.  I'm off for a week in a week so I'm hoping to dedicate that time to implementing my updates on a dev system to submit a patch for what I've got for mysql at that time, perhaps these updates could go together.

J.
Title: Re: Need testers - updated 2-18
Post by: golgoj4 on February 20, 2010, 04:22:38 am
I tagged some tv-shows and I noticed something. There are two episode tags - one for the episode number, one for the episode title. Usually the episode number comes first, sometimes however its the episode title thats first. In such a case only the episode number appears in my orbiters.
Interestingly..I have another question- how do you usually select your tv-show and episode? Normally the orbiter uses Title as sort-order and up until now that is how I used it. I was checking in my orbiter and at first I was a bit confused, because all the episodes of my tv-shows were jumbled...until I changed the sort-order to filename.
Maybe its just me, but being able to have them sorted by season then by episode wouldn't be a bad idea...

interesting...question is, how should those fields be mapped?
im going to look into this and think about it. I also need to see what the orbiter behavior is, but i have a lot of attribute deletion to do as the testing has my database screwed 6ways from sunday.
Title: Re: Need testers - updated 2-18
Post by: cfernandes on February 20, 2010, 07:19:41 pm
i download the update !

but some error o search

Warning: DOMDocument::load() [function.DOMDocument-load]: I/O warning : failed to load external entity "/var/www/pluto-admin/operations/mediaBrowser/tvDBxml/language.xml" in /var/www/pluto-admin/operations/mediaBrowser/tvdbUtils.php on line 303

Warning: Invalid argument supplied for foreach() in /var/www/pluto-admin/operations/mediaBrowser/tvdbUtils.php on line 334

i search for brothers.avi

if i search for naruto !

work like a charm  !


Title: Re: Need testers - updated 2-18
Post by: golgoj4 on February 20, 2010, 08:03:22 pm
i download the update !

but some error o search

Warning: DOMDocument::load() [function.DOMDocument-load]: I/O warning : failed to load external entity "/var/www/pluto-admin/operations/mediaBrowser/tvDBxml/language.xml" in /var/www/pluto-admin/operations/mediaBrowser/tvdbUtils.php on line 303

Warning: Invalid argument supplied for foreach() in /var/www/pluto-admin/operations/mediaBrowser/tvdbUtils.php on line 334

i search for brothers.avi

if i search for naruto !

work like a charm  !




Question: Are you manually entering the filename?

Another question: What are the filenames exactly? Naruto.avi? or something like Naruto.s1.e2.avi?

Another Question: what language are you using?

Reason I ask is because its supposed reset itself on a search error. And the language issue is interesting as well...because it only checks the lang file when it initially starts in order to populate the languages from thetvdb.com and uses what ever is chosen as it runs until it references the lang file it needs. So that its looking for the lang file after you search when that should happen before is a little confusing.


So if i chose 'da' as my language, its going to use that as a reference from there on out without rechecking that original lang file.

as screen shot of any errors would be priceless :)
i could see where you are in the process, what mode (single or batch) ,  and anything else relevant. crop if needed but ill need a few more specifics really try and trouble shoot your issue. But i am happy and willing (love this learning process) to help :)
Title: Re: Need testers - updated 2-18
Post by: cfernandes on February 20, 2010, 08:30:33 pm
i not input name manualy !
i use english language

i tried files as naruto.avi
brother.avi

Beegees - Onenightonly (Live From Las Vegas).avi
Title: Re: Need testers - updated 2-18
Post by: maverick0815 on February 20, 2010, 11:46:51 pm
I am mostly using batch-mode. aside from the things I reported earlier, its working nicely. I see also that the number of warnings about line 213 has decreased to one only.
Title: Re: Need testers - updated 2-18
Post by: golgoj4 on February 21, 2010, 02:16:59 am
i not input name manualy !
i use english language

i tried files as naruto.avi
brother.avi

Beegees - Onenightonly (Live From Las Vegas).avi

Ill need to look at the code and see whats going on. It seems its not able to load the files for some reason.

Im currently working to include specials, which may have some musical performances but im not sure if they are listed on thetvdb.com
Title: Re: Need testers - updated 2-18
Post by: maverick0815 on February 21, 2010, 12:51:47 pm
Tried out your latest version...looks pretty nice.
Batchmode is also greatly improved.
I get one warning:
Quote
Warning: array_values() [function.array-values]: The argument should be an array in /var/www/lmce-admin/operations/mediaBrowser/tvdbUtils.php on line 222
All in all I am quite happy with what you did. So when this is finished it could replace the Module for applying tags recursively- which isn't working anyways
However the overall handling of TV-shows is still not quite right. It works greatly when you sort after filename, then you wouldn't need to go to all the trouble of tagging the files and just need some coverart. Anyways, I don't know the underlying requirements, so I don't know if there is anything you can do about it or if this is something that needs to be handled by the orbiter. Right now the sort order in which the orbiter shows it is : Title of the show, Title of the Episode, Episode Number
The Season of the Show is not being used obviously. I saw however that the results from tvdb puts the Season as Release Date
So, in my mind the correct order would be: Title of the show, Season( aka Release Date) Episode Number (not necessarily be shown), Title of the Episode.
Title: Re: Need testers - updated 2-18
Post by: golgoj4 on February 26, 2010, 04:24:45 am
added an update on 2-25 to support tv specials and deal with some bugs. the whole directory and file permissions business should be done away with now.

-golgoj4
Title: Re: Need testers - updated 2-18
Post by: maverick0815 on February 27, 2010, 08:46:52 pm
I just installed your latest version.
I don't know if thetvdb has some issues or if its your scripts, but there are no pictures being downloaded...only blanks
Title: Re: Need testers - updated 2-18
Post by: golgoj4 on March 04, 2010, 09:17:48 pm
I just installed your latest version.
I don't know if thetvdb has some issues or if its your scripts, but there are no pictures being downloaded...only blanks

just updated...feel free to take a go :)
Title: Re: Need testers - updated 2-18
Post by: maverick0815 on March 07, 2010, 03:55:12 pm
I'm sorry, but the images still don't get pulled.
So far it seems the link to the images is always this only: http://www.thetvdb.com/banners/_cache/
Title: Re: Need testers - updated 2-18
Post by: Robert_M on March 08, 2010, 05:06:56 pm
Had a quick play:-

1) None of the pictures load for individual episodes.  Path for pictures is http://www.thetvdb.com/banners/_cache/

2) When I try and do a batch mode directory for "3rd Rock From The Sun" suggests show name is either "3rd rock from the" or "3rd".  When I do a batch mode directory for "Simpsons" suggests "simp".  It seems to be cutting off the last four characters (I assume it's removing an extension that isn't there). 

3) When doing batch mode, it doesn't cope very well with multiple copies of the same episode in the directory.  It correctly identifes "3rd Rock From The Sun - 4x20 - Alien Hunter.avi" as being season 4, ep 20 when selected in single file mode.  If doing batch on a directory with "3rd Rock From The Sun - 4x20 - Alien Hunter.avi" and ""3rd Rock From The Sun - 4x20.avi" however it states there are other files in the directory that it can't identify the season number of. 

3) If I search in single file mode for "Bananaman S1e1 - Bananaman Meets Dr Gloom.avi" it suggests as the first three show names "bananaman s1e1" (you should probably eliminate duplicates from the suggested show name list) and the last two as "bananaman".  It correctly identifies that it's season 1, episode 1 however.  Also, surely the top guessed show name should therefore be "bananaman" not "bananaman s1e1"
Title: Re: Need testers - updated 2-18
Post by: golgoj4 on March 08, 2010, 08:00:16 pm
Had a quick play:-

1) None of the pictures load for individual episodes.  Path for pictures is http://www.thetvdb.com/banners/_cache/

2) When I try and do a batch mode directory for "3rd Rock From The Sun" suggests show name is either "3rd rock from the" or "3rd".  When I do a batch mode directory for "Simpsons" suggests "simp".  It seems to be cutting off the last four characters (I assume it's removing an extension that isn't there). 

3) When doing batch mode, it doesn't cope very well with multiple copies of the same episode in the directory.  It correctly identifes "3rd Rock From The Sun - 4x20 - Alien Hunter.avi" as being season 4, ep 20 when selected in single file mode.  If doing batch on a directory with "3rd Rock From The Sun - 4x20 - Alien Hunter.avi" and ""3rd Rock From The Sun - 4x20.avi" however it states there are other files in the directory that it can't identify the season number of. 

3) If I search in single file mode for "Bananaman S1e1 - Bananaman Meets Dr Gloom.avi" it suggests as the first three show names "bananaman s1e1" (you should probably eliminate duplicates from the suggested show name list) and the last two as "bananaman".  It correctly identifies that it's season 1, episode 1 however.  Also, surely the top guessed show name should therefore be "bananaman" not "bananaman s1e1"


Updated today, tracked down a bug which was putting data files in the wrong place. This should end the problem of missing images and the like. Ill be in and out of the irc channel so you can more than likely find me there if you are still having problems.

In relation to the guessing of the show names:

I intentionally left it providing that many choices as the wide range of file name possibilities makes it a bit difficult to parse every possible title. You are correct that I could remove some of the duplicates that manage to make it into the list, but doing that initially led to many cases of nothing showing up. Ive been trying to wrap my head around a better way to extract the show name, but have not come up with anything yet

Episodes and seasons:
A bit easier to parse but once again the patterns only go as far as my imagination. If you could show me the filenames of what it having problems identifying?

Also, if you enter the season / ep into the box in batch mode, it will take that as the proper information when you click go.

And thanks for taking the time so far to report back :)

Title: Re: Need testers - updated 2-18
Post by: Robert_M on March 11, 2010, 11:03:09 am
I have actually done something similar to what you're doing (I have a ruby script that automatically renames episodes downloaded to be in the same format). 

The way I did it was first I grab the series and episode marker from the episode.  If you did that and then assumed that everything that came before was the series that should work for a very high percentile of files (I don't think I've ever encountered anything it doesn't work for).  The only problematic files are the ones which use three digits to represent series and episode (I just wrote a special function called seperate to do this) and the ones that don't split into series and episode just use numbering.  With a bit of tweaking you should be able to deal with these cases as well (or at least have a reasonable guess).  I used the following regex's to rename the file - I think the ones at the bottom are just putting in uniform spacing but I didn't comment them so not so sure.... 

Code: [Select]
    filename = filename.gsub(/ S([0-9][0-9])E([0-9][0-9][ \.])/i, " \\1x\\2")
    filename = filename.gsub(/ S([0-9][0-9]) E([0-9][0-9][ \.])/i, " \\1x\\2")
    filename = filename.gsub(/ S([0-9])E([0-9][0-9][ \.])/i, " \\1x\\2")
    # Examples: 'S3E04' = '3x04', 'S07E05' = '7x05', 'S07E03-' = '7x03'

    filename = filename.gsub(/([\- ][0-9])x([0-9][\- \.])/i, "\\1x0\\2")
    # Examples: '3x4-' = '3x04', '6x8 ' = '6x08'


    filename = filename.gsub(/0([0-9]x[0-9][0-9])/i, "\\1")
    # Examples: '03x12' = '3x12', '01x03' = '1x03'

    filename = filename.gsub(/\s*\[([1-9]?[0-9]x[0-9][0-9])\]\s*/i, " \\1 ")
    # Examples: '  [14x34]  ' = ' 14x34 ' 'Stargate[10x23] ' = 'Stargate 10x23 '


    filename = filename.gsub(/([A-Z0-9])\s+([1-9]?[0-9]x[0-9][0-9])/i, "\\1 - \\2")

    filename = filename.gsub(/([1-9]?[0-9]x[0-9][0-9])\s+([A-Z0-9])/i, "\\1 - \\2")

    filename = filename.gsub(/\s*-\s*([1-9]?[0-9]x[0-9][0-9])/i, " - \\1")
    filename = filename.gsub(/([1-9]?[0-9]x[0-9][0-9])\s*-\s*/i, "\\1 - ")



Title: Re: Need testers - updated 2-18
Post by: SilkBC on March 24, 2010, 07:27:04 am
Perhaps you could have flags for certain key parts of a file name and allow users to specify how they are out together, much like a lot of music library/ripper programs out there, like Amarok.  So you could specify tags such as:

Series = %series
Season Number = %season
Episode Number = %episode
Episode Title = %title

So, taking Star Trek: TNG, episode 1, season 1, "Encounter At Far Point", as an example, one one could specify:

%series.%season.%episode.%title.avi = star trek: tng.01.01.encounter at far point.avi

or

%series_-_s%seasone%episode_-_%title.avi = %starttrek_tng_-_s01e01_-_encounter_at_far_point.avi

and so on, so the combinations would become only limited by people's imaginations for naming them.

With MythTV 0.22 now updated into LinuxMCE, I believe it it has its own scripts for grabbing data from <themoviedb.org> and <thetvdb.org> now, doesn't it?  Though if I understand correctly, this one integrates into Mythweb, so that's a good thing.

Just a couple thoughts.

-SilkBC
Title: Re: Need testers - updated 2-18
Post by: golgoj4 on April 05, 2010, 07:38:41 pm
Ok, so id love to put in a trac ticket and get this in so,

If in your responses, you could list bugs, but not necessarily improvements or new features so i can see what needs to be fixed for functionality and what should be added to make it more versatile.

Thanks, and I have not abandonded this, just been trying to beat c++ and Qt concepts into my head for the last few weeks.

Cheers
Golgoj4
Title: Re: Need testers - updated 2-18
Post by: wombiroller on April 10, 2010, 06:11:59 am
Hi golgoj4,

Tested latest (after reinstalled 0810 beta - using en).

Only problem I seem to have is the Media sub-type: doesn't get set.

Example: Series - Rome, filename - S01xE01. THE STOLEN EAGLE.avi

All other attributes set correctly...

EDIT: As discussed in IRC - I think this happens because the Media sub-type gets dropped it the File Format isn't set (happens to me on all media).

I know you don't want nor need feature requests but maybe an option to let the user select which file format should be applied...then batch them all to prevent the Media sub-type from getting dropped...

Thanks again :-)

Cheers,
WR.
Title: Re: Need testers - updated 2-18
Post by: wombiroller on April 11, 2010, 01:35:36 pm
odd - today I can't get this to work at all. error on single file attampts:
Code: [Select]
Warning: file_get_contents(http://www.thetvdb.com/api/GetSeries.php?seriesname=boston legal ) [function.file-get-contents]: failed to open stream: HTTP request failed! <html>  in /var/www/lmce-admin/operations/mediaBrowser/searchTVDB.php on line 35
error on directory attempts:
Code: [Select]
Warning: file_get_contents(http://www.thetvdb.com/api/GetSeries.php?seriesname=boston legal) [function.file-get-contents]: failed to open stream: HTTP request failed! <html>  in /var/www/lmce-admin/operations/mediaBrowser/searchTVDB.php on line 119
I tried re-adding the 0810 files just in case something went wrong but no change... Any ideas?
Title: Re: Need testers - updated 2-18
Post by: golgoj4 on April 12, 2010, 02:57:10 am
odd - today I can't get this to work at all. error on single file attampts:
Code: [Select]
Warning: file_get_contents(http://www.thetvdb.com/api/GetSeries.php?seriesname=boston legal ) [function.file-get-contents]: failed to open stream: HTTP request failed! <html>  in /var/www/lmce-admin/operations/mediaBrowser/searchTVDB.php on line 35
error on directory attempts:
Code: [Select]
Warning: file_get_contents(http://www.thetvdb.com/api/GetSeries.php?seriesname=boston legal) [function.file-get-contents]: failed to open stream: HTTP request failed! <html>  in /var/www/lmce-admin/operations/mediaBrowser/searchTVDB.php on line 119
I tried re-adding the 0810 files just in case something went wrong but no change... Any ideas?


I believe thetvdb changed something in their api. this was brought to my attention a few days ago and the fix should be added later today along with support for setting the resolution.

Images for performers is a different story and im looking into creating a 'character' attribute or something to uniquely link them..any ways, ill post when its been upped.
Title: Re: Need testers - updated 2-18
Post by: golgoj4 on April 12, 2010, 10:16:26 am
upped :)
-can now set the file quality options
-updated api interface
-i am very sleepy

Also, you may notice actor images in single file mode. Im testing adding them to the db in some fashion but in the mean time i left it in, but they dont get added yet.

-golgoj4
Title: Re: Need testers - updated 2-18
Post by: wombiroller on April 12, 2010, 02:33:24 pm
upped :)
-can now set the file quality options
-updated api interface
-i am very sleepy

Also, you may notice actor images in single file mode. Im testing adding them to the db in some fashion but in the mean time i left it in, but they dont get added yet.

-golgoj4
golgoj4 - awesome stuff.

Patch works for both directory and single.

The new batch option to set the file format also works. Tested override, single file and directory with different options selected. All good! Makes a big difference IMO.

The Media sub-type (TV Shows) also seem to be sticking now...

Kudos!

WR.

EDIT: The single file actor images are pretty neat. Wonder how that could be used. I guess something like adding pics near performer names (in view attributes within the UI) would probably be overkill. Still looks cool in the web admin ;)
Title: Re: Need testers - updated 2-18
Post by: golgoj4 on April 12, 2010, 07:01:13 pm
upped :)
-can now set the file quality options
-updated api interface
-i am very sleepy

Also, you may notice actor images in single file mode. Im testing adding them to the db in some fashion but in the mean time i left it in, but they dont get added yet.

-golgoj4
golgoj4 - awesome stuff.

Patch works for both directory and single.

The new batch option to set the file format also works. Tested override, single file and directory with different options selected. All good! Makes a big difference IMO.

The Media sub-type (TV Shows) also seem to be sticking now...

Kudos!

WR.

EDIT: The single file actor images are pretty neat. Wonder how that could be used. I guess something like adding pics near performer names (in view attributes within the UI) would probably be overkill. Still looks cool in the web admin ;)


yeah im currently contemplating the best way to make use of the information.
Some things ive noticed:
-If you tag an episode, all of the performers in that episode will get the episode screen shot.
-Everytime you run the tvdb script, it would add another (the same) actor image. So i need a method of making them unique
-You have to delete the existing screenshot to get the proper one to show.  Note, deleting the screenie associated with the actor doesnt remove the on for the episode, just its association to that performer.

so with all of that in mind, im pondering how important the images are. Does anyone even use 'performer' as a filter. I would like to provide as much data as possible, but i just need to work out a decent method to add it and make it usefull.
Title: Re: Need testers - updated 4-14
Post by: wombiroller on May 15, 2010, 10:28:33 am
Images broken again  ???

Assuming TVDB have gone and changed their API again?
Title: Re: Need testers - updated 4-14
Post by: golgoj4 on May 15, 2010, 04:40:53 pm
Images broken again  ???

Assuming TVDB have gone and changed their API again?

urgh...yes. and no email notification :X. Just tested it and it still get the image if you complete it, but ill need to update the code. Ill post back when its done.
Title: Re: Need testers - updated 4-14
Post by: golgoj4 on May 22, 2010, 07:28:35 pm
ok so after some research on the site, turns out i was doing it wrong  ;D They dont allow the way I was serving the images. Im supposed to dl all of them and serve them locally. This is a lot of data...so im more than likely going to 86 the images so people arent downloading a bunch of stuff which may or may not be used. We'll see. In the meantime, it will work sans images but i still will grab the episode image because I used a different method to grab that one.

ill update it as i figure out how i want to handle it. I would prefer to use the images it downloads but i dont want to download useless info and waste bandwidth.

golgoj4
Title: Re: Need testers - updated 4-14
Post by: maverick0815 on June 19, 2010, 05:28:28 pm
I'm just curious...have you found a way to get it working again?
Title: Re: Need testers - updated 4-14
Post by: golgoj4 on June 21, 2010, 06:10:10 pm
I'm just curious...have you found a way to get it working again?

I have, its just a matter of doing it in the least sloppy way possible. Been working on it, but recently got a production job so trying to code while im supposed to be recording sound has been difficult.

Soon though...my main hang up atm is handling temporary storage of the images.

-golgoj4
Title: Re: Need testers - updated 4-14
Post by: RayBe on August 28, 2010, 09:40:52 am
hi golgoj4,
great work, this is the tool i been looking for!
are there any updates of the project?
when do u expect to get this in the latest snapshot?

br,
Raymond
Title: Re: Need testers - updated 4-14
Post by: golgoj4 on August 28, 2010, 07:24:37 pm
hi golgoj4,
great work, this is the tool i been looking for!
are there any updates of the project?
when do u expect to get this in the latest snapshot?

br,
Raymond

its in the svn being debugged atm. :)

golgoj4
Title: Re: Need testers - updated 4-14
Post by: RayBe on August 28, 2010, 10:32:47 pm
cool, super news,
thanks

br,
Raymond
Title: Re: Need testers - updated 4-14
Post by: maverick0815 on September 02, 2010, 06:45:36 pm
Its nice to see you made good progress, however I have some bugs to report:
Quote
Warning: fopen(operations/mediaBrowser/images/searchImg73893.jpg) [function.fopen]: failed to open stream: Permission denied in /var/www/lmce-admin/operations/mediaBrowser/searchTVDB.php on line 200

Warning: fwrite(): supplied argument is not a valid stream resource in /var/www/lmce-admin/operations/mediaBrowser/searchTVDB.php on line 201

Warning: fclose(): supplied argument is not a valid stream resource in /var/www/lmce-admin/operations/mediaBrowser/searchTVDB.php on line 202
Also there are no images displayed in the preview, but they get downloaded and integrated.
Title: Re: Need testers - updated 4-14
Post by: maverick0815 on September 17, 2010, 08:02:03 pm
Batchmode doesn't really work...mostly the images are missing. When I start one directory to be processed, the right frame gets loaded twice.
Title: Re: Need testers - updated 4-14
Post by: coley on September 30, 2010, 12:37:24 pm
I'm seeing similar errors to maverick0815 with the images.
Has anything changed again with TVDB? I noticed back in this thread images caused an issue before.
I don't see the files in svn - are the latest ones on a trac ticket? or is the zip file the latest?
am happy to debug stuff if required.

-Coley.
Title: Re: Need testers - updated 4-14
Post by: coley on September 30, 2010, 04:59:42 pm
Had a look under the hood, and the images are being downloaded to an images directory in the workings of the admin website, hence wrong create permissions. Would it not be better to move this out from under here? and possibly put it with '/home/coverartscan' at least this dir has the correct permissions.

-Coley.
Title: Re: Need testers - updated 4-14
Post by: golgoj4 on September 30, 2010, 06:15:54 pm
Had a look under the hood, and the images are being downloaded to an images directory in the workings of the admin website, hence wrong create permissions. Would it not be better to move this out from under here? and possibly put it with '/home/coverartscan' at least this dir has the correct permissions.

-Coley.

thats actually a good idea and has been a suggestion put forward to solve this little hiccup.

Really guys, i have been trying to clean this up but between having to reinstall linuxmce because i hosed my install trying to do some work, then my core melting down, and getting finding time on my days off has been a bear to say the least. Also, i realized that i did my initial development incorrectly which is what the problem with the images is at the moment. on my machine I stupidly made the directory in question writeable, which led to others who tested it having problems.

As soon as i get my web dev environment setup properly, I will knock this out. Currently trying to install eclipse on my core so can get back to it because yes, i still need an IDE to get stuff done. Feel free to take a crack at it, but i have some time off atm so im going to try and finish it up because there are lots more things i need to get to.

-golgoj4
Title: Re: Need testers - updated 4-14
Post by: golgoj4 on September 30, 2010, 11:57:32 pm
thanks to merkur2k, i got things setup as needed

will post latest revision later once i roll through more files to test it myself. Still cant figure out why the double frame is being called however...

-golgoj4
Title: Re: Need testers - updated 4-14
Post by: golgoj4 on October 01, 2010, 11:06:54 pm
New zip, please use the link on page one and let me know of any errors. thanks!

-golgoj4
Title: Re: Need testers - updated 10-1
Post by: coley on October 02, 2010, 12:31:11 am
ok will chk it out.
Whats changed? is it just image location or have there been other changes?

-Coley.
Title: Re: Need testers - updated 10-1
Post by: golgoj4 on October 02, 2010, 01:56:43 am
ok will chk it out.
Whats changed? is it just image location or have there been other changes?

-Coley.

Actually i took your advice and used /coverartscan which worked great. Also, after staring @ loops for what seemed like forever I found the one that was causing the double frame. Some slight formatting and thats about it.
Title: Re: Need testers - updated 10-1
Post by: coley on October 02, 2010, 02:48:25 am
so far so good, images working.
-Coley.
Title: Re: Need testers - updated 10-1
Post by: golgoj4 on October 04, 2010, 06:05:31 pm
anyone else? any problems?
Title: Re: Need testers - updated 10-1
Post by: maverick0815 on October 04, 2010, 08:29:25 pm
the guesses don't work with me, but apart from that, its all peachy :-) Good job, buddy.
Title: Re: Need testers - updated 10-1
Post by: golgoj4 on October 04, 2010, 08:37:25 pm
the guesses don't work with me, but apart from that, its all peachy :-) Good job, buddy.

can you provide a few filenames? i want to try and improve the regex's a bit. Im currently trying to write a c++ based version that does this automatically.

-golgoj4.
Title: Re: Need testers - updated 10-1
Post by: maverick0815 on October 15, 2010, 05:47:04 pm
Sorry for the delay...I had a little less time at my hands for a while, but here you got some filenames:
Star.Trek.Enterprise.2x02.Carbon.Creek.avi
Paradox.1x01.avi
Two.And.A.Half.Men.2x03.A.Bag.Full.Of.Jawea.avi

just a few examples.
Title: Re: Need testers - updated 10-1
Post by: golgoj4 on October 15, 2010, 06:33:02 pm
Sorry for the delay...I had a little less time at my hands for a while, but here you got some filenames:
Star.Trek.Enterprise.2x02.Carbon.Creek.avi
Paradox.1x01.avi
Two.And.A.Half.Men.2x03.A.Bag.Full.Of.Jawea.avi

just a few examples.

cool thanks!
im posting my progress here http://wiki.linuxmce.org/index.php/MetaData_Handling#Automatic_File_tagging
Title: Re: Need testers - updated 10-1
Post by: jthodges on October 15, 2010, 10:24:29 pm
cool thanks!
im posting my progress here http://wiki.linuxmce.org/index.php/MetaData_Handling#Automatic_File_tagging

I extended UpdateMedia to execute a set of rules for new and existing media files quite a while ago.  Reading that wiki entry, I think that what you're doing could just plug into that.  Details are in this thread: http://forum.linuxmce.org/index.php?topic=7116.0.  Trak ticket: http://svn.linuxmce.org/trac.cgi/ticket/158.

It's sat for a long time because I was told no new features would be considered until 0810 was released.  I'm currently setting up a new build environment and will make sure the patch still works with the latest source.  Then I was planning to see if I can generate any more interest in it by making it easier to add to a live system, create some more useful rules, etc.  I'd be really interested in discussing how we could plug your automatic component in to this system as a rule or a set of rules.
Title: Re: Need testers - updated 10-1
Post by: golgoj4 on October 16, 2010, 02:07:57 am
cool thanks!
im posting my progress here http://wiki.linuxmce.org/index.php/MetaData_Handling#Automatic_File_tagging

I extended UpdateMedia to execute a set of rules for new and existing media files quite a while ago.  Reading that wiki entry, I think that what you're doing could just plug into that.  Details are in this thread: http://forum.linuxmce.org/index.php?topic=7116.0.  Trak ticket: http://svn.linuxmce.org/trac.cgi/ticket/158.

It's sat for a long time because I was told no new features would be considered until 0810 was released.  I'm currently setting up a new build environment and will make sure the patch still works with the latest source.  Then I was planning to see if I can generate any more interest in it by making it easier to add to a live system, create some more useful rules, etc.  I'd be really interested in discussing how we could plug your automatic component in to this system as a rule or a set of rules.

My approach is slightly different in that it doesn't really have anything to do with rules save that the file is video and named a certain way. I considered a directory based approach, but thinking from an appliance standpoint i want interested in having people follow specific directory structure AND filename convention. Basically my goal is that anywhere linuxmce finds a video file that meets the criteria, and tags it based solely on how its named. I also intend for it to hit multiple sources for data so that I can fill out the metadata on things as much as possible.

Rules would still be usefull I think in helping users who wanted to establish how their files are organized if they choose to do it that way. But i still have much work to do so once i get a working proto-type ill have better idea.

-golgoj4

Title: Re: Need testers - updated 10-1
Post by: jthodges on October 16, 2010, 03:56:20 am
I'm not sure I explained it very well, or I'm not understanding your goals correctly.  I'm not sure where the description of it as a directory-based approach comes from, but it's not necessarily directory based.  You can attach rules to a directory, but you can also put them at the top level and just execute the rule based on a regular expression match.  It's really just an engine wired into UpdateMedia that executes custom logic against media that it matches via regular expression. Isn't that what you need? 

In your case I was thinking a rule for each data source (e.g., "IMDBRule", "TVDB"), which you could apply at the top level (or lower if folks did happen to have a tv directory they wanted to limit it to) for an array of regular expressions to match the various naming schemes you wanted to support.  Any media matching would cause your rule to execute. 

Am I way off base here?  It still seems like a good fit to me.

Title: Re: Need testers - updated 10-1
Post by: golgoj4 on October 24, 2010, 08:26:53 am
I'm not sure I explained it very well, or I'm not understanding your goals correctly.  I'm not sure where the description of it as a directory-based approach comes from, but it's not necessarily directory based.  You can attach rules to a directory, but you can also put them at the top level and just execute the rule based on a regular expression match.  It's really just an engine wired into UpdateMedia that executes custom logic against media that it matches via regular expression. Isn't that what you need?  

In your case I was thinking a rule for each data source (e.g., "IMDBRule", "TVDB"), which you could apply at the top level (or lower if folks did happen to have a tv directory they wanted to limit it to) for an array of regular expressions to match the various naming schemes you wanted to support.  Any media matching would cause your rule to execute.  

Am I way off base here?  It still seems like a good fit to me.



jthodges: i've made quite a bit of progress and ill want to see if i can get a hold of you on irc later this week. Im at the stage of writing the sql code to insert stuff, so we are approaching that point of convergence :)

I wasn't really sure of the best way to make the code available for others to look at / make suggestions / improve, so i signed up for this gitorious business as I wasn't interested in bothering the devs until its further along. this should let us collaborate a little easier.

http://gitorious.org/linuxmce-autotagger
http://linuxmce.pastebin.com/vvm6DvEZ <--console output, basically to debug and see its determinations.

the code atm will compile and run (its built on qt). Throw some video files in 'home/public/data/videos/' and it will scan and give you output in the console. this is basically a lot of debug info to let me know what its identified and so on to help refine th initial process. its to the point where it retrieves the data online (for tv atm) but doesn't insert it yet. I figured this was a good point to start sharing my progress.

-golgoj4

Title: Re: Need testers - updated 10-1
Post by: jthodges on October 25, 2010, 12:45:24 am
Fantastic!  I've had work stuff taking over the last week or so unfortunately, so I still need to dig out and test that patch.  I'm hoping to be freed up in the evenings starting tomorrow, and I'll make that a first priority to support any integration discussions we have this week.  Also looking forward to checking out what you've uploaded... thanks!
Title: Re: Need testers - updated 10-1
Post by: golgoj4 on November 07, 2010, 08:28:06 am
Continuing the topic over here: http://forum.linuxmce.org/index.php?topic=10884.0

Long story short, have a basic stand alone version.

Look like ill need to setup a builder to compile the necessary changes to updateMedia.

In the mean time if you want to test it out, go ahead. i would just recommend using a small set of test files. Details are on the last commit.

-golgoj4
Title: Re: Need testers - updated 10-1
Post by: jeangot on April 18, 2011, 08:27:27 am
Hello,

without the autotagger being integrated into UpdateMedia, what is the best way to have it run automatically on new files added to the system? If I would set a cron to run autotagger once daily, would it retag previously tagged files, or would it be smart enough to only look at new files? (Assuming I'm passing directories to it, and not individual filenames)

Jean
Title: Re: Need testers - updated 10-1
Post by: golgoj4 on April 19, 2011, 04:20:02 am
Hello,

without the autotagger being integrated into UpdateMedia, what is the best way to have it run automatically on new files added to the system? If I would set a cron to run autotagger once daily, would it retag previously tagged files, or would it be smart enough to only look at new files? (Assuming I'm passing directories to it, and not individual filenames)

Jean

Im currently coding changes to it so that it will run in the background, checking for new media files to tag. As far as existing stuff, it checks to see if they are missing anything or if there is more info to add, but it does this pretty quickly so a re-scan of existing stuff doesnt take very long at all.

As far as it being 'smart enough' to skip already tagged media. I made a choice for it not to specifically because cast lists expand, synopis becomes more filled out, etc.

So yes, run your cron job, i dont see that it would cause any problems

-golgoj4