LinuxMCE Forums

General => Users => Topic started by: pigdog on July 23, 2009, 05:34:09 pm

Title: Media> Video folder not seen
Post by: pigdog on July 23, 2009, 05:34:09 pm
Hi,

I added three media folders to my NAS and updatemedia added 2 to MEDIA>VIDEOS sort by Title so I was able to attach artwork but the third has never been picked up.  I can see it via sort by filename under my share, I can see it in it's directory on the drive via command line.  I have resynch'd media see attached...

Code: [Select]
10      07/23/09 10:50:05.539           UpdateMedia::ReadDirectory /home/public/data/videos/Windows Share-Volume_2 [33]/Watchmen <0xb6ce48d0>
10      07/23/09 10:50:05.568           UpdateMedia::ScanSubfolders dir /home/public/data/videos/Windows Share-Volume_2 [33]/Watchmen: subdirs found: 2 <0xb6ce48d0>
10      07/23/09 10:50:05.570           '/home/public/data/videos/Windows Share-Volume_2 [33]/Watchmen' is a ripped dvd <0xb6ce48d0>
10      07/23/09 10:50:05.581           Sync mode for dir /home/public/data/videos/Windows Share-Volume_2 [33]/Watchmen: modeBoth <0xb6ce48d0>
05      07/23/09 10:50:05.583           # PlutoMediaFile STARTED: dir /home/public/data/videos/Windows Share-Volume_2 [33] file Watchmen <0xb6ce48d0>
10      07/23/09 10:50:05.585           # ID3FileHandler::LoadAttributes: loading 0 attributes in the attribute file /home/public/data/videos/Windows Share-Volume_2 [33]/ <0xb6ce48d0>
10      07/23/09 10:50:05.587           # LoadPlutoAttributes: pluto attributes loaded (from id3 file - general object tag) 0 <0xb6ce48d0>
10      07/23/09 10:50:05.589           # LoadPlutoAttributes: id3 attributes loaded (from id3 file - common tags) 0 <0xb6ce48d0>
10      07/23/09 10:50:05.591           MergePictures: merging 0 pictures from our tag with 0 pictures from PIC tags <0xb6ce48d0>
10      07/23/09 10:50:05.593           Processing path /home/public/data/videos/Windows Share-Volume_2 [33], file Watchmen. Found 0 attributes, 0 long attributes in file <0xb6ce48d0>
10      07/23/09 10:50:05.596           SetFileAttribute /home/public/data/videos/Windows Share-Volume_2 [33]/Watchmen 1135 <0xb6ce48d0>
10      07/23/09 10:50:05.598           # LoadPlutoAttributes: pluto attributes merged with those from database 0 <0xb6ce48d0>
10      07/23/09 10:50:05.600           # LoadPlutoAttributes: pluto long attributes merged with those from database 0 <0xb6ce48d0>
10      07/23/09 10:50:05.601           LoadCoverarts: loaded 0 unique pictures from file <0xb6ce48d0>
10      07/23/09 10:50:05.602           LoadBookmarkPictures: clear bookmarks from file.We'll use those from db: 0 <0xb6ce48d0>
10      07/23/09 10:50:05.603           # SaveMiscInfo: FK_FileFormat 0, FK_MediaSubType 0 <0xb6ce48d0>
10      07/23/09 10:50:05.605           File 1135 has now media type 3 <0xb6ce48d0>
10      07/23/09 10:50:05.606           # GetPicAttribute: file 1135 <0xb6ce48d0>
10      07/23/09 10:50:05.608           Found 0 pics for file <0xb6ce48d0>
10      07/23/09 10:50:05.609           Found 0 pics for attribute <0xb6ce48d0>
10      07/23/09 10:50:05.610           # GetPicAttribute: got no picture for file 1135 <0xb6ce48d0>
10      07/23/09 10:50:05.611           # GetPicAttribute: file 1135 <0xb6ce48d0>
10      07/23/09 10:50:05.612           Found 0 pics for file <0xb6ce48d0>
10      07/23/09 10:50:05.613           Found 0 pics for attribute <0xb6ce48d0>
10      07/23/09 10:50:05.614           # GetPicAttribute: got no picture for file 1135 <0xb6ce48d0>
10      07/23/09 10:50:05.616           # Won't create id3 file (the media file doesn't have attributes) <0xb6ce48d0>
10      07/23/09 10:50:05.617           # ID3FileHandler::SaveAttributes: saving 0 attributes in the attribute file /home/public/data/videos/Windows Share-Volume_2 [33]/ <0xb6ce48d0>
05      07/23/09 10:50:05.617           # ID3FileHandler::SaveAttributes: saving 0 pictures into APIC tags to /home/public/data/videos/Windows Share-Volume_2 [33]/ <0xb6ce48d0>
10      07/23/09 10:50:05.619           Serialize write bookmarks: 0 <0xb6ce48d0>
10      07/23/09 10:50:05.620           # SyncDbAttributes: ready to sync db with attributes found in attribute file <0xb6ce48d0>
10      07/23/09 10:50:05.625           # SyncDbAttributes: attributes is db 0, total 0 <0xb6ce48d0>
10      07/23/09 10:50:05.626           # SyncDbAttributes: long attributes is db 0, total 0 <0xb6ce48d0>
10      07/23/09 10:50:05.628           SaveCoverarts: got 0 coverarts in db. Merging with 0 from file <0xb6ce48d0>
10      07/23/09 10:50:05.629           # SaveMiscInfo: FK_FileFormat 0, FK_MediaSubType 0 <0xb6ce48d0>
10      07/23/09 10:50:05.631           File /home/public/data/videos/Windows Share-Volume_2 [33]/Watchmen, PK_File 1135 - midmd5 is d41d8cd98f00b204e9800998ecf8427e <0xb6ce48d0>
Mapped file /mnt/device/33 : 26 -> 33
Mapped file /mnt/device/34 : 25 -> 34
10      07/23/09 10:50:05.635           File /home/public/data/videos/Windows Share-Volume_2 [33]/Watchmen on pluto device 33 <0xb6ce48d0>
10      07/23/09 10:50:05.636           File /home/public/data/videos/Windows Share-Volume_2 [33]/Watchmen assigned to user 0 <0xb6ce48d0>
10      07/23/09 10:50:05.637           # PlutoMediaFile ENDED: dir /home/public/data/videos/Windows Share-Volume_2 [33] file Watchmen, sync mode modeBoth <0xb6ce48d0>

Resynch sees it.

I have rebooted after the resynch.  I have deleted and re-added the folder audio/video_ts (VOB files).

Resynch a second time.  Waited an hour for updatemedia to catch it.

Basically, I've run out of ideas?  Any other suggestions?

P.S.  There is still over 70 Meg of disk space left on that NAS.  The other two are on that same NAS and one was added after this folder was deleted and re-added.

P.S.S.  I can play the source disk on my Core, Fedora 11 box and WIN2K box.
Title: Re: Media> Video folder not seen
Post by: pigdog on July 23, 2009, 08:36:43 pm
I hooked the NAS directly to my WIN2K box and was able to play the movie off the NAS with PowerDVD.

I renamed the movie to The Watchmen set the NAS back up for the Core waited 30 minutes for updatemedia and nothing.

When I sort by file name the folder is the first selection on the list.  When you select it nothing happens. 

I figure it's at the top of the list before the alphabetical order because updatemedia hasn't processed it yet.

When you selected the filename it doesn't do anything.  No movie tries to run.

I went back to the WIN2K box, deleted the file.  Reload and added a new folder.  I copied the audio/video_ts files from the source disk to the NAS location.

Went back to LMCE and tried again.  Still nothing.

At least I've figured out what those 0 byte cifsxxxx files are.

Why is this one being such a pain?
Title: Re: Media> Video folder not seen
Post by: colinjones on July 23, 2009, 09:46:00 pm
As I described in another thread, you won't see any media in Sort by Title (or any other attribute) if it hasn't got attributes assigned to it, and you UpdateMedia log clearly states that it has no attributes. Thus you will only be able to see it in Sort by Filename mode. The reason it sorts to the top - out of alphabetical order - is simply because it is a folder, not a file. Folders sort to the top and then alphabetically within themselves, followed by individual files.

I don't know why it doesn't play when selected in Filename sort mode, but you can get it to appear in the other sort modes by going into web admin, navigating to the media, and then assigning at least a title attribute (probably to the parent folder, not sure about the children folders as LMCE should recognise them, I think you also need to drop down and select the LMCE DVD media option too).
Title: Re: Media> Video folder not seen
Post by: pigdog on July 23, 2009, 11:01:17 pm
Hi colinjones,

Normally even if a folder doesn't have the id3 tag it will still show up under Media>Video (sort by title).

Resynch show Watchman checked - no picture.

If I go right down to Watchmen  under Files & Media|Media Files Synch I can see

This is a directory treated as a single file: [Show Attributes] [Edit attributes for all files in directory].

Type:  LinuxMCE DVD.  Check Amazon

I went to Add attribute:  Title - looked through the list and Watchmen wasn't there so I added it (Watchmen) to the Atribute name* field.

Selected - Add.  Then clicked the Update button.  It accepted - sent the message - and reported - Media file updated.

I heard some hard disk activity on the NAS.  I waited 5 minutes for updatemedia to complete. 

Checked Media>Video nothing.  Checked Files & Media | Media Files Sync shares>Watchmen and I had audio_ts, video_ts and 5 cifsxxxx files.

I did a resynch on the Watchmen file.

# LoadPlutoAttributes: id3 attributes loaded (from id3 file - common tags) 1 <0xb6ce48d0>
Attr in db: type 13  value Watchmen <XXXXXXX>

and some other small changes.

I waited 5 minutes for updatemedia.  Went back to Media>Video filename selected Watchman (File top).

Got hard drive activity - no movie played.  Closed down, back into webadmin.  File sync - now a total of 15 cifsxxxx files.

So the system is trying to play the movie.  I figure the cifs files are when you play a movie and then hit F1 and stop. 

The next time you go to play the movie you are asked start where you left off?  These (the cifs) are those pointers.
Title: Re: Media> Video folder not seen
Post by: pigdog on July 23, 2009, 11:52:29 pm
Hi,

I've got to powerdown and delete Watchmen off the NAS.

I'm into some huge cifsxxxx generation loop.  Gotta clear out the drive.
Title: Re: Media> Video folder not seen
Post by: colinjones on July 24, 2009, 04:29:44 am
pigdog

dunno what the cifs files are, I have never seen them - wondering if they are an artifact of how SAMBA works between LMCE and your specific NAS(and firmware)? Did you ever switch it to smbfs?

As for what is visible, unless you are using 0810 and something has changed in 0810 that I am not aware of, no folder structure at all is shown in Title sort mode. The only things that are shown are media files that have attributes set (specifically Title in this case). If I have no attributes set on my media, then the screen is completely blank.

That being said, I never use VOB style DVD rips, and I believe that LMCE treats these slightly differently... from memory I believe that it attempts to treat the parent folder as the actual media file, and everything below it is hidden so that you can just hit play on the parent. Perhaps that is why you have seen this behaviour before. But for all other normal media files/folders, the folders themselves are not displayed, only the files when attributes are set.

I suggest that you isolate the problem from any possible NAS issues by copying the folder over to your local LMCE core HDD. This will ensure that no strange NAS/CIFS/SAMBA issues are confusing the picture. If you can get the expected behaviour locally, then you can extend this back to the NAS and reasonably assume that anything that doesn't work in the same way there is related to the file sharing part of things. But do remember that moving/copying files will break the connection between any assigned attributes and the media files/folders, so you will need to reassign the attribues.
Title: Re: Media> Video folder not seen
Post by: pigdog on July 24, 2009, 06:22:06 pm
Hi Col,

I'm still working on it.

I have tried to change the share volumes via device tree to Filesystem: smbfs from cifs but when NAS comes online system reverts to cifs.

Have tried just smb as well.

DNS-323 does run a scaled down Linux distro.
Title: Re: Media> Video folder not seen
Post by: pigdog on July 25, 2009, 04:27:00 pm
Hi,

From the device tree for the windows share volumes you can not change from cifs to smbfs.  

I've changed it to smbfs - saved it,  done quick reload, rebooted, with/without passwords, etc.

Whenever the NAS comes online the field flips to cifs.

P.S. I've downloaded the DNS 1.08 beta and added a NFS module to it.  Tried to change cifs to smbfs, nfs, ups (just kidding) but everything flips back to cifs after UpdateMedia runs.

P.P.S.  Colin - I read this http://forum.linuxmce.org/index.php?topic=4758.0 are you running cifs or smbfs and is the script fix from Zaerc in the alpha release?
Title: Re: Media> Video folder not seen
Post by: colinjones on July 25, 2009, 10:06:07 pm
I'm using cifs as I don't have that problem any more.... that was an older version, one of the 0710 betas I think, perhaps something changed in 0810 again?
Title: Re: Media> Video folder not seen
Post by: pigdog on July 25, 2009, 10:49:55 pm
Hi,

I kinda got the media tagged but it was very dirty how I did it.

But I'm still struggling with those damn CIFSxxxx files being generated.

The strangest part is I only get them for the folders that I attached id3 tags to in 810.

All the folders with audio/video_ts and id3 tags created in 710 do not get these CIFS created - every time updatemedia runs - so every 2 minutes.

I attached an id3 to a 710 folder at that one started to get cifs where it didn't before.

If I turn the DNS-323 to read only the CIFS are not created.

I'm trying to figure out where I can add the nobrl option to the cifs mount.  I've looked at Configure_1837.sh but am not sure if that's a good point.

Turning the disk to read only on the DNS will be a pain for whenever I want to rip something.

Cheers.
Title: Re: Media> Video folder not seen
Post by: pigdog on July 26, 2009, 02:59:19 am
Well,

I was writing up something and the damn system went for it's nightly dump.

Anyway, running as NFS on the DNS-323 causes less cifs files about every 8 to 9 minutes.

System reverted to cifs even after trying nfs and NFS in filesystem type.

Damn media tag problem came back.

This DNS beta load is really wonky.  Might have to go the fonz fun-plug route.
Title: Re: Media> Video folder not seen
Post by: colinjones on July 26, 2009, 05:39:09 am
The share/server device you have set up is a "windows share" so obviously you can't use NFS with that, its a totally different system. NFS shares use a different device template, and require manual setup rather than pnp. I believe there are instructions on the wiki somewhere on how to set up an NFS share.
Title: Re: Media> Video folder not seen
Post by: pigdog on July 26, 2009, 02:50:30 pm
Hi Col,

NFS isn't worth trying.  The DNS keeps losing a volume on reboot and has to be reprogrammed.
Title: Re: Media> Video folder not seen
Post by: pigdog on July 27, 2009, 05:09:14 pm
Hi,

Does updatemedia look at or refreshes id3 tags?

I've notice that when the cifsxxxx files are generated their timestamp matches the id3 tag timestamp.

new cifsxxxx file timestamp = new id3 tag timestamp and why only on 810 created id3 tags?

Title: Re: Media> Video folder not seen
Post by: colinjones on July 27, 2009, 11:38:16 pm
Yes, that's updatemedia's entire job - to sync metadata between the pluto_media database and ID3 tags on the media shares (either embedded ID3 tags inside mp3 files, or ID3 tag files for all other media files)

I know that some work has been done on the updatemedia and particularly the ID3 sections for 0810, perhaps this is a bug in 0810. From http://www.nabble.com/Problems-with-rename-to-open-file-and-open-unlink-create-td22910956.html it looks like the cifs files are temporary files created, probably when something (updatemedia) is attempting to modify the ID3 tag files, and cifs/samba is not correctly handling the delete-on-close bit. I don't suppose the NAS supports separate permissions for create/modify/delete? If it has permission to create and modify files but not delete them, that could explain it.... long shot, but worth asking!
Title: Re: Media> Video folder not seen
Post by: pigdog on July 28, 2009, 02:16:01 am
Hi,

Found same - same here earlier this day

http://lists.samba.org/archive/linux-cifs-client/2009-April/004331.html

Problem related to cifs-1.56 with 2.7.27.  Seems to work O.K. for 2.6.29 samba>=3.2.

Would have posted earlier but neighbour just bought new Aspire 5536-5255 and I've been de-crapifying it and creating restore disks.

Guess I'll have to read only the DNS-323 disks for now.

Thanks for your help.  It's nice to have someone to bounce things off.

Cheers - thanks.
Title: Re: Media> Video folder not seen
Post by: pigdog on July 28, 2009, 06:05:58 am
Here's what I just tried.

I connect to the DNS from my Fedora box.

smbclient //NAS-1/Volume_1 -U

Domain=[LINUXMCE] OS=[Unix] Server=[Samba 3.0.24]

Work my way down the tree...

smb: \public\data\videos\> ls
  .                                                 D        0  Wed Jul  8 12:02:12 2009
  ..                                                D        0  Tue Jul  7 23:50:50 2009
  V Is For Vendetta                       D        0  Sun Jul 26 14:56:37 2009  - Bad Folder creates cifs
  Quantum Of Solace                   D        0  Wed Jul  8 11:12:24 2009  - Good Folder no cifs.


smb: \public\data\videos\> allinfo HELLBOY
altname: HELLBOY
create_time:      Wed 08 Jul 2009 12:02:12 PM EDT EDT
access_time:     Sun 26 Jul 2009 02:52:52 PM EDT EDT
write_time:        Wed 08 Jul 2009 12:02:12 PM EDT EDT
change_time:    Wed 08 Jul 2009 12:02:12 PM EDT EDT
NT_STATUS_OK getting streams for \public\data\videos\HELLBOY


smb: \public\data\videos\> allinfo "The Fellowship of the Ring"
altname: TG6IPP~H
create_time:      Sun 26 Jul 2009 02:49:38 PM EDT EDT
access_time:     Sun 26 Jul 2009 02:49:38 PM EDT EDT
write_time:        Sun 26 Jul 2009 02:49:38 PM EDT EDT
change_time:    Sun 26 Jul 2009 02:49:38 PM EDT EDT
NT_STATUS_OK getting streams for \public\data\videos\The Fellowship of the Ring

So Hellboy with just access_time adjusted on updatemedia is fine - no cifsxxxx being created.

Fellowship is one of the problem folders - create, access, write, change_time adjusted - cifsxxxx created.

And chmod fyi...

smb: \public\data\videos\> stat HELLBOY
File: \public\data\videos\HELLBOY
Size: 0              Blocks: 0   directory
Inode: 79200257   Links: 4
Access: (0777/drwxrwxrwx)   Uid: 501   Gid: 501
Access: 2009-07-26 14:52:52 -0400
Modify: 2009-07-08 12:02:12 -0400
Change: 2009-07-08 12:02:12 -0400

smb: \public\data\videos\> stat "The Fellowship of the Ring"
File: \public\data\videos\The Fellowship of the Ring
Size: 0              Blocks: 0   directory
Inode: 8585217   Links: 4
Access: (0777/drwxrwxrwx)   Uid: 501   Gid: 501
Access: 2009-07-26 14:49:38 -0400
Modify: 2009-07-26 14:49:38 -0400
Change: 2009-07-26 14:49:38 -0400