Author Topic: Snapshot testing  (Read 7076 times)

golgoj4

  • NEEDS to work for LinuxMCE
  • ***
  • Posts: 1193
  • hrumpf!
    • View Profile
    • Mah Website
Snapshot testing
« on: March 20, 2011, 08:24:22 pm »
http://wiki.linuxmce.org/index.php/Snapshot_overview This page is doing it wrong.

Testing need to be more indepth that 'it installs'

At a minimum before you list a snapshot as functional, shouldn't

(1) Video
(2) Audio
(3) Network
(4) Storage Devices
(5) Telecom
(6) Automation
(7)Myth / VDR

Be tested before they are listed on a wiki? I appreciate people taking the time, but more complete information needs to accompany these 'tests' otherwise they dont really do much.

-my 2 cents
golgoj4
Linuxmce - Where everyone is never wrong, but we are always behind xbmc in the media / ui department.

bongowongo

  • wants to work for LinuxMCE
  • **
  • Posts: 826
    • View Profile
Re: Snapshot testing
« Reply #1 on: March 21, 2011, 08:08:15 am »
You are right golgoj4.
But we need more resources/manpower to do it.
To elaborate what I do with every snapshot is...........
Go through installation till I see Orbiter UI1.
In the process (2) audio is tested / also to some extend (1), because I see sara.
To dive into the others requires a lot more time, and a proper test setup, and poses problems. What is the standard device for (6)? Zwave/PLCbus/KNX/X10 etc etc.
Usually I take a look at the forum and see if there are common big problems, e.g. not starting AV-wizard or not able to create MD. I test that then. Maybe I should put in the wiki what I exactly tested.

golgoj4

  • NEEDS to work for LinuxMCE
  • ***
  • Posts: 1193
  • hrumpf!
    • View Profile
    • Mah Website
Re: Snapshot testing
« Reply #2 on: March 22, 2011, 08:51:47 am »
Bongo and I talked in IRC and a wiki page outlining our testing process so anyone can join.

Basically its going to be split up by what people have.

So initially bongo is going to install from snapshot at which point i test it on physical hard ware. The more diverse hardware the better so stay tuned for our semi-official testing process.
Linuxmce - Where everyone is never wrong, but we are always behind xbmc in the media / ui department.

bongowongo

  • wants to work for LinuxMCE
  • **
  • Posts: 826
    • View Profile
Re: Snapshot testing
« Reply #3 on: March 22, 2011, 10:04:02 am »
And our team name =
Bongo's Fluffers
team motto =
Test your Bongo regularly
team mascotte =
Elephant

totallymaxed

  • LinuxMCE God
  • ****
  • Posts: 4660
  • Smart Home Consulting
    • View Profile
    • Dianemo - at home with technology
Re: Snapshot testing
« Reply #4 on: March 22, 2011, 10:08:30 am »
Bongo and I talked in IRC and a wiki page outlining our testing process so anyone can join.

Basically its going to be split up by what people have.

So initially bongo is going to install from snapshot at which point i test it on physical hard ware. The more diverse hardware the better so stay tuned for our semi-official testing process.

I dont know what the new Wiki pages says yet but I can relate the process we use that might be of help;

1. Does the snapshot work and deliver a basic working system?

2. Yes -  then people who have the hardware to test the specific parts of system after that can then focus on those and report back
   No - then report what the failure at 1 was and wait for a new snapshot.

Some people may take on several of the hardware specific testing tasks (dependent on time/hardware availability) others may just focus on a single hardware specific test or tests. Each tester documents their testing process. This makes testing faster and avoids the problem of a single person having to have all the hardware & importantly all of the time to test it all each time. If multiple people test the same hardware/feature thats ok too as it just strengthens the validity of the testing.

Just my 2c worth based on our processes here and our experience from doing this with the Pluto devs 'back in the day'.

All the best


Andrew
Andy Herron,
CHT Ltd

For Dianemo/LinuxMCE consulting advice;
@herron on Twitter, totallymaxed+inquiries@gmail.com via email or PM me here.

Get Dianemo-Rpi2 ARM Licenses http://forum.linuxmce.org/index.php?topic=14026.0

Get RaspSqueeze-CEC or Raspbmc-CEC for Dianemo/LinuxMCE: http://wp.me/P4KgIc-5P

Facebook: https://www.facebook.com/pages/Dianemo-Home-Automation/226019387454465

http://www.dianemo.co.uk

Marie.O

  • Administrator
  • LinuxMCE God
  • *****
  • Posts: 3676
  • Wastes Life On LinuxMCE Since 2007
    • View Profile
    • My Home
Re: Snapshot testing
« Reply #5 on: March 22, 2011, 10:26:03 am »
totallymaxed,

that's exactly the plan we discussed. Good to see we are not too far off from what Pluto successfully did

totallymaxed

  • LinuxMCE God
  • ****
  • Posts: 4660
  • Smart Home Consulting
    • View Profile
    • Dianemo - at home with technology
Re: Snapshot testing
« Reply #6 on: March 22, 2011, 10:54:59 am »
totallymaxed,

that's exactly the plan we discussed. Good to see we are not too far off from what Pluto successfully did

Great minds think alike :-)
Andy Herron,
CHT Ltd

For Dianemo/LinuxMCE consulting advice;
@herron on Twitter, totallymaxed+inquiries@gmail.com via email or PM me here.

Get Dianemo-Rpi2 ARM Licenses http://forum.linuxmce.org/index.php?topic=14026.0

Get RaspSqueeze-CEC or Raspbmc-CEC for Dianemo/LinuxMCE: http://wp.me/P4KgIc-5P

Facebook: https://www.facebook.com/pages/Dianemo-Home-Automation/226019387454465

http://www.dianemo.co.uk

bongowongo

  • wants to work for LinuxMCE
  • **
  • Posts: 826
    • View Profile
Re: Snapshot testing
« Reply #7 on: March 22, 2011, 10:59:36 am »
Thanks
So everybody agrees upon the name. Good.

Marie.O

  • Administrator
  • LinuxMCE God
  • *****
  • Posts: 3676
  • Wastes Life On LinuxMCE Since 2007
    • View Profile
    • My Home
Re: Snapshot testing
« Reply #8 on: March 22, 2011, 11:01:42 am »
Great minds think alike :-)

In German it is: Zwei Dumme, ein Gedanke

Go google translate :)

joshpond

  • Veteran
  • ***
  • Posts: 108
    • View Profile
Re: Snapshot testing
« Reply #9 on: March 22, 2011, 01:43:13 pm »
Quote
Great minds think alike :-)

........but so do idiots my wife tells me  :D
My Setup: On it's way

golgoj4

  • NEEDS to work for LinuxMCE
  • ***
  • Posts: 1193
  • hrumpf!
    • View Profile
    • Mah Website
Re: Snapshot testing
« Reply #10 on: March 30, 2011, 12:09:02 am »
The result of bongo and i discussing and his 1st testing

http://wiki.linuxmce.org/index.php/Snapshot_Testing
http://wiki.linuxmce.org/index.php/Snapshot_overview

Im the hardware tester and lagging at the moment. the iso is sitting on my drive as of yet to be burned.

Here is a question: Now that its all laid out, what the best way for multiple people to help test instead of the two?
Linuxmce - Where everyone is never wrong, but we are always behind xbmc in the media / ui department.

locutus

  • Veteran
  • ***
  • Posts: 88
    • View Profile
Re: Snapshot testing
« Reply #11 on: March 30, 2011, 01:17:13 am »
i dont know how you would do it but maybe a script that tests each part?

Michaelree

  • Regular Poster
  • **
  • Posts: 17
    • View Profile
Re: Snapshot testing
« Reply #12 on: March 30, 2011, 03:33:23 am »
Not sure if this is the right place, but i just installed the lastest snapshot 23858.  Everything went fine untill i tryed setting up a media director, a Zotac Ion 330, and i could not get the sound to work over HDMI.

cat /proc/asound/version on the core shows 1.0.23
cat /proc/asound/version on the MD shows 1.0.17
and both are usings alsamixer 1.0.18

Chris

golgoj4

  • NEEDS to work for LinuxMCE
  • ***
  • Posts: 1193
  • hrumpf!
    • View Profile
    • Mah Website
Re: Snapshot testing
« Reply #13 on: March 30, 2011, 10:26:57 am »
Not sure if this is the right place, but i just installed the lastest snapshot 23858.  Everything went fine untill i tryed setting up a media director, a Zotac Ion 330, and i could not get the sound to work over HDMI.

cat /proc/asound/version on the core shows 1.0.23
cat /proc/asound/version on the MD shows 1.0.17
and both are usings alsamixer 1.0.18

Chris

Not exactly but since your here

ssh into the md. normally thats done by
-ssh'ing into the core
-from the core ssh into the md
-run this command apt-get install alsa-modules-`uname -r`

let me know if this works. should bring alsa to 1.0.23 on the MD. The alsamixer version doesnt need to match the alsa version installed I am told.

golgoj4 with fix information from possy.
Linuxmce - Where everyone is never wrong, but we are always behind xbmc in the media / ui department.

pigdog

  • NEEDS to work for LinuxMCE
  • ***
  • Posts: 1105
    • View Profile
Re: Snapshot testing
« Reply #14 on: March 30, 2011, 02:18:41 pm »
Hi,

If golgoj4 solution doesn't work for you look at this...

http://forum.linuxmce.org/index.php?topic=11415.0