PrecisePoint1TestingReport

Differences between revisions 1 and 2
Revision 1 as of 2012-08-23 12:36:55
Size: 8483
Editor: jibel
Comment:
Revision 2 as of 2012-08-23 18:41:16
Size: 6541
Editor: jibel
Comment:
Deletions are marked like this. Additions are marked like this.
Line 5: Line 5:
39 contributors have provided 338 results and covered 273 testcases 40 contributors have provided 380 results and covered 275 testcases
Line 8: Line 8:
 * Image Coverage : 54.43% (43/79)  * Image Coverage : 88.75% (71/80)
Line 32: Line 32:
||Ubuntu Server EC2||amd64||70.00%||100.00%||
||Ubuntu Server EC2||i386||75.00%||100.00%||
Line 44: Line 46:
28 bugs have been reported affecting a total of 21 test cases.
<<BR>>10 Tests failed.
 * Pass Rate: 96.34% (263/273)
28 bugs have been reported affecting a total of 5 test cases.
<<BR>>2 Tests failed.
 * Pass Rate: 99.27% (273/275)
Line 116: Line 118:
=== Ubuntu Alternate amd64 - Rescue amd64 ===
   * Bug:1040297 Rescue mode doesn't execute shell against proper partition
     * debian-installer (Ubuntu) Incomplete Undecided
   * Bug:1040306 Rescue mode doesn't reinstall grub with all operating systems
     * debian-installer (Ubuntu) Confirmed Undecided
=== Ubuntu Alternate i386 - Rescue i386 ===
   * Bug:1040297 Rescue mode doesn't execute shell against proper partition
     * debian-installer (Ubuntu) Incomplete Undecided
   * Bug:1040306 Rescue mode doesn't reinstall grub with all operating systems
     * debian-installer (Ubuntu) Confirmed Undecided
=== Ubuntu Alternate i386 - Test Memory (Live CD) ===
   * Bug:1028851 Memory test hangs on quantal, i386
     * memtest86+ (Ubuntu) Triaged Medium
=== Ubuntu Desktop amd64 - Live Session ===
   * Bug:1039405 Lockups when running vm's with 768MB of memory
     * ubiquity (Ubuntu) New Undecided
     * ubiquity (Ubuntu Precise) New Undecided
=== Ubuntu Desktop i386 - Install (OEM setup) ===
   * Bug:1039048 Install media unusable after the oem setup installation
     * ubiquity (Ubuntu) New Medium
=== Upgrade Kubuntu amd64 - Upgrade (Lucid) ===
   * Bug:1039828 package fontconfig-config 2.8.0-3ubuntu9 failed to install/upgrade: ErrorMessage: subprocess installed post-installation script returned error exit status 1
     * fontconfig (Ubuntu) Fix Released High
     * fontconfig (Ubuntu Precise) Fix Released High
     * fontconfig (Ubuntu Quantal) Fix Released High
Line 146: Line 123:
=== Upgrade Ubuntu amd64 - Upgrade (Lucid) ===
   * Bug:1040494 Unable to perform cdromupgrade without network from Lucid to Precise 12.04.1 AMD64 : E:Could not perform immediate configuration on 'python-minimal'
     * update-manager (Ubuntu) New Critical
   * Bug:1040499 No dialog after inserting a Precise 12.04.1 cd/usb key into Lucid
     * xorg (Ubuntu) Confirmed High
=== Upgrade Wubi - Upgrade i386 ===
   * Bug:1038639 install fail in Windows XP running in VM
     * linux (Ubuntu) Incomplete Medium

Precise 12.04.1 Testing report - Aug 23, 2012

Summary

Test Coverage

40 contributors have provided 380 results and covered 275 testcases

  • Image Coverage : 88.75% (71/80)
  • Breakdown by flavor and architecture:

Flavor

Arch

Coverage

Pass Rate

Edubuntu

amd64

100.00%

100.00%

Edubuntu

i386

100.00%

100.00%

Kubuntu

amd64

85.71%

100.00%

Kubuntu

i386

86.67%

100.00%

Mythbuntu

amd64

100.00%

100.00%

Mythbuntu

i386

100.00%

100.00%

Netboot

amd64

50.00%

100.00%

Netboot

armhf+armadaxp

100.00%

100.00%

Netboot

armhf+highbank

100.00%

100.00%

Netboot

armhf+omap

100.00%

0.00%

Netboot

armhf+omap4

100.00%

100.00%

Netboot

i386

50.00%

100.00%

Ubuntu

amd64

96.30%

96.23%

Ubuntu

amd64+mac

100.00%

100.00%

Ubuntu

i386

100.00%

94.12%

Ubuntu Core

amd64

100.00%

100.00%

Ubuntu Core

armhf

100.00%

100.00%

Ubuntu Core

i386

100.00%

100.00%

Ubuntu Server

amd64

95.45%

100.00%

Ubuntu Server

i386

100.00%

100.00%

Ubuntu Server EC2

amd64

70.00%

100.00%

Ubuntu Server EC2

i386

75.00%

100.00%

Ubuntu Studio

amd64

100.00%

100.00%

Ubuntu Studio

i386

100.00%

100.00%

Upgrade

amd64

75.00%

78.57%

Upgrade

i386

66.67%

100.00%

Upgrade

Wubi

100.00%

75.00%

Wubi

amd64

100.00%

100.00%

Wubi

i386

100.00%

100.00%

Xubuntu

amd64

44.44%

100.00%

Xubuntu

i386

33.33%

100.00%

Failures summary

28 bugs have been reported affecting a total of 5 test cases.
2 Tests failed.

  • Pass Rate: 99.27% (273/275)


Bug Tasks Importance

  • Critical : 2
  • High : 8 (4 closed)
  • Medium : 10 (1 closed)
  • Low : 2
  • Wishlist : 1
  • Undecided : 7

Bugs Details

Fixed/Closed Issues

High

  • 1008918 unity (Ubuntu) Invalid wrong display in dashboard after first time clicking the dashboard button

  • 683260 casper (Ubuntu) Fix Released persistence doesn't work on liveusb

  • 1034668 indicator-appmenu (Ubuntu) Won't Fix Upgrade from Lucid to Precise does not install packages for Global Menu: indicator-appmenu

  • 1039828 fontconfig (Ubuntu) Fix Released package fontconfig-config 2.8.0-3ubuntu9 failed to install/upgrade: ErrorMessage: subprocess installed post-installation script returned error exit status 1

Medium

  • 837054 ubiquity (Ubuntu) Invalid Time Zone selection shows about 20 different "New York"s and doesn't autoselect my location

Open Issues

Critical

  • 1040494 update-manager (Ubuntu) New Unable to perform cdromupgrade without network from Lucid to Precise 12.04.1 AMD64 : E:Could not perform immediate configuration on 'python-minimal'

  • 1017001 apt (Ubuntu) Confirmed package resolvconf 1.63ubuntu14 failed to install/upgrade: ErrorMessage: pre-dependency problem - not installing resolvconf

High

  • 1040499 xorg (Ubuntu) Confirmed No dialog after inserting a Precise 12.04.1 cd/usb key into Lucid

  • 1038573 evolution (Ubuntu) Triaged Unreadable messages displayed during Lucid -> Precise upgrade

  • 987418 ubiquity (Ubuntu) Triaged manual partitioner: /dev/sdb (installation media) selected by default as device for boot loader installation

  • 946718 update-notifier (Ubuntu) Triaged backend_helper.py crashed with RuntimeError in add_signal_receiver(): To make asynchronous calls, receive signals or export objects, D-Bus connections must be attached to a main loop by passing mainloop=... to the constructor or calling dbus.set_default_main_loop(...)

Medium

  • 1028851 memtest86+ (Ubuntu) Triaged Memory test hangs on quantal, i386

  • 924909 metacity (Ubuntu) Confirmed Windows have grey traces in Ubiquity

  • 924909 xfwm4 (Ubuntu) Confirmed Windows have grey traces in Ubiquity

  • 828679 colord (Ubuntu) Confirmed colord crashed with SIGABRT in kernel_vsyscall()

  • 986551 usb-creator (Ubuntu) New firefox takes long to start on live usb persistent key

  • 1038639 linux (Ubuntu) Incomplete install fail in Windows XP running in VM

  • 1039048 ubiquity (Ubuntu) New Install media unusable after the oem setup installation

  • 1035203 debian-installer (Ubuntu) New the <Go Back> button and the <No> button on "Select a language window" does not work

  • 985652 ubiquity (Ubuntu) New Translations for "retrieving files" are not being used

Low

  • 940919 indicator-datetime (Ubuntu) Confirmed clock is not automatically set in live session

  • 1038914 coreutils (Ubuntu) New lucid to precise: invalid $LS_COLORS after upgrade and before reboot

Wishlist

  • 940919 ubiquity (Ubuntu) Triaged clock is not automatically set in live session

Undecided

  • 1008918 unity-2d (Ubuntu) In Progress wrong display in dashboard after first time clicking the dashboard button

  • 1040306 debian-installer (Ubuntu) Confirmed Rescue mode doesn't reinstall grub with all operating systems

  • 1040297 debian-installer (Ubuntu) Incomplete Rescue mode doesn't execute shell against proper partition

  • 988290 xserver-xorg-video-intel (Ubuntu) Confirmed Resolution change with KVM switch on Precise

  • 1019621 abiword (Ubuntu) Confirmed Precise abiword version needs to be reverted to stable release prior to 12.04.1

  • 1040393 debian-installer (Ubuntu) New omap netboot partition too small for flash-kernel backup procedure

  • 1039405 ubiquity (Ubuntu) New Lockups when running vm's with 768MB of memory

Summary of Test Failures

Netboot armhf+omap - Install (ubuntu)

  • 1040393 omap netboot partition too small for flash-kernel backup procedure

    • debian-installer (Ubuntu) New Undecided
    • debian-installer (Ubuntu Precise) New Undecided

Upgrade Mythbuntu amd64 - Upgrade (Lucid)

  • 1017001 package resolvconf 1.63ubuntu14 failed to install/upgrade: ErrorMessage: pre-dependency problem - not installing resolvconf

    • apt (Ubuntu) Confirmed Critical
    • apt (Ubuntu Precise) Confirmed Critical
    • apt (Ubuntu Quantal) Confirmed Critical

QATeam/ReleaseReports/PrecisePoint1TestingReport (last edited 2012-08-23 18:41:16 by jibel)