QuantalAlpha3TestReport

Revision 2 as of 2012-07-26 13:39:26

Clear message

Quantal Alpha 3 Testing report - Jul 26, 2012

Summary

Test Coverage

35 contributors have provided 456 results and covered 337 testcases

  • Image Coverage : 81.40% (70/86)
  • Breakdown by flavor and architecture:

Flavor

Arch

Coverage

Pass Rate

Edubuntu

amd64

100.00%

100.00%

Edubuntu

i386

100.00%

100.00%

Kubuntu

amd64

64.29%

100.00%

Kubuntu

amd64+mac

42.86%

100.00%

Kubuntu

armhf+omap4

100.00%

100.00%

Kubuntu

i386

66.67%

100.00%

Lubuntu

amd64

100.00%

100.00%

Lubuntu

amd64+mac

100.00%

100.00%

Lubuntu

i386

100.00%

100.00%

Lubuntu

powerpc

100.00%

100.00%

Netboot

amd64

100.00%

100.00%

Netboot

armhf+omap4

100.00%

100.00%

Netboot

i386

100.00%

100.00%

Ubuntu

amd64

95.83%

92.31%

Ubuntu

amd64+mac

100.00%

90.00%

Ubuntu

armhf+ac100

100.00%

100.00%

Ubuntu

armhf+omap4

33.33%

100.00%

Ubuntu

i386

100.00%

98.18%

Ubuntu Core

amd64

100.00%

100.00%

Ubuntu Core

armhf

100.00%

100.00%

Ubuntu Core

i386

100.00%

100.00%

Ubuntu Server

amd64

90.91%

85.00%

Ubuntu Server

armhf+omap4

100.00%

100.00%

Ubuntu Server

i386

100.00%

86.67%

Ubuntu Server EC2

amd64

70.00%

100.00%

Ubuntu Server EC2

i386

75.00%

100.00%

Upgrade

amd64

100.00%

100.00%

Upgrade

i386

100.00%

100.00%

Wubi

amd64

100.00%

100.00%

Wubi

i386

100.00%

100.00%

Xubuntu

amd64

55.56%

14.29%

Xubuntu

i386

66.67%

60.00%

Failures summary

46 bugs have been reported affecting a total of 61 test cases.
20 Tests failed.

  • Pass Rate: 94.07% (317/337)


Bug Tasks Importance

  • Critical : 2 (1 closed)
  • High : 19 (5 closed)
  • Medium : 9 (2 closed)
  • Low : 2
  • Undecided : 15 (1 closed)

Bugs Details

Fixed/Closed Issues

Critical

  • 1028664 debian-installer (Ubuntu) Fix Released keyboard does not work on quantal-server-armhf+omap4.img

High

  • 1016925 xubuntu-meta (Ubuntu) Fix Released 12.10 Alternate installer fails with libavformat53 unmet dependencies

  • 1028301 pkgsel (Ubuntu) Fix Released Quantal Ubuntu Server - sources.list only contains cdrom entries after a preseeded installation

  • 1028972 ltsp (Ubuntu) Invalid Empty session menu in ltsp client

  • 1028526 isc-dhcp (Ubuntu) Fix Released dhcpd failed to start with apparmor denied: capname="dac_override"

  • 1027851 linux (Ubuntu) Fix Released Quantal desktop installation on a vm hung on reboot.

Medium

  • 441835 devicekit-disks (Ubuntu) Invalid Clicking on floppy gives "no device media found"

  • 441835 linux (Ubuntu) Invalid Clicking on floppy gives "no device media found"

Undecided

  • 1028108 debian-installer (Ubuntu) Invalid Debian Installer , [ trying to overwrite '/lib/firmware/rt2870.bin', which is also in package firmware-ralink 0.36]

Open Issues

Critical

  • 1029032 xubuntu-meta (Ubuntu) Triaged Xubuntu 64 (Quantal) alternate install failed: libavformat53 unmet dependencies

High

  • 1028859 indicator-datetime (Ubuntu) New a "Invalid UTF 8" appears at the place where the time should be displayed in the notification area after some config in date&time setting

  • 1028972 indicator-session (Ubuntu) New Empty session menu in ltsp client

  • 987418 ubiquity (Ubuntu) Triaged manual partitioner: /dev/sdb (installation media) selected by default as device for boot loader installation

  • 1028746 ibus-chewing (Ubuntu) New quantal alpha3: ibus-engine-chewing crashed with SIGABRT in assert_fail_base()

  • 1018022 light-themes (Ubuntu) Confirmed Dark Unity menus displayed in white

  • 1022726 ubiquity (Ubuntu) New Wrong drive letter during install of Quantal Alpha 2

  • 1028866 gnome-control-center (Ubuntu) New the date is not displayed correctly in the "date and time setting" window

  • 1018907 plymouth (Ubuntu) Confirmed plymouth in quantal on arm does only boot with black screen

  • 1028828 indicator-datetime (Ubuntu) New the weekday name: "SUN, MON, TUE, WED, THU, FRI, SAT" is not displayed correctly in the date and time window

  • 986806 ubiquity (Ubuntu) Incomplete swap not activated after choosing 'use whole disk' with encrypted home

  • 1026520 colord (Ubuntu) Confirmed colord-sane crashed with SIGSEGV in opendirat()

  • 1010487 ubiquity (Ubuntu) Confirmed Xubuntu - black windows

  • 1028453 ubuntu-meta (Ubuntu) Confirmed Quantal Ubuntu Server minimal install oversized

  • 441835 udisks (Ubuntu) Triaged Clicking on floppy gives "no device media found"

Medium

  • 924909 metacity (Ubuntu) Confirmed Windows have grey traces in Ubiquity

  • 924909 xfwm4 (Ubuntu) Confirmed Windows have grey traces in Ubiquity

  • 1007674 linux (Ubuntu) Triaged Panel volume slider does not respond

  • 1009896 lubuntu-meta (Ubuntu) Triaged Lubuntu Alternate and Desktop images exceed 700MB

  • 983681 linux (Ubuntu) Triaged Floppy keeps running forever after every access

  • 1028640 sessioninstaller (Ubuntu) Confirmed session-installer crashed with TypeError in _on_property_changed(): could not convert type dbus.Array to PyObject required for parameter 0

  • 1028983 partman-base (Ubuntu) New armhf-omap4: a disk formatted with ext4 fails to mount with partman

Low

  • 967308 ubiquity-slideshow-ubuntu (Ubuntu) In Progress Sync slideshow apps with Ubuntu : Mention Gnote or Zim in the slideshow

  • 1023254 gnumeric (Ubuntu) Triaged gnumeric crashed with signal 5 in g_realloc()

Undecided

  • 1028651 ubiquity (Ubuntu) New Cursor disappears when Detect Keyboard Layout window appears, after clicking no. Moving mouse causes it to come back, then after clicking no again it disappears again.

  • 1028852 ubiquity-slideshow-ubuntu (Ubuntu) New kubuntu slideshow still talks of 12.04

  • 1028851 memtest86+ (Ubuntu) New Memory test hangs on quantal, i386

  • 1029407 debian-installer (Ubuntu) New Check disk for defects fail on MD5 checksum for A3 quantal i386 Server

  • 1028591 kdebase-workspace (Ubuntu) New battery widget does not show current status as it changes

  • 1028552 lightdm-kde (Ubuntu) New guest login not working

  • 1029128 xubuntu-meta (Ubuntu) New Displays "Xubuntu 12.04" on bootup rather than 12.10

  • 1028611 xubuntu-meta (Ubuntu) New Manually select "Xubuntu desktop" on alpha3 testing alternate

  • 1027461 ubiquity (Ubuntu) Confirmed Xubuntu, installer locked in auto resize

  • 1010794 xserver-xorg-video-nouveau (Ubuntu) Confirmed Graphics/text corruptions in some applications with nouveau drivers

  • 1028553 konsole (Ubuntu) New complains about open tabs on logout

  • 1028551 kubuntu-default-settings (Ubuntu) New no default search engine set

  • 1018598 gtk+3.0 (Ubuntu) Confirmed menus of gtk3 applications under Xubuntu

  • 1028545 kubuntu-default-settings (Ubuntu) New ad-block off by default

Summary of Test Failures

Ubuntu Alternate i386 - Test Memory (Live CD)

  • 1028851 Memory test hangs on quantal, i386

    • memtest86+ (Ubuntu) New Undecided

Ubuntu Desktop amd64 - Install (OEM setup)

  • 1029351 ISO testing: Cannot do an OEM installation a UEFI system

    • Ubuntu New Undecided

Ubuntu Desktop amd64 - Install (auto-resize)

  • 1023254 gnumeric crashed with signal 5 in g_realloc()

    • Gnumeric New Undecided
    • gnumeric (Ubuntu) Triaged Low
  • 1023254 gnumeric crashed with signal 5 in g_realloc()

    • Gnumeric New Undecided
    • gnumeric (Ubuntu) Triaged Low

Ubuntu Desktop amd64 - Install (entire disk)

  • 1029358 i915: artifacts on installer display

    • Ubuntu New Undecided

Ubuntu Desktop amd64 - Install (manual partitioning)

  • 441835 Clicking on floppy gives "no device media found"

    • obsolete Fix Released Medium
    • gvfs Unknown Medium
    • Linux Invalid Undecided
    • udev Invalid Undecided
    • udisks Confirmed Medium
    • devicekit-disks (Ubuntu) Invalid Medium
    • linux (Ubuntu) Invalid Medium
    • udisks (Ubuntu) Triaged High
    • devicekit-disks (Ubuntu Lucid) Invalid Medium
    • linux (Ubuntu Lucid) Invalid Medium
    • udisks (Ubuntu Lucid) Triaged High
    • devicekit-disks (Ubuntu Karmic) Won't Fix Medium
    • linux (Ubuntu Karmic) Invalid Undecided
    • udisks (Ubuntu Karmic) Invalid High
    • udisks (Arch Linux) New Undecided
    • udisks (Debian) Confirmed Unknown
  • 983681 Floppy keeps running forever after every access

    • Linux Confirmed Medium
    • linux (Ubuntu) Triaged Medium
  • 987418 manual partitioner: /dev/sdb (installation media) selected by default as device for boot loader installation

    • ubiquity (Ubuntu) Triaged High
    • ubiquity (Ubuntu Quantal) Triaged High
  • 1022726 Wrong drive letter during install of Quantal Alpha 2

    • ubiquity (Ubuntu) New High

Ubuntu Desktop amd64+mac - Install (manual partitioning)

  • 987418 manual partitioner: /dev/sdb (installation media) selected by default as device for boot loader installation

    • ubiquity (Ubuntu) Triaged High
    • ubiquity (Ubuntu Quantal) Triaged High

Ubuntu Server amd64 - Install (JeOS on KVM)

  • 1028453 Quantal Ubuntu Server minimal install oversized

    • ubuntu-meta (Ubuntu) Confirmed High

Ubuntu Server amd64 - iSCSI Authenticated Root Installation

  • 1028458 iSCSI root based servers appear to fail to boot completely

    • Ubuntu Confirmed High

Ubuntu Server amd64 - iSCSI Unauthenticated Root Installation

  • 1028458 iSCSI root based servers appear to fail to boot completely

    • Ubuntu Confirmed High

Ubuntu Server i386 - Install (JeOS on KVM)

  • 1028453 Quantal Ubuntu Server minimal install oversized

    • ubuntu-meta (Ubuntu) Confirmed High

Ubuntu Server i386 - Install (default + RAID1)

  • 1029407 Check disk for defects fail on MD5 checksum for A3 quantal i386 Server

    • debian-installer (Ubuntu) New Undecided

Ubuntu Server i386 - iSCSI Authenticated Root Installation

  • 1028458 iSCSI root based servers appear to fail to boot completely

    • Ubuntu Confirmed High

Ubuntu Server i386 - iSCSI Unauthenticated Root Installation

  • 1028458 iSCSI root based servers appear to fail to boot completely

    • Ubuntu Confirmed High

Xubuntu Alternate amd64 - Install (entire disk with encryption)

  • 1029032 Xubuntu 64 (Quantal) alternate install failed: libavformat53 unmet dependencies

    • xubuntu-meta (Ubuntu) Triaged Critical
    • xubuntu-meta (Ubuntu Quantal) Triaged Critical

Xubuntu Alternate amd64 - Install (entire disk)

  • 1016925 12.10 Alternate installer fails with libavformat53 unmet dependencies

    • xubuntu-meta (Ubuntu) Fix Released High
  • 1028611 Manually select "Xubuntu desktop" on alpha3 testing alternate

    • xubuntu-meta (Ubuntu) New Undecided
  • 1029032 Xubuntu 64 (Quantal) alternate install failed: libavformat53 unmet dependencies

    • xubuntu-meta (Ubuntu) Triaged Critical
    • xubuntu-meta (Ubuntu Quantal) Triaged Critical

Xubuntu Alternate i386 - Install (entire disk with encryption)

  • 1029032 Xubuntu 64 (Quantal) alternate install failed: libavformat53 unmet dependencies

    • xubuntu-meta (Ubuntu) Triaged Critical
    • xubuntu-meta (Ubuntu Quantal) Triaged Critical

Xubuntu Alternate i386 - Install (entire disk)

  • 1029032 Xubuntu 64 (Quantal) alternate install failed: libavformat53 unmet dependencies

    • xubuntu-meta (Ubuntu) Triaged Critical
    • xubuntu-meta (Ubuntu Quantal) Triaged Critical
  • 1029032 Xubuntu 64 (Quantal) alternate install failed: libavformat53 unmet dependencies

    • xubuntu-meta (Ubuntu) Triaged Critical
    • xubuntu-meta (Ubuntu Quantal) Triaged Critical

Xubuntu Desktop amd64 - Install (auto-resize)

  • 1010487 Xubuntu - black windows

    • ubiquity (Ubuntu) Confirmed High
  • 1027461 Xubuntu, installer locked in auto resize

    • ubiquity (Ubuntu) Confirmed Undecided

Xubuntu Desktop amd64 - Live Session

  • 1018598 menus of gtk3 applications under Xubuntu

    • gtk+3.0 (Ubuntu) Confirmed Undecided

Xubuntu Desktop i386 - Install (auto-resize)

  • 924909 Windows have grey traces in Ubiquity

    • metacity (Ubuntu) Confirmed Medium
    • xfwm4 (Ubuntu) Confirmed Medium
  • 1010487 Xubuntu - black windows

    • ubiquity (Ubuntu) Confirmed High
  • 1027461 Xubuntu, installer locked in auto resize

    • ubiquity (Ubuntu) Confirmed Undecided