Ubuntu QA 9.10 Roadmap

Bugs

Triage

• Specialization Within bug-control

  • Encouraging specialisation and mentoring in bug-control. High PedroVillavicencio

• Package Greasemonkey Scripts

  • Create a native Ubuntu package and/or a team PPA. - Medium BrianMurray

Tracking & Fixing

• Fixing Bugs With Patches

  • A session with engineering teams on processing bugs with patches attached. High (i) BrianMurray

• Regression Immunisation

  • Put in place procedures to discover major upstream infrastructure changes early and chart the regression potential inherent in these for our users. Use this information at around Feature Freeze to decide whether to push out the new changes or roll back. High (i) DaveMurphy

Apport

• Increase Apport Adoption

  • Adjust documentation and Launchpad functionality to steer more people towards using apport. Push back on various groups in turn to file correctly. Essential HenrikOmma

• Increase Apport Coverage

  • The QA team will drive an effort to extend coverage of apport hooks to all core Ubuntu components. Medium (i) BrianMurray

• Apport In ubuntu-server

  • Discussion with server team about including apport by default as well as increasing Apport coverage for server packages. Medium SteveBeattie

Testing

Test coverage

• Expand Test Coverage

  • What tests do we need to include, and how to test them e.g. Webcam, Audio, Printing, etc. General spec for tracking extending test coverage. Essential RonaldMcCollam

• Extended Audio Testing

  • Extend both manual and automated test cases to test a range of use cases and hardware configurations on a regular basis. High RonaldMcCollam

• Suspend-Resume Testing

  • Integrate the kernel team's suspend-resume script more fully in the certification test setup, both as a fully automated and as a prompted test. High LeannOgasawara

• Daily Desktop Testing

  • Add desktop tests to the daily hardware testing schedule on laptops and netbooks. High EitanIsaacson

Install & upgrade

• Install From Live CD Images

  • Uses Ubiquity pre-seeding. Essential MarcTardif

• Package Testing

  • Setting up regular conflict-checker runs. High RonaldMcCollam

• Distribution Upgrade Testing

  • Automated or semi-automated test distribution upgrades (i.e. jaunty -> Karmic). Coordination with Michael Vogt who already does some automated tests. Medium SteveBeattie

• UNR Testing Automation

  • Perform install testing of UNR on all laptop and netbook class devices as part of a regula - Put in place procedures to discover major upstream infrastructure changes earlyr rotation of flavours. Incorporate automated desktop UNR tests from the OEM team. PaulLarson (Mobile team QA)

Infrastructure

• Metrics Based Testing

  • Track the evolution of certain parameters such as boot speed and power usage that may not have a clear pass/fail threshold but for which historical data is desireable. We will extend out infrastructure to collect and display such data. Essential MarcTardif

• Virtual Testing Environments

  • Use regularly updated KVM instances that can be downloaded with various versions of Ubuntu for testing and debugging. Also consider instances that people can log into remotely. Medium SteveBeattie

• Testing Weather Report

  • A web application similar to the Ubuntu release weather report (https://blueprints.launchpad.net/ubuntu/+spec/developer-weather-report) oriented towards Ubuntu pre-release testers that will display various bits of relevant information on the state of the development branch (archive integrity, ongoing library transitions, high-impact bugs, critical or high importance bugs in core components, daily image health and build status, new packages, updates in components related to release goals, calls for testing by developers, etc.) Medium MuratGüneş

• Testing Sequencing And Management

  • How we can improve test sequencing - e.g. re-running tests after a suspend/resume test - and management - e.g. resuming the test sequence after a crash.

• Integrating Test Suites in Checkbox Using Filters

  • Use a filter pattern to integrate suites and metrics testing. - Medium MarcTardif