RoadMap

Revision 15 as of 2009-06-05 10:12:05

Clear message

Ubuntu QA 9.10 Roadmap

Apport

  • Increase Apport Coverage - The QA team will drive an effort to extend coverage of apport hooks to all core Ubuntu components. Medium (i) BrianMurray

  • Increase Apport Adoption - Adjust documentation and Launchpad functionality to steer more people towards using apport. Push back on various groups in turn to file correctly. Essential HenrikOmma

  • Extend Apport Functionality - Some bugs require more information than just automatically attaching system logs to a bug. Some bugs (eg suspend/resume bugs) also need a series of questions to also be answered. Checkbox already provides this type of functionality. It would be good to investigate how to extend apport to leverage checkbox.

  • Apport In ubuntu-server - discussion with server team about including apport by default as well as increasing Apport coverage for server packages. Medium SteveBeattie

Bugs

Testing

Extend test coverage

  • Metrics Based Testing - All our current testing is a binary pass/fail but we would also like to track the evolution of certain parameters such as boot speed and power usage that may not have a clear pass/fail threshold but for which historical data is desireable. We will extend out infrastructure to collect and analyse such data. Essential MarcTardif

  • Install From Live CD Images - Uses Ubiquity pre-seeding. Essential MarcTardif

  • Virtual Testing Environments - Explore using regularly updated KVM instances that can be downloaded with various versions of Ubuntu for testing and debugging use. Alternatively consider EC2 instances that people can log into remotely. Medium SteveBeattie

  • Package Testing - Setting up regular conflict-checker runs. High RonaldMcCollam

  • Distribution Upgrade Testing - automated or semi-automated test distribution upgrades (i.e. jaunty -> Karmic). Coordination with Michael Vogt who already does some automated tests. Medium SteveBeattie

  • UNR Testing Automation - Perform install testing of UNR on all laptop and netbook class devices as part of a regula - Put in place procedures to discover major upstream infrastructure changes earlyr rotation of flavours. Incorporate automated desktop UNR tests from the OEM team. PaulLarson (Mobile team QA)

Tracking & monitoring

  • Regression Immunisation - Put in place procedures to discover major upstream infrastructure changes early and chart the regression potential inherent in these for our users. Use this information at around Feature Freeze to decide whether to push out the new changes or roll back. High (i) SteveBeattie

  • Testing Weather Report - A web application similar to the Ubuntu release weather report (https://blueprints.launchpad.net/ubuntu/+spec/developer-weather-report) oriented towards Ubuntu pre-release testers that will display various bits of relevant information on the state of the development branch (archive integrity, ongoing library transitions, high-impact bugs, critical or high importance bugs in core components, daily image health and build status, new packages, updates in components related to release goals, calls for testing by developers, etc.) Medium MuratGüneş

QA tools

  • Package Greasemonkey Scripts - The Launchpad greasemonkey scripts project seems like a useful one and could help bug triagers a lot however there is no package to install these scripts. The easiest thing to do would be to find a way to package the greasemonkey scripts and have them installed in the right place. Alternatively, perhaps the greasemonkey scripts should be modified into an extension which then can be packaged. Medium BrianMurray

Checkbox