RequiredTests

Differences between revisions 26 and 27
Revision 26 as of 2012-12-10 08:20:43
Size: 5127
Editor: jibel
Comment:
Revision 27 as of 2012-12-10 08:40:44
Size: 5228
Editor: jibel
Comment:
Deletions are marked like this. Additions are marked like this.
Line 81: Line 81:
|| apt-clone || || ||
|| bzr || andrewsomething || ([[http://bazaar.launchpad.net/~ubuntu-branches/ubuntu/raring/bzr/raring/view/head:/debian/tests/testsuite|isn't this already in place?]]) ||
|| apt-clone || jibel || ||
|| bzr || andrewsomething || ([[http://bazaar.launchpad.net/~ubuntu-branches/ubuntu/raring/bzr/raring/view/head:/debian/tests/testsuite|isn't this already in place?]]) jibel: selftest runs as part of the build, but not against the package as installed on a system||

Introduction

autopkgtest tests can be very easily integrated into existing source packages and easily test-run locally. http://developer.ubuntu.com/packaging/html/auto-pkg-test.html shows how to easily get started with this kind of tests.

If you decide to work on one of the tests, please add @SIG@ behind the package in question and if you submitted a test-case for review already, you might want to add a link to it.

Required Tests

For the following packages we require autopkgtest tests.

simple compile/link/run tests

The idea here is to test if we can easily compile and link against these libraries and run some very basic code.

The following tests might serve as inspiration:

For these libraries we require tests:

Library

Who

Status

libdconf-dev

rafalcieslak256

libatk1.0-dev

libgdk-pixbuf2.0-dev

rafalcieslak256 2012-10-31 21:36:30

libmysqlclient-dev

libwebkitgtk-3.0-dev

libgstreamer0.10-dev, libgstreamer-plugins-base0.10-dev

libnux-3.0-dev

libunity-core-6.0-dev, libunity-dev

libindicator3-dev

libsoup2.4-dev

librsvg2-dev

libsecret-1-dev

libarchive-dev

libdbusmenu-glib-dev, libdbusmenu-gtk3-dev

libgdata-dev

libical-dev

libpoppler-dev

libcairo2-dev

rafalcieslak256 2012-10-30 22:30:00

libfolks-dev

libtelepathy-glib-dev

libtelepathy-qt4-dev

libbluetooth-dev

libmessaging-menu-dev

libpulse-dev

libqt4-dev

libvte-2.90-dev

libaccountsservice-dev

libbamf3-dev

libfluidsynth-dev

rafalcieslak256 2012-10-30 22:30:00

libasound2-dev

rafalcieslak256 2012-10-30 22:30:00

libpng12-dev

rafalcieslak256 2012-10-31 21:36:30

libpango1.0-dev

rafalcieslak256 2012-10-31 21:36:30

functionality tests

The following packages don't have tests at all. It'd be great to let tests exercise the most common functionality and workflow (ie. for d-conf this might be: check reading, writing of schema keys, handling of invalid values for types, and schema creation/compilation, for a lens this might be: create a temporary home directory with some files, and check that these files are found).

Library

Who

Status

gzip

dholbach 2012-10-30 20:06:29

More generic test required in Debian: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=693691

d-conf

unity-lens-files

unity-lens-photos

unity-applications-daemon

indicator-session

indicator-messages

valac (we support several versions with a metapackage, ensure that this pulls in everything required)

evince (autopilot: open a simple PDF, scroll through it, verify that it is displaying something)

eog (autopilot: open various kinds of images, change between them with mouse and cursor, verify that it is displaying something)

run upstream test suite against system installed packages

What we want to do here is to get the upstream test suite run as part of the autopkgtest.

This is what's done here as well: || Example: ubiquity tests

For the following tests we want to run upstream test-suites:

Library

Who

Status

apt

apt-clone

jibel

bzr

andrewsomething

(isn't this already in place?) jibel: selftest runs as part of the build, but not against the package as installed on a system

python-launchpadlib

mysql-5.5

ubuntuone

bamf

nbd

webkit

fixing existing tests

Red ones on https://jenkins.qa.ubuntu.com/view/Raring/view/AutoPkgTest/ ; there are a few which never succeeded

Library

Who

Status

maas

network-manager

software-center

ubuntu-release-upgrader

unity-firefox-extension

update-manager

QATeam/RequiredTests (last edited 2013-12-03 12:19:20 by dholbach)