## page was renamed from QATeam/AutomatedTesting/Ubiquity/InstallationTestCases
= Introduction =

This specification should outline both test cases for installation completion but also for expected failures such as low memory and under size HDD scenarios where the installation is not a possibility. This specification only outlines test cases concerned with the installation completing successfully, and not logical functionality of the installer itself, which is covered in the [[../StateTransitionTestCases|state transition testcases.]]

= Approval =

|| '''Author'''      ||                           ||               ||
|| Dan Chapman       || [[LaunchpadHome:dpniel ]] || Ubuntu Member ||
|| '''Approved By''' ||                           ||               ||
|| <name>            || < lp profile >            || < position >  ||
||                   ||                           ||               ||

= Related Documents =

|| '''Ref #''' || '''Document Name'''                            || '''Link''' ||
|| 01          || Installer Design - Ubuntu Installation Process || [[http://goo.gl/H12x6V]]      ||
|| 02          || Test Analysis and Specification for Ubiquity   ||[[https://wiki.ubuntu.com/QATeam/AutomatedTesting?action=AttachFile&do=get&target=Test+analysis+and+specification+for+Ubiquity.pdf|Automated testing for Ubiquity]]   ||
|| 03          || Ubiquity Test Plan    || [[https://wiki.ubuntu.com/QATeam/AutomatedTesting/Ubiquity|Ubiquity Test Plan]]      ||
|| 04          || State Transition Test Cases                    || ../StateTransitionTestCases   ||

<<TableOfContents(3)>>

= Considerations =
There are many factors that need to be taken into account for creation of these test cases,

|| '''Installation Type'''  || Default options <<BR>> LVM install <<BR>> LVM with encryption <<BR>> Custom partitioning <<BR>> Empty HDD <<BR>> Resize/other OS installed <<BR>> No swap <<BR>> Auto-resize <<BR>> Upgrade <<BR>> Erase and Re-install <<BR>> Re-Install saving user data <<BR>> OEM <<BR>> Free Software only ||
|| '''Connectivity'''       || Ethernet <<BR>> Wireless <<BR>> No Network ||
|| '''Memory'''             || Less Than Min Req <<BR>> Min Req <<BR>> Greater Than Min Req ||
|| '''Hard Drive Size'''    || Less Than Min Req <<BR>> Min Req <<BR>> Greater Than Min Req ||
|| '''Power Source'''       || Connected <<BR>> Battery ||
|| '''Localisation'''       || Different language choices||
|| '''File System Format''' || ext2 <<BR>> ext3 <<BR>> ext4 <<BR>> JFS <<BR>> XFS <<BR>> ReiserFS <<BR>> btrfs <<BR>> fat 16 <<BR>> fat 32 <<BR>> Swap <<BR>> Encrypted partition <<BR>> Empty partition ||

The combination of all these factors results in 1000’s of possible test cases, so we need to decide on a subset of scenarios.

In the next section I propose some 168 initial test case scenarios we should try and aim to achieve. A lot of the test cases are similar and will only need one or two arguments changing in the actual autopilot test case or the test case runner, so although there does seem a lot, in reality it won’t require too much extra effort to reach this initial goal.

= Installation Test Cases =

Test case names are in the format of

“!InstallScenario-InstalledOS-Connectivity-!TestCaseNumber”

Installed OS codes are as follows
|| '''F''' || *buntu flavor      ||
|| '''W''' || Windows OS         ||
|| '''M''' || Mac OS             ||
|| '''X''' || No OS / Empty HDD  ||
|| '''L''' || Other linux distro ||

And Connectivity,
|| '''Eth''' || Ethernet   ||
|| '''WF'''  || Wi-Fi      ||
|| '''NN'''  || No Network ||

The different connectivity options will only be used on test cases where we have an empty HDD, to test every scenario against each connection type is not very practical and basically triples our test case amount for every OS already installed on the HDD.

== Install Scenario 1 - Less Than System Requirements ==
We should test that we cannot install with less than the system requirements.
|| '''Test Cases''' || '''Details''' ||
|| IS1-X-Eth-TC1    || less than required memory <<BR>> Greater than or equal required HDD size ||
|| IS1-X-Eth-TC2    || less than required memory <<BR>> less than required HDD size ||
|| IS1-X-Eth-TC3    || greater than or equal required memory <<BR>> less than required HDD size ||

== Install Scenario 2 - Default Installation ==

|| '''Test Cases''' || '''Details''' ||
|| IS2-X-Eth-TC1 <<BR>> IS2-X-WF-TC2 <<BR>> IS2-X-NN-TC3 || English install <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS2-X-Eth-TC4 <<BR>> IS2-X-WF-TC5 <<BR>> IS2-X-NN-TC6 || Non-English install <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS2-X-Eth-TC7 <<BR>> IS2-X-WF-TC8 <<BR>> IS2-X-NN-TC9 || English install <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||
|| IS2-X-Eth-TC10 <<BR>> IS2-X-WF-TC11 <<BR>> IS2-X-NN-TC12 || Non-English install <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||

== Install Scenario 3 - LVM installation ==

|| '''Test Cases''' || '''Details''' ||
|| IS3-X-Eth-TC1 <<BR>> IS3-X-WF-TC2 <<BR>> IS3-X-NN-TC3 || English install <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS3-X-Eth-TC4 <<BR>> IS3-X-WF-TC5 <<BR>> IS3-X-NN-TC6 || Non-English install <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS3-X-Eth-TC7 <<BR>> IS3-X-WF-TC8 <<BR>> IS3-X-NN-TC9 || English install <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements||
|| IS3-X-Eth-TC10 <<BR>> IS3-X-WF-TC11 <<BR>> IS3-X-NN-TC12 || Non-English install <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||

== Install Scenario 4 - LVM with Encryption Installation ==

|| '''Test Cases''' || '''Details''' ||
|| IS4-X-Eth-TC1 <<BR>> IS4-X-WF-TC2 <<BR>> IS4-X-NN-TC3 || English install <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS4-X-Eth-TC4 <<BR>> IS4-X-WF-TC5 <<BR>> IS4-X-NN-TC6 || Non-English install <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS4-X-Eth-TC7 <<BR>> IS4-X-WF-TC8 <<BR>> IS4-X-NN-TC9 || English install <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||
|| IS4-X-Eth-TC10 <<BR>> IS4-X-WF-TC11 <<BR>> IS4-X-NN-TC12 || Non-English install <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||

== Install Scenario 5 - Custom/Manual Partition installation ==
With there being a mass amount of partitioning layout and file system formats we should try a subset of layouts and each FS type at least once, now i’m not sure that they should all be tested at the same time or continue with how the current tests are implemented. Which currently selects a random predefined configuration during each test run, this way at some point all the FS types will get tested and we have tried various layouts.
The current configurations can be seen [[http://bazaar.launchpad.net/~ubuntu-installer/ubiquity/trunk/view/head:/autopilot/ubiquity_autopilot_tests/configs/partconfig.py|here]], the majority of them naively assume we always have the default 12GB of space to play with. It would ideally be better to have seperate configurations for the minimum system requirements test cases, which the test cases below assume this to be true. 

This has been difficult to implement in non-english languages with autopilot due to relying on label values to navigate this section. But there are test cases for it to be implemented in the future should it become easier

|| '''Test Cases''' || '''Details''' ||
|| IS5-X-Eth-TC1 <<BR>> IS5-X-WF-TC2 <<BR>> IS5-X-NN-TC3 || English install <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements <<BR>> Random Config ||
|| IS5-X-Eth-TC4 <<BR>> IS5-X-WF-TC5 <<BR>> IS5-X-NN-TC6 || Non-English install <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements <<BR>> Random Config ||
|| IS5-X-Eth-TC7 <<BR>> IS5-X-WF-TC8 <<BR>> IS5-X-NN-TC9 || English install <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements <<BR>> Random Config ||
|| IS5-X-Eth-TC10 <<BR>> IS5-X-WF-TC11 <<BR>> IS5-X-NN-TC12 || Non-English install <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements <<BR>> Random Config ||

== Install Scenario 6 - Auto-Resize Installation ==

=== a) Using Default ===

|| '''Test Cases''' || '''Details''' ||
|| IS6a-F-Eth-TC1 <<BR>> IS6a-W-Eth-TC2 <<BR>> IS6a-M-Eth-TC3 <<BR>> IS6a-L-Eth-TC4 || English install <<BR>> Use default install options <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS6a-F-Eth-TC5 <<BR>> IS6a-W-Eth-TC6 <<BR>> IS6a-M-Eth-TC7 <<BR>> IS6a-L-Eth-TC8 || Non-English install <<BR>> Use default install options <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS6a-F-Eth-TC9 <<BR>> IS6a-W-Eth-TC10 <<BR>> IS6a-M-Eth-TC11 <<BR>> IS6a-L-Eth-TC12 || English install <<BR>> Use default install options <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||
|| IS6a-F-Eth-TC13 <<BR>> IS6a-W-Eth-TC14 <<BR>> IS6a-M-Eth-TC15 <<BR>> IS6a-L-Eth-TC16 || Non-English install <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||

=== b) Using LVM ===

|| '''Test Cases''' || '''Details''' ||
|| IS6b-F-Eth-TC1 <<BR>> IS6b-W-Eth-TC2 <<BR>> IS6b-M-Eth-TC3 <<BR>> IS6b-L-Eth-TC4 || English install <<BR>> Use LVM install options <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS6b-F-Eth-TC5 <<BR>> IS6b-W-Eth-TC6 <<BR>> IS6b-M-Eth-TC7 <<BR>> IS6b-L-Eth-TC8 || Non-English install <<BR>> Use LVM install options <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS6b-F-Eth-TC9 <<BR>> IS6b-W-Eth-TC10 <<BR>> IS6b-M-Eth-TC11 <<BR>> IS6b-L-Eth-TC12 || English install <<BR>> Use LVM install options <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||
|| IS6b-F-Eth-TC13 <<BR>> IS6b-W-Eth-TC14 <<BR>> IS6b-M-Eth-TC15 <<BR>> IS6b-L-Eth-TC16 || Non-English install <<BR>> Use LVM install options <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||

=== c) Using LVM with Encryption ===

|| '''Test Cases''' || '''Details''' ||
|| IS6b-F-Eth-TC1 <<BR>> IS6b-W-Eth-TC2 <<BR>> IS6b-M-Eth-TC3 <<BR>> IS6b-L-Eth-TC4 || English install <<BR>> Using LVM Encryption options <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS6b-F-Eth-TC5 <<BR>> IS6b-W-Eth-TC6 <<BR>> IS6b-M-Eth-TC7 <<BR>> IS6b-L-Eth-TC8 || Non-English install <<BR>> Using LVM Encryption options <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS6b-F-Eth-TC9 <<BR>> IS6b-W-Eth-TC10 <<BR>> IS6b-M-Eth-TC11 <<BR>> IS6b-L-Eth-TC12 || English install <<BR>> Using LVM Encryption options <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||
|| IS6b-F-Eth-TC13 <<BR>> IS6b-W-Eth-TC14 <<BR>> IS6b-M-Eth-TC15 <<BR>> IS6b-L-Eth-TC16 || Non-English install <<BR>> Using LVM Encryption options <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||


== Install Scenario 7 - Manual-Resize installation ==
We can use the same configs used in the custom partition page tests, we just need to resize to make enough space first.

|| '''Test Cases''' || '''Details''' ||
|| IS7-F-Eth-TC1 <<BR>> IS7-W-Eth-TC2 <<BR>> IS7-M-Eth-TC3 <<BR>> IS7-L-Eth-TC4 || English install <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements <<BR>> Random Config ||
|| IS7-F-Eth-TC5 <<BR>> IS7-W-Eth-TC6 <<BR>> IS7-M-Eth-TC7 <<BR>> IS7-L-Eth-TC8 || Non-English install   <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements <<BR>> Random Config ||
|| IS7-F-Eth-TC9 <<BR>> IS7-W-Eth-TC10 <<BR>> IS7-M-Eth-TC11 <<BR>> IS7-L-Eth-TC12 || English install <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements <<BR>> Random Config ||
|| IS7-F-Eth-TC13 <<BR>> IS7-W-Eth-TC14 <<BR>> IS7-M-Eth-TC15 <<BR>> IS7-L-Eth-TC16 || Non-English install <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements <<BR>> Random Config ||

== Install Scenario 8 - Erase & Re-Install ==

=== a) Using Default ===

|| '''Test Cases''' || '''Details''' ||
|| IS8a-F-Eth-TC1 <<BR>> IS8a-W-Eth-TC2 <<BR>> IS8a-M-Eth-TC3 <<BR>> IS8a-L-Eth-TC4 || English install <<BR>> Use default install options <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS8a-F-Eth-TC5 <<BR>> IS8a-W-Eth-TC6 <<BR>> IS8a-M-Eth-TC7 <<BR>> IS8a-L-Eth-TC8 || Non-English install <<BR>> Use default install options <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS8a-F-Eth-TC9 <<BR>> IS8a-W-Eth-TC10 <<BR>> IS8a-M-Eth-TC11 <<BR>> IS8a-L-Eth-TC12 || English install <<BR>> Use default install options <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||
|| IS8a-F-Eth-TC13 <<BR>> IS8a-W-Eth-TC14 <<BR>> IS8a-M-Eth-TC15 <<BR>> IS8a-L-Eth-TC16 || Non-English install <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||

=== b) Using LVM ===

|| '''Test Cases''' || '''Details''' ||
|| IS8b-F-Eth-TC1 <<BR>> IS8b-W-Eth-TC2 <<BR>> IS8b-M-Eth-TC3 <<BR>> IS8b-L-Eth-TC4 || English install <<BR>> Use LVM install options <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS8b-F-Eth-TC5 <<BR>> IS8b-W-Eth-TC6 <<BR>> IS8b-M-Eth-TC7 <<BR>> IS8b-L-Eth-TC8 || Non-English install <<BR>> Use LVM install options <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS8b-F-Eth-TC9 <<BR>> IS8b-W-Eth-TC10 <<BR>> IS8b-M-Eth-TC11 <<BR>> IS8b-L-Eth-TC12 || English install <<BR>> Use LVM install options <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||
|| IS8b-F-Eth-TC13 <<BR>> IS8b-W-Eth-TC14 <<BR>> IS8b-M-Eth-TC15 <<BR>> IS8b-L-Eth-TC16 || Non-English install <<BR>> Use LVM install options <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||

=== c) Using LVM with Encryption ===

|| '''Test Cases''' || '''Details''' ||
|| IS8c-F-Eth-TC1 <<BR>> IS8c-W-Eth-TC2 <<BR>> IS8c-M-Eth-TC3 <<BR>> IS8c-L-Eth-TC4 || English install <<BR>> Using LVM Encryption options <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS8c-F-Eth-TC5 <<BR>> IS8c-W-Eth-TC6 <<BR>> IS8c-M-Eth-TC7 <<BR>> IS8c-L-Eth-TC8 || Non-English install <<BR>> Using LVM Encryption options <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS8c-F-Eth-TC9 <<BR>> IS8c-W-Eth-TC10 <<BR>> IS8c-M-Eth-TC11 <<BR>> IS8c-L-Eth-TC12 || English install <<BR>> Using LVM Encryption options <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||
|| IS8c-F-Eth-TC13 <<BR>> IS8c-W-Eth-TC14 <<BR>> IS8c-M-Eth-TC15 <<BR>> IS8c-L-Eth-TC16 || Non-English install <<BR>> Using LVM Encryption options <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||

== Install Scenario 9 - Upgrade Installation ==

|| '''Test Cases''' || '''Details''' ||
|| IS9-F-Eth-TC1 || English upgrade <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS9-F-Eth-TC2 || Non-English upgrade <<BR>> Minimum Memory Requirements <<BR>> Minimum HDD Requirements ||
|| IS9-F-Eth-TC3 || English upgrade <<BR>> > Memory Requirements <<BR>> > Minimum HDD Requirements ||
|| IS9-F-Eth-TC4 || Non-English upgrade <<BR>> > Minimum Memory Requirements <<BR>> > Minimum HDD Requirements ||

== Install Scenario 10 - Re-Install Re-Using Home Installation ==
Todo at later date
== Install Scenario 11 - OEM Installation ==
Todo at later date
== Install Scenario 12 - Free Software Only Installation ==
Todo at later date