KernelSRU-EC2

Differences between revisions 5 and 6
⇤ ← Revision 5 as of 2011-01-05 20:16:42 →
Size: 2096
Editor: pool-173-64-203-126
Comment: initial version
← Revision 6 as of 2011-01-05 20:27:13 → ⇥
Size: 4277
Editor: pool-173-64-203-126
Comment: initial version
Deletions are marked like this. Additions are marked like this.
Line 3: Line 3:

---- /!\ '''Edit conflict - other version:''' ----
Line 44: Line 46:

---- /!\ '''Edit conflict - your version:''' ----
=== Coverage ===
 - At least test m1.small (i386) and m1.large (amd64) in us-east-1
 - more ideal would be testing across all 4 regions and better coverage across instance types
=== Testing the kernel ===
Note: The following tests are all part of the "QA Regression Test Suite", as defined at the Test Automation Sprint.
==== Autotest ====
1. SSH into it

2. sudo apt-get install build-essential make (kernel.org)

3. {{{wget http://test.kernel.org/releases/0.12.0/autotest-client-0.12.0.tar.bz2}}} (kernel.org autotest client)

 1. tar -xjf the beast
 1. (autotest-1) run {{{autotest-0.12.0/bin/autotest tests/dbench/control > test-dbench.out 2>&1}}}
 1. (autotest-2) run {{{autotest-0.12.0/bin/autotest tests/tbench/control > test-tbench.out 2>&1}}}
 1. (autotest-3) run {{{autotest-0.12.0/bin/autotest tests/signaltest/control > test-signaltest.out 2>&1}}}
 1. (autotest-4) run {{{sudo autotest-0.12.0/bin/autotest tests/tiobench/control > test-tiobench.out 2>&1}}}
 1. (autotest-4) run {{{sudo autotest-0.12.0/bin/autotest tests/real_time_tests/control > test-real_time_tests.out 2>&1}}}
4. save the logs: {{{tar -cjf autotest.tar.bz2 test*.out}}}

5. from your machine, grab the results tarball: {{{scp ubuntu@<ec2-instance>:autotest.tar.bz2}}}

==== QA Regression Testing ====

/!\: We should call this something else, since it's confusing to call it the "QA Regression Testing". It's now only one test in the "QA Regression Test Suite"
1. SSH into it
2. bzr branch lp:qa-regression-testing
 1. cd qa-regression-testing/scripts
 1. run the scripts:
  * {{{python test-kernel-aslr-collisions.py -v }}}
  * {{{python test-kernel.py -v}}}
  * {{{sudo python test-kernel-root-ops.py -v}}}
  * {{{sudo python test-kernel-security.py -v (requires execstack, libcap2-bin)}}}

==== LTP =====

1. SSH into it

2. {{{sudo apt-get install ltp}}}

3. run {{{sudo /usr/lib/ltp/tools/runltp -f ltplite -l /var/cache/ltp/results/runltplite.log -o /var/cache/ltp/results/runltplite-results.txt}}}

---- /!\ '''End of edit conflict''' ----

Contents

  1. Coverage
  2. Testing the kernel
  3. Coverage
  4. Testing the kernel

Warning /!\ Edit conflict - other version:

Coverage

  • - At least test m1.small (i386) and m1.large (amd64) in us-east-1 - more ideal would be testing across all 4 regions and better coverage across instance types

Testing the kernel

Note: The following tests are all part of the "QA Regression Test Suite", as defined at the Test Automation Sprint.

Autotest

1. SSH into it

2. sudo apt-get install build-essential make (kernel.org)

3. wget  http://test.kernel.org/releases/0.12.0/autotest-client-0.12.0.tar.bz2 (kernel.org autotest client)

  1. tar -xjf the beast

  2. (autotest-1) run autotest-0.12.0/bin/autotest tests/dbench/control > test-dbench.out 2>&1

  3. (autotest-2) run autotest-0.12.0/bin/autotest tests/tbench/control > test-tbench.out 2>&1

  4. (autotest-3) run autotest-0.12.0/bin/autotest tests/signaltest/control > test-signaltest.out 2>&1

  5. (autotest-4) run sudo autotest-0.12.0/bin/autotest tests/tiobench/control > test-tiobench.out 2>&1

  6. (autotest-4) run sudo autotest-0.12.0/bin/autotest tests/real_time_tests/control > test-real_time_tests.out 2>&1

4. save the logs: tar -cjf autotest.tar.bz2 test*.out

5. from your machine, grab the results tarball: scp ubuntu@<ec2-instance>:autotest.tar.bz2

QA Regression Testing

/!\: We should call this something else, since it's confusing to call it the "QA Regression Testing". It's now only one test in the "QA Regression Test Suite" 1. SSH into it 2. bzr branch lp:qa-regression-testing

  1. cd qa-regression-testing/scripts
  2. run the scripts:

    • python test-kernel-aslr-collisions.py -v 

    • python test-kernel.py -v

    • sudo python test-kernel-root-ops.py -v

    • sudo python test-kernel-security.py -v (requires execstack, libcap2-bin)

==== LTP =====

1. SSH into it

2. sudo apt-get install ltp

3. run sudo /usr/lib/ltp/tools/runltp -f ltplite -l /var/cache/ltp/results/runltplite.log -o /var/cache/ltp/results/runltplite-results.txt

Warning /!\ Edit conflict - your version:

Coverage

  • - At least test m1.small (i386) and m1.large (amd64) in us-east-1 - more ideal would be testing across all 4 regions and better coverage across instance types

Testing the kernel

Note: The following tests are all part of the "QA Regression Test Suite", as defined at the Test Automation Sprint.

Autotest

1. SSH into it

2. sudo apt-get install build-essential make (kernel.org)

3. wget  http://test.kernel.org/releases/0.12.0/autotest-client-0.12.0.tar.bz2 (kernel.org autotest client)

  1. tar -xjf the beast

  2. (autotest-1) run autotest-0.12.0/bin/autotest tests/dbench/control > test-dbench.out 2>&1

  3. (autotest-2) run autotest-0.12.0/bin/autotest tests/tbench/control > test-tbench.out 2>&1

  4. (autotest-3) run autotest-0.12.0/bin/autotest tests/signaltest/control > test-signaltest.out 2>&1

  5. (autotest-4) run sudo autotest-0.12.0/bin/autotest tests/tiobench/control > test-tiobench.out 2>&1

  6. (autotest-4) run sudo autotest-0.12.0/bin/autotest tests/real_time_tests/control > test-real_time_tests.out 2>&1

4. save the logs: tar -cjf autotest.tar.bz2 test*.out

5. from your machine, grab the results tarball: scp ubuntu@<ec2-instance>:autotest.tar.bz2

QA Regression Testing

/!\: We should call this something else, since it's confusing to call it the "QA Regression Testing". It's now only one test in the "QA Regression Test Suite" 1. SSH into it 2. bzr branch lp:qa-regression-testing

  1. cd qa-regression-testing/scripts
  2. run the scripts:

    • python test-kernel-aslr-collisions.py -v 

    • python test-kernel.py -v

    • sudo python test-kernel-root-ops.py -v

    • sudo python test-kernel-security.py -v (requires execstack, libcap2-bin)

==== LTP =====

1. SSH into it

2. sudo apt-get install ltp

3. run sudo /usr/lib/ltp/tools/runltp -f ltplite -l /var/cache/ltp/results/runltplite.log -o /var/cache/ltp/results/runltplite-results.txt

Warning /!\ End of edit conflict

QATeam/KernelSRU-EC2 (last edited 2011-01-06 11:19:54 by pc-2-14-161-190)