KernelSRU-EC2

Differences between revisions 6 and 15 (spanning 9 versions)
⇤ ← Revision 6 as of 2011-01-05 20:27:13 →
Size: 4277
Editor: pool-173-64-203-126
Comment: initial version
← Revision 15 as of 2011-01-06 11:19:54 → ⇥
Size: 2327
Editor: pc-2-14-161-190
Comment:
Deletions are marked like this. Additions are marked like this.
Line 4: Line 4:
---- /!\ '''Edit conflict - other version:''' ----
Line 7: Line 6:
Line 10: Line 10:
==== Autotest ====
==== Setup ====
Line 13: Line 15:
2. sudo apt-get install build-essential make (kernel.org) 2. {{{sudo apt-get install build-essential make bzr libc6-dev-i386 execstack libcap2-bin exim4}}}

==== Autotest ====
Line 18: Line 22:
 1. (autotest-1) run {{{autotest-0.12.0/bin/autotest tests/dbench/control > test-dbench.out 2>&1}}}
 1. (autotest-2) run {{{autotest-0.12.0/bin/autotest tests/tbench/control > test-tbench.out 2>&1}}}
 1. (autotest-3) run {{{autotest-0.12.0/bin/autotest tests/signaltest/control > test-signaltest.out 2>&1}}}
 1. (autotest-4) run {{{sudo autotest-0.12.0/bin/autotest tests/tiobench/control > test-tiobench.out 2>&1}}}
 1. (autotest-4) run {{{sudo autotest-0.12.0/bin/autotest tests/real_time_tests/control > test-real_time_tests.out 2>&1}}}		  1. (autotest-1) run {{{autotest-client-0.12.0/bin/autotest autotest-client-0.12.0/tests/dbench/control > test-dbench.out 2>&1}}}
 1. (autotest-2) run {{{autotest-client-0.12.0/bin/autotest autotest-client-0.12.0/tests/tbench/control > test-tbench.out 2>&1}}}
 1. (autotest-3) run {{{autotest-client-0.12.0/bin/autotest autotest-client-0.12.0/tests/signaltest/control > test-signaltest.out 2>&1}}}
 1. (autotest-4) run {{{sudo autotest-client-0.12.0/bin/autotest autotest-client-0.12.0/tests/tiobench/control > test-tiobench.out 2>&1}}}
 1. (autotest-4) run {{{sudo autotest-client-0.12.0/bin/autotest autotest-client-0.12.0/tests/real_time_tests/control > test-real_time_tests.out 2>&1}}}
Line 29: Line 33:
/!\: We should call this something else, since it's confusing to call it the "QA Regression Testing". It's now only one test in the "QA Regression Test Suite" /!\ We should call this something else, since it's confusing to call it the "QA Regression Testing". It's now only one test in the "QA Regression Test Suite"
Line 31: Line 36:
2. bzr branch lp:qa-regression-testing
 1. cd qa-regression-testing/scripts
2. {{{bzr branch lp:qa-regression-testing}}}
 1. {{{cd qa-regression-testing/scripts}}}
Line 39: Line 45:
==== LTP ===== ==== LTP ====
Line 46: Line 52:

---- /!\ '''Edit conflict - your version:''' ----
=== Coverage ===
 - At least test m1.small (i386) and m1.large (amd64) in us-east-1
 - more ideal would be testing across all 4 regions and better coverage across instance types
=== Testing the kernel ===
Note: The following tests are all part of the "QA Regression Test Suite", as defined at the Test Automation Sprint.
==== Autotest ====
1. SSH into it

2. sudo apt-get install build-essential make (kernel.org)

3. {{{wget http://test.kernel.org/releases/0.12.0/autotest-client-0.12.0.tar.bz2}}} (kernel.org autotest client)

 1. tar -xjf the beast
 1. (autotest-1) run {{{autotest-0.12.0/bin/autotest tests/dbench/control > test-dbench.out 2>&1}}}
 1. (autotest-2) run {{{autotest-0.12.0/bin/autotest tests/tbench/control > test-tbench.out 2>&1}}}
 1. (autotest-3) run {{{autotest-0.12.0/bin/autotest tests/signaltest/control > test-signaltest.out 2>&1}}}
 1. (autotest-4) run {{{sudo autotest-0.12.0/bin/autotest tests/tiobench/control > test-tiobench.out 2>&1}}}
 1. (autotest-4) run {{{sudo autotest-0.12.0/bin/autotest tests/real_time_tests/control > test-real_time_tests.out 2>&1}}}
4. save the logs: {{{tar -cjf autotest.tar.bz2 test*.out}}}

5. from your machine, grab the results tarball: {{{scp ubuntu@<ec2-instance>:autotest.tar.bz2}}}

==== QA Regression Testing ====

/!\: We should call this something else, since it's confusing to call it the "QA Regression Testing". It's now only one test in the "QA Regression Test Suite"
1. SSH into it
2. bzr branch lp:qa-regression-testing
 1. cd qa-regression-testing/scripts
 1. run the scripts:
  * {{{python test-kernel-aslr-collisions.py -v }}}
  * {{{python test-kernel.py -v}}}
  * {{{sudo python test-kernel-root-ops.py -v}}}
  * {{{sudo python test-kernel-security.py -v (requires execstack, libcap2-bin)}}}

==== LTP =====

1. SSH into it

2. {{{sudo apt-get install ltp}}}

3. run {{{sudo /usr/lib/ltp/tools/runltp -f ltplite -l /var/cache/ltp/results/runltplite.log -o /var/cache/ltp/results/runltplite-results.txt}}}

---- /!\ '''End of edit conflict''' ----

Contents

  1. Coverage
  2. Testing the kernel

Coverage

  • - At least test m1.small (i386) and m1.large (amd64) in us-east-1 - more ideal would be testing across all 4 regions and better coverage across instance types

Testing the kernel

Note: The following tests are all part of the "QA Regression Test Suite", as defined at the Test Automation Sprint.

Setup

1. SSH into it

2. sudo apt-get install build-essential make bzr libc6-dev-i386 execstack libcap2-bin exim4

Autotest

3. wget  http://test.kernel.org/releases/0.12.0/autotest-client-0.12.0.tar.bz2 (kernel.org autotest client)

  1. tar -xjf the beast

  2. (autotest-1) run autotest-client-0.12.0/bin/autotest autotest-client-0.12.0/tests/dbench/control > test-dbench.out 2>&1

  3. (autotest-2) run autotest-client-0.12.0/bin/autotest autotest-client-0.12.0/tests/tbench/control > test-tbench.out 2>&1

  4. (autotest-3) run autotest-client-0.12.0/bin/autotest autotest-client-0.12.0/tests/signaltest/control > test-signaltest.out 2>&1

  5. (autotest-4) run sudo autotest-client-0.12.0/bin/autotest autotest-client-0.12.0/tests/tiobench/control > test-tiobench.out 2>&1

  6. (autotest-4) run sudo autotest-client-0.12.0/bin/autotest autotest-client-0.12.0/tests/real_time_tests/control > test-real_time_tests.out 2>&1

4. save the logs: tar -cjf autotest.tar.bz2 test*.out

5. from your machine, grab the results tarball: scp ubuntu@<ec2-instance>:autotest.tar.bz2

QA Regression Testing

Warning /!\ We should call this something else, since it's confusing to call it the "QA Regression Testing". It's now only one test in the "QA Regression Test Suite"

1. SSH into it

2. bzr branch lp:qa-regression-testing

  1. cd qa-regression-testing/scripts

  2. run the scripts:

    • python test-kernel-aslr-collisions.py -v 

    • python test-kernel.py -v

    • sudo python test-kernel-root-ops.py -v

    • sudo python test-kernel-security.py -v (requires execstack, libcap2-bin)

LTP

1. SSH into it

2. sudo apt-get install ltp

3. run sudo /usr/lib/ltp/tools/runltp -f ltplite -l /var/cache/ltp/results/runltplite.log -o /var/cache/ltp/results/runltplite-results.txt

QATeam/KernelSRU-EC2 (last edited 2011-01-06 11:19:54 by pc-2-14-161-190)