OpenSolaris Test Execution Platform

OSTEP - OpenSolaris Test Execution Platform

What is OSTEP?

OSTEP is the open source version of the Solaris Test Execution Project (STEP).
OSTEP is a powerful automated test execution framework that allows users to select,
configure and automatically run test suites on physical and virtual test machines. 

Currently OSTEP comprises the following:

Command Line Interface - Used to kick off tests.
Framework Driver - Used to run tests on test systems.
Testsuites - Selection of OpenSolaris functional tests.
Results Webapp - Used to display test results.

The goal of OSTEP is to make executing any of these testsuites as simple and as
painless as possible. It does this through standardisation of testsuite execution and
results reporting, the use of an intuitive command line interface, and the ability
to generate batch files that enable multiple test tasks to be run automatically.

Results from each test run will be uploaded to a central mysql database for easy
perusal at ostep.

OSTEP operates under the following terms and conditions.

How To Use OSTEP

Testfarm/OSTEP Quick Guide

Note: You will have to have a valid opensolaris.org username.

1. Reserve the number of systems you require for testing using the Testfarm
   Reservation webtool - Here.

2. Register your username with the ostep server. Follow the link listed
  Here and click on the "Servers" button

   Click "Add Account" at the "OSTEP Test Execution Server" column.

3. ssh onto your reserved OSTEP server system.

4. Run OSTEP

   Answer questions when you are prompted. SUT means 'System Under Test'. SUT1 would relate
   to the Client Test system you reserved via the Testfarm. SUT2 would relate to the Server.

Note: Please use the IP Address of Test System for SUT_HOSTNAME

   Users may user 'step' or 'ostep' to run any of the following commands.

For a full list of options OSTEP can take, please type 'ostep'
  

To kick off a test, please type 'ostep start'
  

To monitor execution of your test, please type 'ostep log [stepid]'

To view the ostep report for a testrun, type 'ostep summary [stepid]'
  

To List all previous test executions, please type 'ostep list'
  

OSTEP Tests

Update (Apr 29th 2009)
The smf testsuite is now available for Local Zones testing.

Note (March 31st 2009)
Initially, in addition to the tools and infrastructure, we shall be making
three open-sourced test-suites available. We plan to add 11 further test-suites
over the next few weeks as the required systems are added to the testfarm.
Expect email notification when this is complete.

There are currently 14 Solaris Testsuites available in OSTEP format. This list
will grow as more suites are ported to OpenSolaris. 

• 
  
  • Table listing testsuites verified to run on system types

Table listing Testsuites by OpenSolaris test area.

Viewing Results

You can view all your OSTEP test results Here

Future

Phase 2 of OSTEP is to make the ostep tools and tests available for download
from opensolaris.org (in IPS format). We hope to have this complete by the end
of May 2009.