Views:

Overview

Follow the steps in this article to set up a Test Runner record that will automatically execute Tests on a schedule that you define.

Prerequisites

For this article you will need to have installed and configured the North52 Calculator Demo solution, and created a number of Tests.

Create the Test Runner record

  • Open the North52 Decision Suite app
  • Navigate to TestShield > Test Runner
  • Click New
  • On the Test Runner tab:
    • Expand the Demo Calculator Test Plan
    • Expand the Calculations Test Suite
    • Check all the Tests you wish to include in your Test Runner
  • Select the Test Runner Settings tab
    • Change the Name to Test Runner - Demo Calculator Tests
    • Leave the Start DateTime as it is (for this exercise we want the first run to execute immediately)
    • Change the Frequency to Daily
  • Click Save

Start the Test Runner

Each Test Runner record must be started for the scheduled Tests to be executed. 

  • Select N52 Commands > Start Test Runner from the form command bar
    • A pop up dialog will show and then close once the Test Runner has been started

You can monitor the progress of the Test Runner and Test processes from Settings > System Jobs

Test Results

After the Tests have completed, select the Test Runner Results tab to view the results from all the Tests included in the Test Runner.

Look for any failures - two of the tests above are showing failures. Open the Test Result record to view the detail:

  • In the JSON Test Results section we can see that the first step failed - this is because the expected value in the Assert tab is incorrect 

  • Additional detail showing the full trace of the test run can be found on the Test Trace tab

Stop the Test Runner

The Test Runner will continue to execute daily until it is manually stopped. To do this:

  • Open the Test Runner record
  • Select N52 Commands > Stop Test Runner from the form command bar
    • A pop up dialog will show and then close once the Test Runner has been stopped