Chapter 5. Using Tempest

Run the commands in this section to perform various test operations. You can also combine multiple options in a single tempest run command.

5.1. Listing Available Tests

Run the tempest-run command with either the --list-tests or -l options to get a list of available tempest tests:

# tempest run -l

5.2. Running Smoke Tests

Smoke testing is a type of preliminary testing which only covers the most important functionality. While they are not comprehensive, running smoke tests can save time if they do identify a problem.

# tempest run --smoke

5.3. Passing Tests Using Whitelist Files

A whitelist file is a file that contains regular expressions to select tests that you want to include. Regular expressions are separated by a newline.

Run the tempest run command with either the --whitelist-file or -w options to use a whitelist file:

# tempest run -w <whitelist_file>

5.4. Skipping Tests Using Blacklist Files

A blacklist file is a file that contains regular expressions to select tests that you want to exclude. Regular expressions are separated by a newline.

Run the tempest run command with either the --blacklist-file or -b options to use a blacklist file:

# tempest run -b <blacklist_file>

5.5. Running Tests in Parallel Concurrently, or Serially

Run the tests serially:

# tempest run --serial

Run the tests in parallel. Parallel testing is the default:

# tempest run --parallel

Use the --concurrency or -c option to specify the number of workers to use when running tests in parallel:

# tempest run --concurrency <workers>

By default, the Integration Test Suite uses one worker for each CPU available.

5.6. Running Specific Tests

Run specific tests with the --regex regular expression option. The regular expression must be Python regular expression:

# tempest run --regex <regex>

For example, use the following example command to run all tests that have names beginning with tempest.scenario:

# tempest run --regex ^tempest.scenario