perst is a wrapper around LoaderIO, which can be configured and run in your commandline multiple tests and validates the measureable values like AVG Response Time and AVG Error Rate.
- Command Line Options
- Configuration files
- Big list of configuration options
version
api
app
tasks
tasks.[name].name
tasks.[name].type
tasks.[name].duration
tasks.[name].clientsStart
tasks.[name].clients
tasks.[name].timeout
tasks.[name].errorThreshold
tasks.[name].notes
tasks.[name].tags
tasks.[name].threshold
tasks.[name].requests
tasks.[name].request
- Configuration Examples
Usage: perst [options]
Basic options:
Switch | Description |
---|---|
-c, --config FILENAME | Use this config file (if argument is used but value is unspecified, defaults to .perstrc) |
-d, --dry-run | Runs all test in dry-run mode |
-h, --help | Show this help message |
-v, --version | Show version number |
--ci | Runs this on a CI |
--dump-config [FORMAT] | dumps the config to the stdout in given format (yaml, yml, json, js). Default: yaml |
-f, --filter PATTERN | filters the task by given regex. The name attribute will be used with the regex |
--color | force the output with colors |
--no-color | force the output without colors |
--list-tasks | lists all available tasks |
-s, --silent | silent mode |
--stop-on-failure | stops the tasks execution, if a task fails |
At the following locations in the root directory and format can be placed the configuration.
The files will be searched in this order. The first match will be used.
- package.json
{ "perst": {...} }
- .perstrc yaml
- .perstrc.json json
- .perstrc.yaml yaml
- .perstrc.yml yaml
- .perstrc.js javascript
- .perstrc.cjs common js
- perst.config.js javascript
- perst.config.cjs common js
Or you run perst with the command line switch -c.
You can use environment variables in your configuration. Environment variables are only supported in YAML Files.
Every environment variable can be written in the format $NAME
or ${NAME}
. Only existing environment variables will replaced.
YAML configuration use YAML Version 1.2 and supports anchors.
Defines the version of the configuration file.
- Required: false
- Type: Number
- Values: 1
- Default: 1
Defines some api information currently for loader IO.
- Required: true
- Type: Object
Defines the loader IO API token.
- Required: true
- Type: String
Defines the loader IO API server url.
- Required: false
- Type: String
- Default: https://api.loader.io
Defines the loader IO API version.
- Required: false
- Type: String
- Values: v2
- Default: v2
Defines some application options.
- Required: true
- Type: Object
Defines the domain for load testing. The domain must be defined in loader IO and must be verified.
- Required: true
- Type: String
- Example: https://www.example.de
Defines every task which should be run. This is an object of tasks.
- Required: true
- Type: Object
Defines the name of the task in loader IO. This name will be used to find an existing task to reuse and rerun them. If no task can be found with this name, the task will be created.
- Required: true
- Type: String
Defines the test type for the task. The article Test Types and Understanding the different test types describe detailed information about the test type.
- Required: false
- Type: String
- Values: per-test, per-second, maintain-load
- Default: per-second
With the "Clients per test" type, you specify the total number of clients to connect to your application over the duration of the test. If you specify 20000 clients for a 20-second test, 1000 clients will connect each second during that test.
The "Clients per second" type is similar to "Clients per test", but instead of specifying the total, you specify the number of clients to start each second. A 20-second test with 1000 clients per second is the same as a 20-second test at 20000 clients per test.
This test allows you to specify a from and a to value for clients. If you specify 0 and 10000 here for example, the test will start with 0 clients and increase up to 10000 simultaneous clients by the end of the test.
Defines the execution duration of the test in seconds.
- Required: false
- Type: Integer
- Values: >= 60
- Default: 60
This defines number of clients for the start for the test type Maintain client load. This value will be ignored for all other test types.
- Required: false
- Type: Integer
- Values: >= 0
- Default: 0
This defines number of clients, which should be used. I case of the test type Maintain client load, this will be the number of client at the end of the test.
- Required: true
- Type: Integer
- Values: >= 15
This defines the timeout for one request. This value is in milliseconds.
- Required: false
- Type: Integer
- Values: >= 0
- Default: 10000
This defines the error percentage threshold.
- Required: false
- Type: Integer
- Values: 0 <= x <= 100
- Default: 10000
This defines some notes to add to the test.
- Required: false
- Type: String
This defines some tags to add to the test.
- Required: false
- Type: Array of String
This defined the relevant threshold, whether the test should fail or not.
- Required: false
- Type: Object
This defines the maximum average response time in milliseconds, which is allowed. If the test exceeds this value, the task will fail.
- Required: true
- Type: Integer
- Values: >= 0
- Default: 500
This defines the maximum average error rate, which is allowed. If the test exceeds this value, the task will fail.
- Required: true
- Type: Integer
- Values: 0 <= x <= 100
- Default: 0
This defines the multiple request options for the test. This property can be defined beside the tasks.[name].request
property, but it
can also be defined without the tasks.[name].request
property. If both properties are defined, the first request is the request, which is
defined in the property tasks.[name].request
.
- Required: true
- Type: Array of Object
The descriptions of the object in this array are the same as described in the property tasks.[name].request
.
This defines the request options for the test. This property can be defined beside the tasks.[name].requests
property, but it
can also be defined without the tasks.[name].requests
property. If both properties are defined, the first request is the request, which is
defined in the property tasks.[name].request
.
- Required: true
- Type: Object
This defines the absolute path for the request. The path can be start with a / or without it. This path will be combined with the property api.domain
.
- Required: true
- Type: String
This defines method for the request.
- Required: false
- Type: String
- Values: GET, POST, PUT, PATCH, DELETE
- Default: GET
This defines a URL of a payload file. Detailed information about the payload file can be found in the article Payload Files.
- Required: false
- Type: Url
This defines header values for the request. If you defined this property, you have to declare the header accept-encoding
on your own.
- Required: false
- Type: Object
- Default:
{'accept-encoding': 'gzip'}
This defines an array with parameters objects. These parameters will be sent in query string or POST body.
- Required: false
- Type: Array of Object
This defines the name of the parameter.
- Required: true
- Type: String
This defines the name of the parameter.
- Required: true
- Type: String
This defines options for the authentication.
- Required: false
- Type: Object
This defines the type of the authentication.
- Required: false
- Type: String
- Values: basic
- Default: basic
The value basic
defines the authentication as HTTP Basic Auth.
This defines login or user name for the authentication.
- Required: true
- Type: String
This defines password for the authentication.
- Required: true
- Type: String
This defines variables whose values will be taken from the header. These variables can be used in all following request. You can read more information in the article Variables.
- Required: false
- Type: Array of Object
This defines the name of the variable for later use.
- Required: true
- Type: String
This defines the header property name to get the value from the request.
- Required: true
- Type: String
This defines source of the variables.
- Required: false
- Type: String
- Values: header
- Default: header
version: 1
api:
token: bb74abe565ec005944ffcbfa846431e1
server: https://api.loader.io
version: v2
app:
domain: https://www.example.com
tasks:
tasks1:
name: Task 1
type: per-second
duration: 60
clientsStart: 1
clients: 25
timeout: 10000
notes: "some notes"
tags:
- tag 1
- tag 2
threshold:
avgResponseTime: 500
avgErrorRate: 0
request:
path: /nuff/narf
type: GET
payloadFile: https://www.example.de/file
headers:
accept-encoding: gzip
parameters:
- name: parameter 1
value: value of parameter 1
- name: parameter 2
value: value of parameter 2
authentication:
type: basic
login: login
password: password
variables:
- name: variable 1 name
property: variable 1 property
source: variable 1 source
- name: variable 2 name
property: variable 2 property
source: variable 2 source
tasks2:
name: Task 2
duration: 60
clients: 25
threshold:
avgResponseTime: 500
avgErrorRate: 0
requests:
- path: /nuff/narf
- path: /rofl/copoter
{
"version": 1,
"api": {
"token": "bb74abe565ec005944ffcbfa846431e1",
"server": "https://api.loader.io",
"version": "v2"
},
"app": {
"domain": "https://www.example.com"
},
"tasks": {
"tasks1": {
"name": "Task 1",
"type": "per-second",
"duration": 60,
"clientsStart": 1,
"clients": 25,
"timeout": 10000,
"notes": "some notes",
"tags": [
"tag 1",
"tag 2"
],
"threshold": {
"avgResponseTime": 500,
"avgErrorRate": 0
},
"request": {
"path": "/nuff/narf",
"type": "GET",
"payloadFile": "https://www.example.de/file",
"headers": {
"accept-encoding": "gzip"
},
"parameters": [
{
"name": "parameter 1",
"value": "value of parameter 1"
},
{
"name": "parameter 2",
"value": "value of parameter 2"
}
],
"authentication": {
"type": "basic",
"login": "login",
"password": "password"
},
"variables": [
{
"name": "variable 1 name",
"property": "variable 1 property",
"source": "variable 1 source"
},
{
"name": "variable 2 name",
"property": "variable 2 property",
"source": "variable 2 source"
}
]
}
},
"tasks2": {
"name": "Task 2",
"duration": 60,
"clients": 25,
"threshold": {
"avgResponseTime": 500,
"avgErrorRate": 0
},
"requests": [
{"path": "/nuff/narf"},
{"path": "/rofl/copoter"}
]
}
}
}
export default {
"version": 1,
"api": {
"token": "bb74abe565ec005944ffcbfa846431e1",
"server": "https://api.loader.io",
"version": "v2"
},
"app": {
"domain": "https://www.example.com"
},
"tasks": {
"tasks1": {
"name": "Task 1",
"type": "per-second",
"duration": 60,
"clientsStart": 1,
"clients": 25,
"timeout": 10000,
"notes": "some notes",
"tags": [
"tag 1",
"tag 2"
],
"threshold": {
"avgResponseTime": 500,
"avgErrorRate": 50
},
"request": {
"path": "/nuff/narf",
"type": "GET",
"payloadFile": "https://www.example.de/file",
"headers": {
"accept-encoding": "gzip"
},
"parameters": [
{
"name": "parameter 1",
"value": "value of parameter 1"
},
{
"name": "parameter 2",
"value": "value of parameter 2"
}
],
"authentication": {
"type": "basic",
"login": "login",
"password": "password"
},
"variables": [
{
"name": "variable 1 name",
"property": "variable 1 property",
"source": "variable 1 source"
},
{
"name": "variable 2 name",
"property": "variable 2 property",
"source": "variable 2 source"
}
]
}
},
"tasks2": {
"name": "Task 2",
"duration": 60,
"clients": 25,
"threshold": {
"avgResponseTime": 500,
"avgErrorRate": 0
},
"requests": [
{"path": "/nuff/narf"},
{"path": "/rofl/copoter"}
]
}
}
}