Page History
...
| Key | ValueType | Default | Combination | Description | Example | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| ignore | Bool | True | Override | Ignored model files / directories will not be included in the automatic testing process. | ignore = false | ||||||
| confidential | Bool | False | Override | If set the test / benchmarks should not publish any information about the content or meta-data of the model. | confidential = true | ||||||
| modelFileExtension | Comma separated list of strings | Empty | Override | A list of file name suffixes (file extensions) for identify model files. | modelFileExtension = sct | ||||||
| traceFileExtension | Comma separated list of strings | Empty | Override | A list of file name suffixes (file extensions) for identify test trace files. | traceFileExtension = eso, .trace | ||||||
resourceSetID
| String | Empty | Not propagated | A globally unique identifier which will cause the associated model files to be loaded into one resource set which allows resolving cross references between models files. | resourceSetID = my-unique-id | ||||||
| modelProperties | Comma separated list of strings | Empty | Combined | A list of model specific categories that should be assigned to the model. The categories are handled as a set where is property file in the hierarchy can add or remove (using !) new tags. | modelProperties = tiny-model, !broken | ||||||
| Other properties | String | Empty | Override | Any user specific property. | complexity = 9001 |
...
| Status | ||||
|---|---|---|---|---|
|
Benchmarks run similar to test. They run the models in a models repository, provided in the same way as mentioned before.
Local Benchmarks
To run the benchmarks locally you first have to provide the models repository (including the environment variable mentioned above). Then you need the appropriate plug-ins. in you runtime configuration.
...
Where the project_name specifies the project to save the results into. The benchmarks will create the project if it does not exist and will create a json file containing the benchmark results.
Overview
Content Tools