Updates status of tests to various test management systems
Current code is more of PoC, so work is still needed. Testlink implementation tested with Bitnami's Container.
Test management system is recognized from the variables in the scope. If for some reason different suites go to different systems, those variables can be set at Suite level.
If you are using the robotframework-maven-plugin you can use this library by adding the following dependency to your pom.xml:
<dependency>
<groupId>com.github.hi-fi</groupId>
<artifactId>robotframework-statusupdater</artifactId>
<version>0.0.4</version>
<scope>test</scope>
</dependency>
- More information about this library can be found in the Keyword Documentation.
- For keyword completion in RIDE you can download this Library Specs and place it in your PYTHONPATH.
There're some common variables that control how library works when used as a listener. Note that listerner has to be specified when starting the tests (e.g. Generic way and Java with Maven plugin
| Variable name | Description |
|---|---|
| startSuiteListenerEnabled | Listen suite start |
| stopSuiteListenerEnabled | Listen suite end |
| startTestListenerEnabled | Listen test start |
| stopTestListenerEnabled | Listen test end |
With Quality Center/ALM, update is done to testcase name's first part (until first whitespace) in the Robot tests.
| Variable name | Description |
|---|---|
| QC_URL | Part of the QC's URL before /qcbin... |
| QC_USER | User who has rights to specified domain and project and rights to execute tests |
| QC_PW | Password for QC_USER |
| QC_DOMAIN | Domain to use in QC |
| QC_PROJECT | Project to use in QC |
| Robot test status | QC Status | Comment |
|---|---|---|
| - | Not Completed | Default status when test execution is created to QC. Practically means that test is started in Robot |
| PASS | Passed | |
| FAIL | If test has tag "BLOCKED" (case insensitive), Blocked; Otherwise Failed |
| Variable name | Description |
|---|---|
| JIRAXRAY_URL | JIRA's hostname |
| JIRAXRAY_CONTEXT | Path to Jira. Jira is accessed normally with JIRAXRAY_URL/JIRAXRAY_CONTEXT -address. |
| JIRAXRAY_USER | User that has rights to create test executions to specified project. |
| JIRAXRAY_PW | Password for JIRAXRAY_USER |
| Robot test status | QC Status | Comment |
|---|---|---|
| - | Not Completed | Default status when test execution is created to QC. Practically means that test is started in Robot |
| PASS | Passed | |
| FAIL | If test has tag "BLOCKED" (case insensitive), Blocked; Otherwise Failed |
| Variable name | Description |
|---|---|
| JIRAZEPHYR_URL | JIRA's hostname |
| JIRAZEPHYR_CONTEXT | Path to Jira. Jira is accessed normally with JIRAZEPHYR_URL/JIRAZEPHYR_CONTEXT -address. |
| JIRAZEPHYR_USER | User that has rights to create test executions to specified project. |
| JIRAZEPHYR_PW | Password for JIRAZEPHYR_USER |
| cycleId | Zephyr cycle ID. Can be fetched with REST API call (not visible at UI) |
| versionId | Zephyr version ID. Can be fetched with REST API call (not visible at UI) |
| Robot test status | QC Status | Comment |
|---|---|---|
| - | Not Completed | Default status when test execution is created to QC. Practically means that test is started in Robot |
| PASS | Passed | |
| FAIL | If test has tag "BLOCKED" (case insensitive), Blocked; Otherwise Failed |
With TestLink, update is done with testcase's external ID, which has to be first part of the testcase name in the Robot tests. In the case of failure failure message is written to notes of the TestLink execution.
| Variable name | Description |
|---|---|
| TESTLINK_URL | TestLink's XML-RPC endpoint. With Docker TestLink this is at http:///lib/api/xmlrpc/v1/xmlrpc.php |
| TESTLINK_API_KEY | API key from the user who should be visible at the automated updates |
| planName | Name of TestLink's test plan containing test case that needs to be updated |
| projectName | Name of TestLink's project containing test plan containing test case that needs to be updated |
| buildId | ID number of the build that is executed in Test Plan |
Updates Testlink only at test end.
| Robot test status | Testlink Status |
|---|---|
| PASS | PASSED |
| FAIL | If test has tag "BLOCKED" (case insensitive), BLOCKED; Otherwise FAILED |