The IdP/SP testbed is a modular collection of trust and identity software products. It provides the capability to select existing products to easily deploy and integrate them without requiring technical knowledge of the individual products. This allows the automated set-up of a complete test environment for the execution of integration tests.
The architecture of the testbed is based on the use of self-containing containers (Docker) for the software products (IdP, SP, Proxy). These containers are maintained by a product maintainer and made available at a location of their choice (e.g. Docker Hub). The key component of the testbed is a centrally managed repository (GitHub) that contains the configurations of all products, i.e. deployment and test instructions. A user only has to clone the central repository and can then select the required software products and have it deployed in a target environment (e.g. local or cloud). In addition, the testbed provides a way to run automated web-based tests using Selenium, which are tailored to the selected software products.
This approach makes the administration of the testbed very lightweight and gives developers and other maintainers the opportunity to make their own products easily available.
The following roles are involved in operating testbed components.
Product Maintainer
The maintainer is responsible for managing a single software product in the testbed. This includes the creation of a Docker container and its configuration according to the testbed specification.
The maintainer can either be the official developer of the product or any other trusted community members who is willing to take on this task.
Testbed Administrator
The administrator is the owner of the testbed GitHub repository. He is responsible for the general testbed configuration and the generic tests. The administrator can add new products to the testbed by creating corresponding subdirectories and passing them on to the maintainer.
Testbed User
The end user of the testbed. The testbed is freely available as an open source application.
The expected target group are developers of T&I software products or (federation) operators who want to perform an integration test.
The following activities describe the actions necessary to manage and use the testbed.
[01] package product
The maintainer packages his product in a container according to the Docker Specification.
[02] provide config
The maintainer provides a configuration file that contains all the information needed to deploy the Docker container.
[03] accept config
The Testbed Admin checks the configuration.
If the product does not yet exist in the testbed, the admin needs to create a suitable directory to grant access to the maintainer.
[04] update testbed
The product configuration is added to the testbed and is now available for use.
[08] manage
The testbed admin makes necessary changes to the general configuration, the testbed deployment script or the generic tests, if required.
[05] fetch config
The user receives the complete testbed configuration by cloning the GitHub repository.
[06] deploy config
The user selects the desired software products and versions in the configuration.
[07] fetch product
Using the deployment script provided, the configured testbed can be deployed into any environment that is able to run Docker.
The testbed offers the capability to define and execute automated web-based tests using Selenium.
The testbed provides a set of generic test cases out of the box (Testbed supported test cases). These include standard authentication flows which are supported by every IdP/SP product.
<<test sequence diagram>>