The scope of testing is to verify fitment to the specification from the perspective of
Functionality
Deployability
Configurability
Customizability
Verification is performed not only from the end user perspective but also from the System Integrator (SI) point of view. Hence Configurability and Extensibility of the software is also assessed. This ensures readiness of software for use in multiple countries. Since MOSIP is an “API First” product platform, Verification scope required comprehensive automation testing for all the MOSIP APIs. An automation Test Rig is created for the same.
The Partner Management System Revamp testing scope revolves around the following flows:
Features: Partner Certificate, Policies, Authentication Services (OIDC Client & API key), User Profile, User Dashboard, Accept Terms & Conditions/ Consent.
Multilingual (English/Arabic/French)
Multi-browser testing: using Edge, Firefox, and Chrome browsers (Windows/ Mac)
Partner Management System Revamp End to End testing
Regression Testing
Persona based approach has been adopted to perform the IV&V, by simulating test scenarios that resemble a real-time implementation.
A Persona is a fictional character/user profile created to represent a user type that might use a product/or a service in a similar way. Persona based testing is a software testing technique that puts software testers in the customer's shoes, assesses their needs from the software and thereby determines use cases/scenarios that the customers will execute. The persona needs may be addressed through any of the following.
Functionality
Deployability
Configurability
Customizability
The verification methods may differ based on how the need was addressed.
For regression check, “MOSIP Test Rig” - an automation testing suite - which is indigenously designed and developed for supporting persona based testing. MOSIP Test Rig covers the end to end test execution and reporting. The end to end functional test scenarios are written starting from creation of packet in registration center, processing the packet through the registration processor, generating UIN and authenticating identity using IDA through various permutation and combinations of cases being covered. MOSIP Test Rig will be an open source artifact which can also be enhanced and used by countries to validate the SI deliveries before going live. Persona classes include positive personas.
Verification is performed on various configurations as mentioned below
Default configuration - with 3 Lang (English/Arabic/French)
Below are the test metrics by performing functional testing. The process followed was black box testing which based its test cases on the specifications of the software component under test. Functional test was performed in combination of individual module testing as well as integration testing. Test data were prepared in line with the user stories. Expected results were monitored by examining the user interface. The coverage includes GUI testing, System testing, End-To-End flows across multiple languages and configurations. The testing cycle included simulation of multiple identity schema and respective UI schema configurations.
MANUAL VERIFICATION (UI):
Total
Passed
Failed
Skipped (N/A)
842
825
16
1
Test Rate: 99% with Pass Rate: 98%
Note: NA - 1 Test Cases which are descoped scenarios/not developed feature
API Test Rig:
Total
Passed
Failed
Skipped (N/A)
23
23
0
0
Test Rate: 100% with Pass Rate: 100%
Note- API flow is testing by automation only (positive flow). No manual testing done for APIs
Below are the detailed test metrics by performing Manual/automation testing. The project metrics are derived from Defect density, Test coverage, Test execution coverage, test tracking and efficiency.
The various metrics that assist in test tracking and efficiency are as follows:
Passed Test Cases Coverage: It measures the percentage of passed test cases. (Number of passed tests / Total number of tests executed) x 100
Failed Test Case Coverage: It measures the percentage of all the failed test cases. (Number of failed tests / Total number of test cases executed) x 100
Module/Repro
Compatible Version
Comments
PMS Revamp
mosipqa/pmp-reactjs-ui:1.3.x
Partner Management Services
mosipqa/partner-management-service:1.3.x
Policy Management service
mosipqa/policy-management-service:1.3.x
PMS UI
mosipqa/pmp-ui:release-1.2.0.1
PMP-UI used for admin activities
Key-manager
mosipqa/kernel-keymanager-service:1.2.1.x
IDA Auth
mosipqa/authentication-service:release-1.2.0.1
Artifactory
mosipqa/artifactory-server:1.2.0.x
eSignet
mosipqa/esignet:1.2.0
Reg Proc
mosipid/registration-processor-stage-group-1:1.2.0.1
mosipid/registration-processor-stage-group-2:1.2.0.1
mosipid/registration-processor-stage-group-3:1.2.0.1
mosipid/registration-processor-stage-group-4:1.2.0.1
mosipid/registration-processor-stage-group-5:1.2.0.1
mosipid/registration-processor-stage-group-6:1.2.0.1
mosipid/registration-processor-stage-group-7:1.2.0.1
mosipid/registration-processor-common-camel-bridge:1.2.0.1
mosipid/registration-processor-notification-service:1.2.0.1
mosipid/registration-processor-dmz-packet-server:1.2.0.1
mosipid/registration-processor-reprocessor:1.2.0.1
mosipid/registration-processor-registration-status-service:1.2.0.1
mosipid/registration-processor-registration-transaction-service:1.2.0.1
mosipid/registration-processor-workflow-manager-service:1.2.0.1
Notifier (Kernel)
mosipid/kernel-notification-service:1.2.0.1-B1
Audit manager
mosipid/kernel-auditmanager-service:1.2.0.1-B1
ID Repro
mosipqa/id-repository-identity-service:develop
datashare
mosipqa/data-share-service:develop
mosip-pms table
bitnami/postgresql:15.4.0-debian-11-r10
Keycloak
mosipqa/mosip-artemis-keycloak:develop
minio
bitnami/minio:2022.2.7-debian-10-r0
config-server
mosipid/config-server:1.1.2
artifactory
mosipqa/artifactory-server:1.2.0.x
Websub
mosipid/websub-service:1.2.0.1-B1
postgres
bitnami/postgresql:15.4.0-debian-11-r10
Partner-Management-Service:
Partner-Management-Portal:
Github link for 'Test Reports' is here.
Release Name: Partner Management System Revamp
Release Number: v1.3.0-dp.1
Release Type:: Developer Preview Release
Release Date: 3rd Sep, 2024
We are excited to announce that Partner Management System (PMS) is undergoing a major revamp and as our first step, we will be introducing a brand new web application - Partner Management Portal to cater to the following aspects:
Technology stack upgrade
Introduce new partner types.
Introduce new features.
Enhancement of existing features.
Improved usability and user experience.
This release marks the developer's preview release (1.3.0-dp.1) of Partner Management System which focuses on implementation of Authentication Partner workflow in the new UI. This version of PMS is designed to run on 1.2.0.1 version of MOSIP platform.
The key features of Authentication Partner incorporated in this release are:
Partner Certificate:
Upload and Re-upload: Easily upload or re-upload Certificate Authority (CA) signed Partner Certificate.
Download: Download CA signed Partner Certificate and corresponding MOSIP Signed Certificate.
Policies:
Select Policy Group: Select Policy Group to be able to request for policies
Request Policies: Request policies within selected policy group.
Policy List: View a tabular list of requested policies along with Partner Admin approval status.
View Policy Details: Access detailed views of individual policies, including status of Partner Admin approval/rejection.
Authentication Services:
OIDC Client:
Create OIDC Client: Create OIDC Clients for approved policies.
View OIDC Details: Access a tabular list and individual views of submitted OIDC Client details, including OIDC Client IDs.
Edit: Edit existing OIDC Client details.
Deactivate: Deactivate OIDC Client whenever needed.
API Key:
Generate API Key: Create API Keys for approved policies.
View API Key Details: View a tabular list and individual details of submitted API Keys.
Deactivate: Deactivate API Keys when necessary.
Browser Support:
Complete support on Chrome, Firefox, Edge and Safari ensures a seamless user experience across these popular browsers.
Language Support:
Currently supports English, French and Arabic with plans to incorporate additional languages in future releases.
Compatibility:
Optimized for standard browser sizes (laptop/desktop) with responsive UI design for laptop/desktop views.
Note: All other existing services offered by earlier version of Partner Management Portal (Version 1.2.0.2) for roles such as Partner Admin, Device Provider, FTM Chip provider etc will continue to work in the previous UI until our revamp incorporates all these features in upcoming releases.
The following table outlines the tested and certified compatibility of PMS 1.3.0-dp.1 with other modules.
For a detailed description of Partner Management System, code, design, and setup steps, refer to:
For detailed description of the above features, refer to .
To know more about the upcoming features planned as part of PMS Revamp for this year, please check out .
Below is the list of key :
For more details on all the open issues, please refer
For code and implementation of Partner Management Services, refer .
For code and implementation of Partner Management Portal (revamp) , refer .
To get started with the new interface of Partner Management Portal, refer to the .
To access the build and read through the deployment instructions, refer to the .
Note: The deployment script for the PMS module-wise test rig will be addressed in the next release. Meanwhile, users who wish to run automation tests can refer to the and deploy using the image mosipid/apitest-pms:1.3.0-dp.1
.
For details related to partner management services revamp configurations, refer to the
Refer .
For details on the test results, refer .
Jira Issue
Issue Description
Error messages are observed when selecting a policy group but only when Authentication Partner is registered with lengthy names, organization names, or usernames.
This will be resolved once the Keycloak is integrated with PMP in our upcoming releases.
On deactivating an API key from one browser , the status still remains 'Activated' on viewing the same API Key details in another browser.
This is occurring due to caching. Hence user is expected to reload the tabular page of API Keys to see the latest status in View API Key screen.
Length validation of OIDC Client name is not functioning as expected for lengthy names within the given range. This has a dependency with eSignet, where the column size needs to be increased.
Its suggested that meaningful and reasonable length be utilised for OIDC Client name.
Date and time format in UI will be currently displayed as per user’s browser language settings instead of user’s system settings format.
An error is thrown when public key in JWK format is entered, due to which unable to submit the details. This is faced only in Safari browser of Macbook.
As a workaround, the create OIDC Client functionality can be performed across Chrome/ Firefox/ Edge/ Safari in Windows OS or Chrome/ Firefox/ Edge in mac OS, until this is resolved.
As the MOSIP Signed Certificate expires only after one year from the time of upload, testing is on hold for MOSIP Signed Certificate Expiry scenario.
Add Installation scripts for each module-wise apitest.
Repository Released
Tags
partner-management-services
partner-management-portal
keymanager
artifactory-ref-impl
PMS UI (legacy PMS UI for admin activities)
IDA Auth
eSignet
Reg Proc
Notifier (Kernel)
Audit manager
ID Repo
datashare
mosip-pms table
Keycloak
minio
config-server
Websub