Test Report
Scope
The scope of testing revolved around verifying the compliance of the product as per the specifications published by MOSIP using the below devices:
The Windows Compliance tool kit was tested with the below specifications:
ABIS (Automated Biometric Identification System) Specifications were tested with Fingerprint, Iris and Face modalities as per MOSIP ABIS API specifications.
Secure Biometric Interface (SBI) with Compliance testcases collection and Quality Assessment testcases collection on below modalities
Registration devices for Iris, Face and Fingerprint
Authentication devices for Iris, Face and Fingerprint
Biometric SDK
Quality Check
Match
Extraction
Conversion
The Android Compliance tool kit app v1.3.0 was tested with the below specifications:
Secure Biometric Interface (SBI) with Compliance testcases collection and Quality Assessment testcases collection on below modalities
Registration devices for Iris, Face and Fingerprint
Authentication devices for Iris, Face and Fingerprint
Test Execution Statistics
ABIS Testing
MOSIP interfaces with an Automated Biometric Identification System (ABIS) to perform de-duplication of a resident's biometric data. A country may use multiple ABISs for the same biometric data and evaluate the best ABIS based on de-duplication quality. ABIS is used for 1:N de-duplication. For 1:1 authentication, Biometric SDK is used. MOSIP does not recommend using an ABIS for 1:1 authentication.
Test cases have been tested with MOSIP mock ABIS for compliance with the MOSIP specifications across 29 test cases.
Scenarios | Mock ABIS |
Total | 28 |
Passed | 27 |
Pending | 0 |
Failed | 0 |
NA | 1 |
Test Rate (%) | 100% |
Pass Rate (%) | 100% |
Out of scope: Real ABIS testing in CTK 1.3.0
SBI Testing
The Secure Biometric Interface (SBI) is used to interface with the biometric devices. The Compliance tool kit was tested to ensure that the interface built by the device provider is following the specifications and security rules defined in the SBI spec. The device hardware security features are not tested as a part of Compliance tool kit.
For Android Authentication Devices using MOSIP's Android mock SBI
The Android CTK app v1.3.0 with MOSIP Android Mock SBI has been tested for compliance with the specifications across 55 test cases. Test cases specific to quality and user interactions have been tested with MOSIP Android mock SBI.
Scenarios | Finger | Iris | Face |
Total | 36 | 26 | 40 |
Passed | 36 | 26 | 40 |
Pending | 0 | 0 | 0 |
Failed | 0 | 0 | 0 |
Test Rate (%) | 100% | 100% | 100% |
Pass Rate (%) | 100% | 90% | 100% |
For Android Registration Devices using MOSIP's Android mock SBI
The Android CTK app v1.3.0 with MOSIP Android Mock SBI has been tested for compliance with the specifications across 64 test cases. Test cases specific to quality and user interactions have been tested with MOSIP Android mock SBI and real registration face SBI.
Scenarios | Finger | Iris | Face |
Total | 47 | 24 | 43 |
Passed | 47 | 24 | 43 |
Pending | 0 | 0 | 0 |
Failed | 0 | 0 | 0 |
Test Rate (%) | 100% | 100% | 100% |
Pass Rate (%) | 100% | 100% | 100% |
For Windows Authentication Devices using MOSIP's Windows mock SBI
The Windows CTK 1.3.0 with MOSIP windows Mock SBI has been tested for compliance with the specifications across 55 authentication spec test cases.
Scenarios | Finger | Iris | Face |
Total | 34 | 26 | 40 |
Passed | 34 | 26 | 40 |
Pending | 0 | 0 | 0 |
Failed | 0 | 0 | 0 |
Test Rate (%) | 100% | 100% | 100% |
Pass Rate (%) | 100% | 100% | 100% |
For Windows Registration Devices using MOSIP's windows mock SBI
The Windows CTK 1.3.0 with MOSIP windows Mock SBI has been tested for compliance with the specifications across 76 registration spec test cases.
Scenarios | Finger | Iris | Face |
Total | 53 | 27 | 46 |
Passed | 53 | 27 | 46 |
Pending | 0 | 0 | 0 |
Failed | 0 | 0 | 0 |
Test Rate (%) | 100% | 100% | 100% |
Pass Rate (%) | 100% | 100% | 100% |
Out of scope: Real devices testing on Windows and android CTK v1.3.0.
SDK Testing
The SDK implementation has been tested to support quality check, match, extraction, and conversion of biometrics. Test cases have been tested with MOSIP mock SDK.
Scenarios | With Mock SDK |
Total | 65 |
Passed | 65 |
Pending | 0 |
Failed | 0 |
Test Rate (%) | 100% |
Pass Rate (%) | 100% |
Out of scope: Segmentation testing and Real SDK testing.
Known Issues
CTK-Keycloak login field names in Arabic are not appearing in RTL.
Forgot Password option is not working in CTK login page.
Error message should be user friendly in CTK sign-in page.
Column name is showing as 'View report'
Getting 500 error for endpoint
/v1/authmanager/authorize/invalidateTokenin development environment.
Docker version (required for Compliance Tool Kit)
mosipqa/compliance-toolkit-service:1.3.0
mosipqa/compliance-toolkit-ui:1.3.0
mosipqa/postgres-init:1.2.0.1
mosipqa/postgres-init:1.2.0.1
mosipqa/postgres-init:develop
mosipid/config-server:1.1.2
mosipid/kernel-auditmanager-service:1.2.0.1-B1
mosipid/kernel-auth-service:1.2.0.1-B2
mosipqa/authentication-service:1.2.0.1
mosipid/kernel-keymanager-service:1.2.0.1-B2
mosipid/keycloak-init:1.2.0.1-B2
mosipid/partner-management-service:1.2.0.1-B3
mosipqa/partner-onboarder:develop
mosipid/kernel-notification-service:1.2.0.1-B1
mosipqa/keycloak-init:1.2.0.1
mosipqa/minio-client-util:latest
Sonar Report
MOSIP - Compliance-toolkit-service
MOSIP - compliance-toolkit-ui
Last updated
