Test Report

Scope

The scope of testing revolved around verifying the compliance of the product as per the specifications published by MOSIP using the below devices:

The Windows Compliance tool kit was tested with the below specifications:

• ABIS (Automated Biometric Identification System) Specifications were tested with Fingerprint, Iris and Face modalities as per MOSIP ABIS API specifications.

• Secure Biometric Interface (SBI) with Compliance testcases collection and Quality Assessment testcases collection on below modalities

  • Registration devices for Iris, Face and Fingerprint

  • Authentication devices for Iris, Face and Fingerprint

• Biometric SDK

  • Quality Check

  • Match

  • Extraction

  • Conversion

The Android Compliance tool kit app v1.4.0 was tested with the below specifications:

• Secure Biometric Interface (SBI) with Compliance testcases collection and Quality Assessment testcases collection on below modalities

  • Registration devices for Iris, Face and Fingerprint

  • Authentication devices for Iris, Face and Fingerprint

Test Execution Statistics

ABIS Testing

MOSIP interfaces with an Automated Biometric Identification System (ABIS) to perform de-duplication of a resident's biometric data. A country may use multiple ABISs for the same biometric data and evaluate the best ABIS based on de-duplication quality. ABIS is used for 1:N de-duplication. For 1:1 authentication, Biometric SDK is used. MOSIP does not recommend using an ABIS for 1:1 authentication.

Test cases have been tested with MOSIP mock ABIS for compliance with the MOSIP specifications across 29 test cases.

Scenarios	Mock ABIS
Total	28
Passed	27
Pending	0
Failed	0
NA	1
Test Rate (%)	100%
Pass Rate (%)	100%

Out of scope: Real ABIS testing in CTK 1.4.0

SBI Testing

The Secure Biometric Interface (SBI) is used to interface with biometric devices. The compliance tool kit was tested to ensure that the interface built by the device provider is following the specs and security rules defined in the SBI spec. The device hardware security features are not tested as part of compliance tool kit.

For Android Authentication Devices using MOSIP's Android mock SBI

The ‘Android CTK app v1.4.0’ with ‘MOSIP Android Mock SBI’ has been tested for compliance with the specifications. Test cases specific to quality and user interactions have been tested with MOSIP Android mock SBI.

Scenarios	Finger	Iris	Face
Total	35	27	41
Passed	35	27	41
Pending	0	0	0
Failed	0	0	0
Test Rate (%)	100%	100%	100%
Pass Rate (%)	100%	90%	100%

For Android Registration Devices using MOSIP's Android mock SBI

The Android CTK app v1.4.0 with MOSIP Android Mock SBI has been tested for compliance with the specifications. Test cases specific to quality and user interactions have been tested with MOSIP Android mock SBI and real registration face SBI.

Scenarios	Finger	Iris	Face
Total	49	26	45
Passed	49	26	45
Pending	0	0	0
Failed	0	0	0
Test Rate (%)	100%	100%	100%
Pass Rate (%)	100%	100%	100%

For Windows Authentication Devices using MOSIP's Windows mock SBI

The Windows CTK 1.4.0 with MOSIP windows Mock SBI has been tested for compliance with the specifications.

Scenarios	Finger	Iris	Face
Total	35	27	41
Passed	35	27	41
Pending	0	0	0
Failed	0	0	0
Test Rate (%)	100%	100%	100%
Pass Rate (%)	100%	100%	100%

For Windows Registration Devices using MOSIP's windows mock SBI

The Windows CTK 1.4.0 with MOSIP windows Mock SBI has been tested for compliance with the specifications.

Scenarios	Finger	Iris	Face
Total	55	29	48
Passed	55	29	48
Pending	0	0	0
Failed	0	0	0
Test Rate (%)	100%	100%	100%
Pass Rate (%)	100%	100%	100%

Out of scope: Real devices testing on Windows and android CTK v1.4.0.

SDK Testing

The SDK implementation has been tested to support quality check, match, extraction, and conversion of biometrics. Test cases have been tested with MOSIP mock SDK.

Scenarios	With Mock SDK
Total	65
Passed	65
Pending	0
Failed	0
Test Rate (%)	100%
Pass Rate (%)	100%

Out of scope: Segmentation testing and Real SDK testing.

Docker version (required for Compliance Tool Kit)

mosipqa/compliance-toolkit-batch-job:1.4.0

mosipqa/compliance-toolkit-service:1.4.0

mosipqa/compliance-toolkit-ui:1.4.0

mosipqa/postgres-init:develop

mosipid/config-server:1.1.2

mosipid/kernel-auditmanager-service:1.2.0.1-B1

mosipid/kernel-auth-service:1.2.0.1-B2

mosipqa/authentication-internal-service:release-1.2.0.1

mosipqa/authentication-otp-service:release-1.2.0.1

mosipqa/authentication-service:release-1.2.0.1

mosipid/kernel-keymanager-service:1.2.0.1-B2

mosipqa/keycloak-init:develop

mosipid/partner-management-service:1.2.0.1-B3

mosipqa/partner-onboarder:develop

mosipid/kernel-notification-service:1.2.0.1-B1

Known Issues

• Currently, ABIS partners can successfully create SBI and SDK projects in CTK 1.4.0, although role-based constraints to restrict this functionality is planned for future release

Sonar Report

MOSIP - Compliance-toolkit-service

MOSIP - compliance-toolkit-ui