> For the complete documentation index, see [llms.txt](https://docs.mosip.io/compliance-tool-kit/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.mosip.io/compliance-tool-kit/versions/version-1.4.4/test-report.md). # Test Report ### Scope The scope of testing revolved around verifying the compliance of the product as per the specifications published by MOSIP using the below devices: The windows compliance tool kit was tested with the below specifications: * **ABIS (Automated Biometric Identification System)** Specifications was tested with Fingerprint, Iris and Face modalities as per MOSIP - ABIS API specifications. * **Secure Biometric Interface (SBI)** with Compliance testcases collection and Quality Assessment test cases collection on below modalities * Registration devices for Iris, Face and Fingerprint * Authentication devices for Iris, Face and Fingerprint **Biometric SDK** * Quality Check * Match * Extraction * Conversion The Android compliance tool kit app v1.4.4 was tested with the below specifications: * **Secure Biometric Interface (SBI)** with Compliance testcases collection and Quality Assessment testcases collection on below modalities * Registration devices for Iris, Face and Fingerprint * Authentication devices for Iris, Face and Fingerprint ### Testing Scope (Bug Fixes Release) Testing focused on validating the fixes delivered in CTK v1.4.4 and ensuring there was no impact on existing Compliance Toolkit functionality. The scope included functional validation of fixes and regression testing of affected modules and workflows across supported platforms and specifications. Jira Issues in Scope: * MOSIP-45009 * MOSIP-45007 * MOSIP-45006 * MOSIP-45005 * MOSIP-45004 * MOSIP-42898 * MOSIP-42453 * MOSIP-3818 ### *Test Execution Statistics* #### ABIS Testing MOSIP interfaces with an Automated Biometric Identification System (ABIS) to perform de-duplication of a resident's biometric data. A country may use multiple ABISs for the same biometric data and evaluate the best ABIS based on de-duplication quality. ABIS is used for 1:N de-duplication. For 1:1 authentication Biometric SDK is used. MOSIP does not recommend using an ABIS for 1:1 authentication. Test cases have been tested with MOSIP mock ABIS for compliance with the MOSIP specifications across 29 test cases.
ScenariosMock ABIS
Total29
Passed28
Pending0
Failed0
NA1
Test Rate (%)100%
Pass Rate (%)100%
**Out of scope: Real ABIS testing in CTK v1.4.4** #### SBI Testing The Secure Biometric Interface (SBI) is used to interface with biometric devices. The compliance tool kit was tested to ensure that the interface built by the device provider is following the specs and security rules defined in the SBI spec. The device hardware security features are not tested as part of compliance tool kit. For Android Authentication Devices using MOSIP's Android mock SBI The ‘Android CTK app v1.4.4’ with ‘MOSIP Android Mock SBI’ has been tested for compliance with the specifications. Test cases specific to quality and user interactions have been tested with MOSIP Android mock SBI.
ScenariosFPIrisFace
Total352741
Passed352741
Pending000
Failed000
Test Rate (%)100%100%100%
Pass Rate (%)100%100%100%
For Android Registration Devices using MOSIP's Android mock SBI The ‘Android CTK app v1.4.4’ with ‘MOSIP Android Mock SBI’ has been tested for compliance with the specifications. Test cases specific to quality and user interactions have been tested with MOSIP Android mock SBI and real registration face SBI.
ScenariosFPIrisFace
Total492645
Passed492645
Pending000
Failed000
Test Rate (%)100%100%100%
Pass Rate (%)100%100%100%
For Windows Authentication Devices using MOSIP's windows mock SBI The windows CTK v1.4.4 with ‘MOSIP windows Mock SBI’ has been tested for compliance with the specificatio For Windows Registration Devices using MOSIP's windows mock SBI The windows CTK v1.4.4 with ‘MOSIP windows Mock SBI’ has been tested for compliance with the specifications.
ScenariosFPIrisFace
Total552948
Passed552948
Pending000
Failed000
Test Rate (%)100%100%100%
Pass Rate (%)100%100%100%
Out of scope: Real devices testing on windows and android CTK v1.4.4. #### SDK Testing The SDK implementation has been tested to support quality check, match, extraction, and conversion of biometrics. Test cases have been tested with MOSIP mock SDK.
ScenariosWith Mock SD
Total65
Passed65
Pending0
Failed0
N/A0
Test Rate (%)100%
Pass Rate (%)100%
**Out of scope: Segmentation testing and Real SDK testing**Docker version (required for Compliance Test Kit):
Docker ImageVersion / Tag
docker.io/mosipdev/activemq-artemis2.39.0
docker.io/mosipdev/alpinelatest
docker.io/mosipid/admin-service1.3.1
docker.io/mosipid/admin-ui1.3.0
docker.io/mosipid/apitest-auth1.3.1-rc.1
docker.io/mosipid/apitest-idrepo1.3.1-rc.1
docker.io/mosipid/apitest-masterdata1.3.1
docker.io/mosipid/apitest-prereg1.3.0
docker.io/mosipid/apitest-resident1.3.0
docker.io/mosipid/artifactory-server1.2.0.2
docker.io/mosipid/artifactory-server1.3.2-rc.1
docker.io/mosipid/authentication-internal-service1.3.1-rc.1
docker.io/mosipid/authentication-otp-service1.3.1-rc.1
docker.io/mosipid/authentication-service1.3.1-rc.1
docker.io/mosipid/biosdk-server1.3.1-rc.1
docker.io/mosipid/captcha-validation-service0.1.1
docker.io/mosipid/clamav1.3.0_base
docker.io/mosipid/commons-packet-service1.3.1-rc.1
docker.io/mosipid/compliance-toolkit-batch-job1.4.0
docker.io/mosipid/consolidator-websub-service1.3.2-rc.1
docker.io/mosipid/credential-request-generator1.3.1-rc.1
docker.io/mosipid/credential-service1.3.1-rc.1
docker.io/mosipid/data-share-service1.3.1-rc.1
docker.io/mosipid/digital-card-service1.3.0
docker.io/mosipid/dsl-orchestrator1.2.1.0
docker.io/mosipid/dsl-orchestrator1.4.0
docker.io/mosipid/dsl-orchestrator1.5.0
docker.io/mosipid/dsl-packetcreator1.4.0
docker.io/mosipid/dsl-packetcreator1.5.0
docker.io/mosipid/esignet-with-plugins1.6.2
docker.io/mosipid/esignet1.4.1
docker.io/mosipid/hotlist-service1.3.1
docker.io/mosipid/id-repository-identity-service1.3.1-rc.1
docker.io/mosipid/id-repository-vid-service1.3.1-rc.1
docker.io/mosipid/kafka3.2.1-debian-11-r9
docker.io/mosipid/kernel-auditmanager-service1.3.2-rc.1
docker.io/mosipid/kernel-auth-service1.3.1
docker.io/mosipid/kernel-config-server1.3.1-rc.1
docker.io/mosipid/kernel-idgenerator-service1.3.1-rc.1
docker.io/mosipid/kernel-keymanager-service1.4.1-rc.1
docker.io/mosipid/kernel-masterdata-service1.3.1
docker.io/mosipid/kernel-notification-service1.3.1-rc.1
docker.io/mosipid/kernel-otpmanager-service1.3.0
docker.io/mosipid/kernel-pridgenerator-service1.3.1-rc.1
docker.io/mosipid/kernel-ridgenerator-service1.3.1-rc.1
docker.io/mosipid/kernel-salt-generator1.3.1-rc.1
docker.io/mosipid/kernel-syncdata-service1.3.1
docker.io/mosipid/keycloak-init1.2.0.1
docker.io/mosipid/keycloak-init1.2.0.2
docker.io/mosipid/keys-generator1.4.1-rc.1
docker.io/mosipid/minio-client-utilNot specified
docker.io/mosipid/minio-client-utillatest
docker.io/mosipid/minio2025.2.28-debian-12-r1
docker.io/mosipid/mock-abis1.3.1-rc.1
docker.io/mosipid/mock-mv1.3.1-rc.1
docker.io/mosipid/mock-relying-party-service0.11.2
docker.io/mosipid/mock-relying-party-service0.9.3
docker.io/mosipid/mock-relying-party-ui0.11.2
docker.io/mosipid/mock-relying-party-ui0.9.3
docker.io/mosipid/mosip-artemis-keycloak1.3.0
docker.io/mosipid/mosip-file-server1.3.0
docker.io/mosipid/oidc-ui1.4.1
docker.io/mosipid/oidc-ui1.6.2
docker.io/mosipid/partner-management-service1.2.2.2
docker.io/mosipid/partner-onboarder1.2.0.1
docker.io/mosipid/partner-onboarder1.3.1
docker.io/mosipid/pmp-revamp-ui1.2.2.2
docker.io/mosipid/policy-management-service1.2.2.2
docker.io/mosipid/postgres-init1.2.0.1
docker.io/mosipid/postgres-init1.3.0
docker.io/mosipid/postgresql14.2.0-debian-10-r70
docker.io/mosipid/pre-registration-application-service1.3.0
docker.io/mosipid/pre-registration-batchjob1.3.0
docker.io/mosipid/pre-registration-booking-service1.3.1-rc.1
docker.io/mosipid/pre-registration-datasync-service1.3.0
docker.io/mosipid/pre-registration-ui1.3.0
docker.io/mosipid/print1.3.1
docker.io/mosipid/redis7.0.5-debian-11-r25
docker.io/mosipid/regclient-keystore1.0.0
docker.io/mosipid/registration-client1.2.0.2
docker.io/mosipid/registration-processor-common-camel-bridge1.3.1-rc.1
docker.io/mosipid/registration-processor-dmz-packet-server1.3.1-rc.1
docker.io/mosipid/registration-processor-landing-zone1.3.1-rc.1
docker.io/mosipid/registration-processor-notification-service1.3.1-rc.1
docker.io/mosipid/registration-processor-registration-status-service1.3.1-rc.1
docker.io/mosipid/registration-processor-registration-transaction-service1.3.1-rc.1
docker.io/mosipid/registration-processor-reprocessor1.3.1-rc.1
docker.io/mosipid/registration-processor-stage-group-11.3.1-rc.1
docker.io/mosipid/registration-processor-stage-group-21.3.1-rc.1
docker.io/mosipid/registration-processor-stage-group-31.3.1-rc.1
docker.io/mosipid/registration-processor-stage-group-41.3.1-rc.1
docker.io/mosipid/registration-processor-stage-group-51.3.1-rc.1
docker.io/mosipid/registration-processor-stage-group-61.3.1-rc.1
docker.io/mosipid/registration-processor-stage-group-71.3.1-rc.1
docker.io/mosipid/registration-processor-workflow-manager-service1.3.1-rc.1
docker.io/mosipid/resident-service1.3.0
docker.io/mosipid/resident-ui0.9.1
docker.io/mosipid/softhsmv2
docker.io/mosipid/uitest-admin1.3.0
docker.io/mosipid/uitest-pmp-v21.3.0-beta.4
docker.io/mosipid/websub-service1.3.2-rc.1
docker.io/mosipid/zookeeper3.8.0-debian-11-r30
docker.io/mosipqa/apitest-pms1.3.x
docker.io/mosipqa/compliance-toolkit-service1.4.x
docker.io/mosipqa/compliance-toolkit-ui1.4.x
docker.io/mosipqa/dsl-orchestrator1.5.x
docker.io/mosipqa/dsl-packetcreator1.5.x
docker.io/mosipqa/mock-smtpdevelop
docker.io/mosipqa/partner-management-service1.3.x
docker.io/mosipqa/pmp-ui-v21.3.x
docker.io/mosipqa/policy-management-service1.3.x
docker.io/mosipqa/uitest-pmp-v21.3.x
docker.io/mosipqa/uitest-residentdevelop
mosipid/apitest-auth1.3.1-rc.1
mosipid/apitest-idrepo1.3.1-rc.1
mosipid/apitest-masterdata1.3.1
mosipid/apitest-prereg1.3.0
mosipid/apitest-resident1.3.0
mosipid/clamav1.3.0_base
mosipid/kernel-config-server1.3.1-rc.1
mosipid/keycloak-init1.2.0.1
mosipid/keycloak-init1.2.0.2
mosipid/postgres-init1.2.0.1
mosipid/postgres-init1.3.0
mosipid/regclient-keystore1.0.0
mosipid/softhsmv2
mosipqa/apitest-pms1.3.x
Sonar Report MOSIP - Compliance-toolkit-service:
MOSIP - compliance-toolkit-ui: