Release 23.10 Performance Testing
Introduction
Performance testing plays a pivotal role in ensuring that software applications run smoothly under their intended workloads.
It's not just about how fast the system responds but also about how reliably and consistently it performs.
With the growing user base of openIMIS, it's essential to understand the system's limits and ensure that it delivers an optimal experience, irrespective of the load.
Objectives of Performance
To ensure that the openIMIS meets predefined performance criteria and delivers a satisfactory user experience.
Identify performance bottlenecks, scalability issues, and areas for optimization before the software is deployed to production.
Core Functionalities to be Tested
Core scenarios regarding Insuree, Family, Claim and Product components
Types of Tests to be Performed
Load Testing
Is a type of performance testing that assesses how well a system or application performs under various loads (measured with various workloads profiles and concurrent users) without performance degradation. It involves defining test scenarios, generating load, monitoring metrics, and reporting findings. The goal is to detect performance issues early, enhance reliability, improve user satisfaction, and optimize resource allocation. Different load testing types include stress testing, volume testing, concurrency testing, scalability testing, and endurance testing, each serving specific purposes in assessing a system's performance capabilities.
Stress Testing
Determine the breaking point of an application. During that we want to provide users and stakeholders information about how much load and for how many users system will break or will show potential risks and weak points. In that case we can provide accurate information of openIMIS capabilities for given hardware and software
Endurance testing
Is a type of performance testing that evaluates how a system or application performs under a sustained workload for an extended period. It helps identify issues like memory leaks and resource depletion that may affect long-term system stability.
Test Environment
Hardware and Software Details
AWS EC2 service m5.4xlarge instance
Network Configuration
standard WAN configuration
Data Preparation
Data Creation Scripts
Scripts for data generation will be created and stored under common repository.
Data Loads Used during Testing
Data Set | Load Test Volumes (millions) | Data Increase (per Hour) | Relations | Concurrent Users |
Insurees | 0.1/1/10 | N/A | Family, Claims | 2/10/50 |
Claims | 0.3/3/30 | 100/1k/5k | Policies, Insuress, Products | 2/10/50 |
Families | 0.04/0.4/4 | N/A | Insurees, Policies, Contributions | 2/10/50 |
Users | 0.0001/0.001/0.01 | N/A | N/A | 2/10/50 |
Products | 0.0001/0.001/0.01 | N/A | Claims | 2/10/50 |
Policies | 0.08/0.8/8 | N/A | Families, Claims | 2/10/50 |
Tools
Tests will be performed using JMeter tool, results will be visualized using Grafana.
All code used for generation of data, test execution, data transformation will be available under GitHub - openimis/performance_testing: Automation of performance testing of openIMIS repository.
Performance Testing Plan
Test Results
Deliverables
Performance Testing Strategy Document: A comprehensive guide detailing the testing approach, objectives, scope, and methodologies.
Test Scripts: Coded scripts that virtual users will execute during the tests.
Test Environment Specifications: Documentation of the environment setup, including hardware, software, and configurations.
Test Results: Raw data and logs collected during test execution.
Performance Analysis Report: A document detailing the test findings, including key metrics, bottlenecks, and recommendations.
Recommendations and Action Items List: A prioritized list of suggested improvements and next steps based on test results.
Issue and Bug Reports: Detailed reports of any defects or performance issues identified.
Did you encounter a problem or do you have a suggestion?
Please contact our Service Desk
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. https://creativecommons.org/licenses/by-sa/4.0/