Portfolio
a1qa provides QA support for a well-known developer of VR-enabled software
The client reached out to a1qa to receive professional support in ensuring bug-free operation of VR software for medical staff.
Overview
The client is a leading Australian-based developer of VR solutions providing realistic simulations for medical professionals, helping them learn how to best navigate critical situations and save lives.
Determined to enhance the accuracy of simulation-based training sessions and improve overall software quality, the client reached out to a1qa.
Services offered
Functional testing
Usability testing
Project scope
To meet the set project milestones, a1qa assigned a team comprising two QA engineers and a part-time manager. Their responsibility was to evaluate the quality of two software products:
- A VR-driven application aimed to practice the way of examining wounded soldiers and making diagnoses. The scenario requires the doctor to correctly utilize available tools. A successful outcome results in the patient surviving and the user earning points as a reward. Conversely, failure to complete the scenario successfully results in no points being awarded.
- A web application operating on a Unity cross-platform engine. Its functionality is similar to that of the VR-based solution, but the scenario differs — a construction worker gets wounded and requires primary care.
The team initiated testing of the VR-enabled application using an Oculus Quest headset. To prevent cybersickness symptoms such as dizziness and headaches, they adhered to a protocol of taking short, mandatory breaks every 15 minutes. After thoroughly reviewing the requirements, creating test cases, and uploading the .apk file to the headset, the engineers provided the following QA support:
- Acceptance testing
To make sure the software meets all critical and major business requirements, the engineers ensured deep testing coverage and focused on both positive and negative testing scenarios.
While ensuring high software quality, the team discovered a range of critical defects, among them a low FPS (frames per second) rate that caused dizziness. Other issues included the inability to grab surgical items because of short hands, objects floating through the walls, no guidelines on the menu, and the like.
To help foster end-user satisfaction, the QA engineers assessed the user interface design and logic, including the navigation structure and elements, menu bars, buttons, and more. After testing, the team created a detailed usability evaluation report with a list of findings and recommendations.
Up was a Unity-based web application. The quality assurance approach comprised the use of acceptance testing.
As was the case with the VR-enabled solution, the engineers ascertained whether the software fully allowed performing the tasks it was supposed to do. This testing step was essential, as before the involvement of a1qa, there were no software quality assurance processes. The QA engineers checked the entire functionality flow — from registering in the game to obtaining bonuses after successfully performing tasks.
As a result, the team discovered 80+ defects that hindered flawless user experience. For instance, some activities became cyclic (endless patient transferring), menus overlapped, surgery tools vanished, errors with the orientation of objects, etc.
Throughout the project, the QA manager safeguarded quality standards, ensuring the set milestones were met, consulted on defect life cycle management, and supervised an overall testing approach.
They also established a smooth communication process with the client by following synchronous and asynchronous interaction. So, despite working across different time zones, the QA team could discuss any questions during a one-hour time frame.
a1qa’s involvement helped bolster software quality and spot more than 160 defects of various severity levels that negatively impacted the technical health of the product.
Technologies & tools
- JIRA
- TestRail
- Oculus Quest 2
Results
-
Failsafe software operation due to thorough acceptance and usability testing, which helped detect more than 160 defects, including critical ones that could negatively affect human health.
-
Full compliance with quality standards due to the contribution of a dedicated QA manager who supervised the entire quality control process and established smooth communication regardless of the time difference.
In numbers
2
months of project duration
2
QA engineers on board
2
software products tested
160+
defects detected