Portfolio
a1qa provides QA support for a famous developer of VR-enabled software
The client reached out to a1qa to receive professional support in ensuring bug-free operation of VR software for medical staff.
Overview
The client is a leading Australian-based developer of VR solutions tailored to provide realistic simulations for medical professionals, helping them learn how to best navigate critical situations and save lives.
Determined to enhance the accuracy of simulation-based training sessions and improve overall software quality, the client reached out to a1qa.
Services offered
Functional testing
Usability testing
Project scope
To cope with set project milestones, a1qa assigned a team of 2 QA engineers and a part-time manager who were responsible for gauging quality level within 2 software products:
- A VR-driven application aimed to practice the way of examining wounded soldiers and making diagnoses. According to the scenario, the doctor should correctly use available tools. In successful case, the patient remains alive, and the user earns points as a reward. Otherwise, in the event of scenario failure, no score is provided.
- A web application operating on a Unity cross-platform engine. Its functionality is similar to that of the VR-based solution, but the scenario differs — a construction worker gets wounded and requires primary care.
The team jump-started testing the VR-enabled application with the help of an Oculus Quest 2 headset and took small, obligatory breaks every 15 minutes to avoid cybersickness symptoms (dizziness, headache, etc.). After studying the requirements, writing test cases, and downloading a .apk file to the headset, the engineers provided the following QA support:
1. Acceptance testing
To make sure the application flow performs as designed and meets all critical and major business requirements, the engineers ensured deep testing coverage and focused on both positive and negative testing scenarios.
While ensuring high software quality, the team discovered a range of critical defects, among them one could affect human health — a low FPS (frames per second) rate that caused dizziness. Other drawbacks included the inability to grab surgical items because of short hands, objects floating through the walls, no guidelines on the menu, and the like.
To help foster end-user satisfaction, the QA engineers assessed user interface design and logic, including a navigation structure and elements, menu bars, buttons, and many more. After testing, the team created a detailed usability evaluation report with a list of findings and recommendations.
The next in line was a Unity-based web application. The quality assurance approach comprised the use of acceptance testing.
As was the case with the VR-enabled solution, the engineers ascertained that the software fully allowed performing the tasks it was specifically supposed to do. This testing step was especially essential, as before the involvement of a1qa, there were no software quality assurance processes. The QA engineers checked the entire functionality flow — from registering in the game to obtaining bonuses after successfully performing tasks.
As a result, the team discovered 80+ defects that blocked flawless user experience. For instance, some activities became cyclic (endless patient transferring), menus were overlapping, surgery tools were vanishing, errors with the orientation of objects, etc.
Throughout the project, the assigned QA manager safeguarded quality standards, ensuring meeting the set milestones, consulting on defect life cycle management, and supervising an overall testing approach.
He also established a smooth communication process with the client by following synchronous and asynchronous interaction. So, despite working across different time zones, the QA team solved any issues during a one-hour time frame.
a1qa’s involvement helped bolster software quality and spot more than 160 defects of various severity levels that negatively impacted the technical health of the product.
Technologies & tools
- JIRA
- TestRail
- Oculus Quest 2
Results
-
Enhanced software quality and a detailed usability testing report with all the findings presented to the client due to a1qa’s rigorous testing approach.
In numbers
2
months of project duration
2
QA engineers on board
2
software products tested
160+
defects detected