Quality stabilization Testing of Apps for Bulbs and Switches

Case Study

Quality stabilization of a smart bulb mobile application

Path breaking, Smart-LED lighting company

Problem Statement

Client’s end customers, using the smart bulb’s were unsatisfied with the quality of the mobile application and were reporting multiple, inconsistent issues with the app.

Client also lacked a strong QA setup to ensure high quality deliverables for upcoming releases.

Mobile application

Challenges

Most of the issues reported by end customers were non reproducible due to lack of required information
During testing, the exchange between the mobile app and the firmware on lightbulbs was erratic, often disrupting or even stalling the testing.
Often the bulbs would stop communicating with the mobile applications requiring a hard reset.
While transferring data from one device to another, data was being lost.
Even with an app in production, there complete lack of test artifacts resulting from previous test creation and execution.

1 Associate Team Lead
1 Quality Engineer
25% – Manager

What we did

CresTech took over the complete verification and validation of the Smart light applications and the communication with the bulbs.

We created a Test Lab with 80 bulbs ,4 android & 4 iOS devices selected after end user analysis
We did the integration testing of various interconnected systems like the mobile app, the cloud and the behaviour of different category of bulbs like downlights , strips etc.
Found out the Root cause for various non reproducible defects by testing under various environment settings
Strategized and prioritised to run the P1 test cases in all the primary phones and P2 on secondary phones to cater customer’s needs for a fast Build Test cycle.

Internet of Things

Outcome

After coming on-board, we tested the app thoroughly and made the subsequent releases 100% free from any critical and major defects in production .
Reproduced and Eliminated the most commonly reported issue of “Missing Light Icon”
Ensured that there was no data loss of end-customers while restoring data in other devices or saving data to cloud.
Reduced the roll-out time by 30% with more strategic testing