Case Study

Quality stabilization of a smart bulb mobile application

Client

Path breaking, Smart-LED lighting company

Application

Mobile application

Team Size

  • 1 Associate Team Lead
  • 1 Quality Engineer
  • 25% - Manager

Industry

Internet of Things

Tech Stack

  • Android mobile app &
  • iOS mobile app,
  • SQL 2017,
  • Bluetooth and Wifi technology

Resource Distribution

Onsite

Duration

6 months

Types of Validation

  • Mobile app functional testing
  • Integration testing
  • Smart bulb’s firmware functional testing
  • Upgrade testing
  • Usability Testing
  • Regression Testing
  • Interruption Testing
  • Installation Testing

Recommendations

More proactive approach to testing with early checks on application design.

Problem Statement

Client’s end customers, using the smart bulb’s were unsatisfied with the quality of the mobile application and were reporting multiple, inconsistent issues with the app.

Client also lacked a strong QA setup to ensure high quality deliverables for upcoming releases.

Challenges

  • Most of the issues reported by end customers were non reproducible due to lack of required information
  • During testing, the exchange between the mobile app and the firmware on lightbulbs was erratic, often disrupting or even stalling the testing.
  • Often the bulbs would stop communicating with the mobile applications requiring a hard reset.
  • While transferring data from one device to another, data was being lost.
  • Even with an app in production, there complete lack of test artifacts resulting from previous test creation and execution.

What we did

CresTech took over the complete verification and validation of the Smart light applications and the communication with the bulbs.

 

  • We created a Test Lab with 80 bulbs ,4 android & 4 iOS devices selected after end user analysis
  • We did the integration testing of various interconnected systems like the mobile app, the cloud and the behaviour of different category of bulbs like downlights , strips etc.
  • Found out the Root cause for various non reproducible defects by testing under various environment settings
  • Strategized and prioritised to run the P1 test cases in all the primary phones and P2 on secondary phones to cater customer’s needs for a fast Build Test cycle. 

 

Outcome

  • After coming on-board, we tested the app thoroughly and made the subsequent releases 100% free from any critical and major defects in production .
  • Reproduced and Eliminated the most commonly reported issue of “Missing Light Icon” 
  • Ensured that there was no data loss  of end-customers while restoring data in other devices or saving data to cloud.
  • Reduced the roll-out time by 30% with more strategic testing