Mobile-App Testing Generic Checklist
- Interruption Testing
- Incoming Call
- Text message
- Other app notifications
- Storage low
- Battery low
- Battery dead
- No storage
- Airplane mode
- Intermittent connectivity
- Home screen jump
- Sleep mode
- Disconnect & connect the SC card
- Disconnect & connect the network/wifi
2. Network Connectivity
- GPRS
- 2G/3G/WiFi
- No connectivity
3. Installation Testing
. 1. Installation testing
2. Memory Test
3. UnInstallation Test
4. Orientation & Screen Resolution Test
- Make sure that the application looks good on target screen resolution. Smartphones and tablets come in all shapes and sizes.
- 320 x 480px
- 640 x 960px
- 480 x 800px
- 720 x 1280px
- 768 x 1280px
- 800 x 1280px
- 1200 x 1920px
- 2048 × 1536px
5. Security Testing
Applications should encrypt user names and passwords when authenticating the user over a network. One way to test security-related scenarios is to route your mobile’s data through a proxy server like OWASP Zed Attack Proxy and look for vulnerabilities.
- Protect the app & network from DOS attacks
- Tools: Retina CS, ZAP, Veracode, Google Nogotofail, SQL Map
https://owasp.org/www-project-mobile-security/#tab=Home
https://github.com/MobSF/Mobile-Security-Framework-MobSF
6. Performance Testing
Check to see if the performance of the mobile application degrades with an increase in the — size of the mailbox, album, messages, music, or any other content relevant to the application.
- Load Test
2, Stress Test
3. Volume Test:
4. Endurance test
5. Stability Test: check the operability of the app for a long time of work, under normal load.
6. Concurrent Test
7. check app is working same under diff network cond’s
8. check the app in non-permanent connection to the internet
9. Tools: Neoload, Apteligent, New Relic
7. Social Network IntegrationTest
1. Successful connection with FB/Gmail/Twitter
2. Check T&C’s
3. UnSuccessful connection[Should throw Authentication failed]
8. Play store/App store integration test
Consultants and organizations that provide end to end services should also include test cases to ensure that the mobile app is successfully deployed to the App Store / Play Store and is only available to the supported devices. This could also include validation of all the text, screenshots, version numbers, etc that are part of the app listing.
9. Update version test
- App updates: All user data is saved after the update.
2. Ensure the update progress is displayed properly.
3. Updates should support for older OS.
4. Testing various ways of installing updates via wifi/network/USB/Bluetooth
10. OS Versions
check functionality on multiple OS
11. Device Resource Testing
1. Lack of space to install or run the app
2. Memory leaks
3. Install/replace the app to SD card
4. Ensure the app does not interfere with other app’s & does not consume their memory
12. Usability Testing
check app works in multi-tasking mode
- text font size
2. button colors
3. check zoom-in & zoom-out
4. The app can be terminated at any stage & resumes operation at the same stage
5. check user can return/cancel the action if pressed the wrong button
6. check speed of the response is high enough
7. Tools- User zoom, Reflector, Loop
13. User-interface Testing
check the display of elements on retina & non-retina
- check all elements display with portrait & landscape mode
2. check the app in diff device sizes. ex: 640x480, 1024x768
3. Tools:” Fitnesse, Imacros, coded UI, Jabula, LoadUI
14. Recovery Testing
check app recovery under crashes
- Ensure the process of data recovery after a break in the connection.
2. Test the recovery after a system failure or transaction failure
3. check the ability of the app to process transactions in the event of a power failure[low battery, incorrect app shutdown]
15. Beta Testing
- check no.of testing participants
2. Testing duration
3. shipping
4. Demographic coverage
5. Tools: Hockey App, Ubertesters, TestFlight
Reference Links:
https://bitbar.com/blog/appium-tip-18-how-to-use-xpath-locators-efficiently/
http://automation-home.blogspot.com/2015/05/appium.html
