UTI Testing Criteria (UTC) for Android applications

UTI Testing Criteria (UTC) for Android applications

V1.1: June 2012

Section 1. Testing notes

Section 2. Different types of apps and their associated tests

Simple App definition and tests

A Simple Android Application would be one which;

o Does not send SMS/MMS

o Does not write data to standard data files e.g. contacts, calendar

o Does not write data to external services e.g. social networks.

o Can access but does not change the state of networking services e.g. 3G/Wifi/Bluetooth

o Can access external sites to retrieve information

o Can access location information

o Can read standard data files

o Can read SMS/MMS

o Can access screen, sound, camera, keyboard.

o Can write its own data e.g. store pictures, create documents.

This list is not exhaustive as new application types are being developed all the time but will cover 90% of applications.

A simple Android application will require the following tests to be carried out;

1.1 OTA Install

Test Title

1.2 Long launch time

3.1 Send/Receive Data

3.4 Resource downloading

5.2 Message - Receive

5.3 Incoming call

6.1 Memory card operation

7.1 Readability

7.3 Screen Repainting

7.5 Key Layout ease of use

7.8 Function progress

7.10 Multiple display format handling

7.11 Different screen sizes

7.12 Multiple format input handling

7.14 Spelling errors

7.15 Technical text errors

8.1 Language - correct operation

8.3 Language - supported formats

9.1 Suspend/resume from main menu

9.2 Suspend/resume while executing

10.1 Application Mute option

11.1 Help and About

12.1 Functionality Sanity Check

13.1 Scrolling in menus

13.3 Pause

15.1 Application Stability

15.2 Application behaviour after forced close

16.2 Data Deletion

Framework app definition and tests

There are many applications where the same application framework is used repeatedly to create new applications. This is especially prevalent for dictionaries, books and magazine applications but may occur in any application genre.

For these applications it is clearly excessive to fully test the new application as it is to a large degree an existing application with new resource files. For these applications the appropriate criteria (simple or complex) should be used in the first instance and then the following tests are to be performed for subsequent derived applications.

1.1 OTA Install

Test Title

3.1 Send/Receive Data

3.4 Resource downloading

7.1 Readability

11.1 Help and About

12.1 Functionality Sanity Check

15.1 Application Stability

Complex Applications

Any application which does not fall into the above categories i.e. Framework or Simple will be deemed to be Complex and will be subject to testing against the full criteria.

Android UTC Guidance