Skip to content

App testing protocol

jorgesilva edited this page Jul 8, 2012 · 2 revisions

This page contains detailed procedures and instructions on how to test a build of the Tecla Access app to ensure that is complies with all designs and specifications.

Devices Tested

ID Model Version 0.6 0.7.1
1 Motorola Droid / Milestone 2.2.1
2 Samsung Galaxy S 2.2.1
3 Samsung Galaxy S2 2.3.5 Passed Passed
4 Samsung Galaxy Nexus 4.1
5 Asus Nexus 7 4.1

Before Releasing

The tests below can be conducted at any time in the development process to ensure consistency across bug fixes and feature implementations. However, release candidate testing must be prepared following the steps below:

  1. Export and sign release candidate APK
  2. Prepare testing device according to one of the following scenarios:
    • For testing new installs, remove all official and development builds from the device
    • For testing upgrades, make sure the device only has an official build published on the Play store
  3. Transfer and install release candidate APK to testing device

IMPORTANT: Release candidate tests should NEVER be performed with a debug or development build or by updating the app from a debug or development build.

Bug testing


Conditions Test Expected Result Current Issues
Tecla keyboard enabled and selected
  • Enter a text field
  • Hit the pull up/down keyboard key
Keyboard toggles between text and navigation modes

Feature testing

Any switch wakes device

Conditions Test Expected Result Current Issues
  • Tecla keyboard enabled and selected
  • Shield connected
  • Phone screen off
Press any switch
  • Screen turns on without executing the command associated with the switch (i.e., the highlighted key is not activated)

Any switch answers incoming call

Conditions Test Expected Result Current Issues
  • Tecla keyboard enabled and selected
  • A call is being received
Hit any switch
  • The call is answered and the speakerphone is automatically enabled

Long-press in fullscreen switch mode opens settings


Conditions Test Expected Result Current Issues
  • Tecla keyboard enabled and selected
  • Active settings:
    • Show navigation keyboard
    • Fullscreen switch mode
    • Enable self-scanning
Long-press on fullscreen switch Tecla Access Settings window shows up
  • Tecla keyboard enabled and selected
  • Active settings:
    • Show navigation keyboard
    • Fullscreen switch mode
    • Enable inverse scanning
Long-press on fullscreen switch Tecla Access Settings does NOT show up

Settings Testing

Enable voice input




Conditions Test Expected Result Current Issues
  • Tecla keyboard enabled and selected
  • No alternative input or scanning settings active
  1. Go to Tecla Access Settings
  2. Check Enable voice input
  3. Go to a text field
  4. Press the microphone button and dictate a sentence
  • The text field is populated with the dictated sentence
  • Tecla keyboard enabled and selected
  • Active settings:
    • Show navigation keyboard
  1. Go to Tecla Access Settings
  2. Check Enable voice input
  • The navigation keyboard shows the voice input key (microphone icon)
  • Tecla keyboard enabled and selected
  • Active settings:
    • Show navigation keyboard
    • Enable voice input
  1. Go to Tecla Access Settings
  2. Uncheck Enable voice input
  • The navigation keyboard does not show the voice input key (microphone icon)
  • Tecla keyboard enabled and selected
  • Active settings:
    • Show navigation keyboard
    • Enable voice input
  1. Ensure the navigation keyboard is showing
  2. Press the voice input key (microphone icon)
  3. Dictate a command

Show navigation keyboard




Conditions Test Expected Result Current Issues
  • Tecla keyboard enabled and selected
  • No alternative input or scanning settings active
  1. Go to Tecla Access Settings
  2. Check Show navigation keyboard
  • Soft input window shows up on screen
  • Tecla keyboard enabled and selected
  • Active settings:
    • Show navigation keyboard
  1. Power off phone
  2. Power phone back on
  • After completing boot sequence:
    • Soft input window shows up on screen without requiring user input (may take up to 2 minutes)
  • Tecla keyboard enabled and selected
  • Active settings:
    • Show navigation keyboard
  1. Go to Tecla Access Settings
  2. Uncheck Show navigation keyboard
  • Soft input window disappears from screen

Navigation keyboard timeout

Conditions Test Expected Result Current Issues
  • Tecla keyboard enabled and selected
  • Active settings:

    • Show navigation keyboard
  1. Go to Tecla Access Settings
  2. Adjust the Navigation keyboard timeout
  • Soft input window disappears from screen after the selected timeout
  • Tecla keyboard enabled and selected
  • Active settings:

    • Connect to Tecla Shield
    • Show navigation keyboard
    • Navigation keyboard timeout is anything but ‘Never’
  • Shield connected
  • Navigation keyboard showing
  1. Wait for keyboard to dissapear from the screen
  2. Press any switch
  • Soft input window re-appears on screen without activating the highlighted key

Fullscreen switch mode

Conditions Test Expected Result Current Issues
  • Tecla keyboard enabled and selected
  • No alternative input or scanning settings active
  1. Go to Tecla Access Settings
  2. Check Fullscreen switch mode
  • Show navigation keyboard is checked
  • Keyboard shows up on screen
  • Enable self-scanning is enabled and checked
  • Self-scanning starts automatically
  • A toast announces fullscreen switch mode has been enabled
  • Fullscreen can be used as single switch
#7
  • Tecla keyboard enabled and selected
  • Active settings:

    • Show navigation keyboard
    • Fullscreen switch mode
    • Enable self-scanning or Enable inverse scanning
  1. Power off phone
  2. Power phone back on
  • After completing boot sequence:

    • Soft input window shows up on screen without requiring user input
    • Scanning starts (either self or inverse scanning)
    • Fullscreen can be used as single switch
  • Tecla keyboard enabled and selected
  • Active settings:

    • Show navigation keyboard
    • Fullscreen switch mode
    • Enable self-scanning
  1. Go to Tecla Access Settings
  2. Uncheck Fullscreen switch mode
  • Screen can no longer be used as single switch
  • Self-scanning stops
  • Enable self-scanning and Enable inverse scanning are disabled
  • A toast announces fullscreen switch mode has been
    disabled

Connect to Tecla Shield

Conditions Test Expected Result Current Issues
  • Tecla keyboard enabled and selected
  • Bluetooth enabled
  • No alternative input or scanning settings active
  • Shield powered on
  1. Go to Tecla Access Settings
  2. Check Connect to Tecla Shield
  • Show navigation keyboard is checked
  • Keyboard shows up on screen
  • Shield connects
  • Shield’s LED goes to solid green
  • A notification announces Shield is connected
  • A toast announces the Shield is connected
  • Shield interacts with on-screen keyboard
  • Tecla keyboard enabled and selected
  • Active settings:

    • Show navigation keyboard
    • Fullscreen switch mode
    • Enable self-scanning or Enable inverse scanning
    • Connect to Tecla Shield
  • Shield Connected
  1. Go to Tecla Access Settings
  2. Uncheck Fullscreen switch mode
  • Screen can no longer be used as single switch
  • Self-scanning or inverse scanning are still available to the Tecla Shield
  • A toast announces fullscreen switch mode has been disabled
  • Tecla keyboard enabled and selected
  • Shield powered
  • Active settings:

    • Show navigation keyboard
    • Connect to Tecla Shield
  • Shield Connected
  1. Power off phone
  2. Power phone back on
  • After completing boot sequence:

    • Keyboard shows up on screen (may take up to 2 minutes)
    • Shield connects automatically (may take up to 2 additional minutes)
    • If scanning is enabled, keyboard starts scanning
  • Tecla keyboard enabled and selected
  • Shield off
  • Active settings:

    • Show navigation keyboard
    • Connect to Tecla Shield
  1. Power off phone
  2. Power phone back on
  3. Wait for boot process to complete
  4. Wait until keyboard appears on screen (may take up to 2 mins)
  5. Power on Shield and place in range
  • After powering on the Shield:

    • Shield connects automatically (may take up to 2 minutes)
    • If scanning is enabled, keyboard starts scanning
  • Tecla keyboard enabled and selected
  • Active settings:

    • Show navigation keyboard
    • Connect to Tecla Shield
  • Shield connected
  1. Power off Shield
  2. Wait for Switch Event Provider timeout (device notifies Shield has been disconnected).
  3. Power Shield back on
  • After powering on Shield:

    • Shield connects automatically (may take up to 2 additional minutes)
    • If scanning is enabled, keyboard starts scanning
  • Tecla keyboard enabled and selected
  • Active settings:

    • Show navigation keyboard
    • Connect to Tecla Shield
  • Shield connected
  1. Power off Bluetooth radio
  2. Wait for Switch Event Provider timeout (device notifies Shield has been disconnected).
  3. Power Bluetooth radio back on
  • After powering radio back on:

    • Shield connects automatically (may take up to 2 additional minutes)
    • If scanning is enabled, keyboard starts scanning
  • Tecla keyboard enabled and selected
  • Active settings:

    • Show navigation keyboard
    • Connect to Tecla Shield
  • Shield connected

Switch to another input method

  • Switch event provider stops
  • Tecla Shield is disconnected
  • Tecla keyboard enabled NOT selected
  • Active settings:

    • Show navigation keyboard
    • Connect to Tecla Shield

Select the Tecla Access input method

  • Switch event provider starts
  • Shield connects automatically (may take up to 2 additional minutes)
  • If scanning is enabled, keyboard starts scanning

Enable self-scanning




Conditions Test Expected Result Current Issues
  • Tecla keyboard enabled and selected
  • Active settings:
    • Connect to Tecla Shield or Fullscreen switch mode

  1. Go to Tecla Access Settings
  2. Check Enable self-scanning

  • Self-scanning starts immediately

  • Tecla keyboard enabled and selected
  • Active settings:
    • Show navigation keyboard
    • Fullscreen switch mode
    • Enable self-scanning

  1. Go to Tecla Access Settings
  2. Uncheck Enable self-scanning
  • Self-scanning stops
  • Fullscreen switch mode is unchecked
  • Screen cannot be used as single switch

Enable inverse scanning


Conditions Test Expected Result Current Issues
  • Tecla keyboard enabled and selected
  • Active settings:
    • Connect to Tecla Shield or Fullscreen switch mode

  1. Go to Tecla Access Settings
  2. Check Enable inverse scanning
  • If previously checked, Enable self-scanning option is unchecked
  • Tecla Access keyboard shows highlight
  • The selection button starts scanning on press and selects on release