0LAUK0 2018Q1 Group 2 - Prototype Functionality Testing: Difference between revisions

From Control Systems Technology Group
Jump to navigation Jump to search
(added content from drive)
 
(→‎Method: updated formatting of specific section)
Line 49: Line 49:
The following sections details every individual test script that will be performed when this test plan is executed. Each sub-test includes a hypothesis. The results of the experiment will be added using the ''Obtained outcome'' feature.
The following sections details every individual test script that will be performed when this test plan is executed. Each sub-test includes a hypothesis. The results of the experiment will be added using the ''Obtained outcome'' feature.


Move up and down within response time and exceeding the maximum deviation of the
1. Move up and down within response time and exceeding the maximum deviation of the screen.
screen.
:Expected outcome: The screen moves along with your face.
 
:Obtained outcome: …
Expected outcome: The screen moves along with your face.
Obtained outcome: …
2. Move up and down within response time without exceeding the maximum deviation.
2. Move up and down within response time without exceeding the maximum deviation.
Expected outcome: The screen doesn’t move along.
:Expected outcome: The screen doesn’t move along.
Obtained outcome: …
:Obtained outcome: …
3. Move up and down exceeding the response time and exceeding the maximum deviation of
3. Move up and down exceeding the response time and exceeding the maximum deviation of
the screen.
the screen.
Expected outcome: The screen doesn’t move along.
:Expected outcome: The screen doesn’t move along.
Obtained outcome: …
:Obtained outcome: …
4. Move up and down exceeding the response time without exceeding the maximum
4. Move up and down exceeding the response time without exceeding the maximum
deviation.
deviation.
Expected outcome: The screen doesn’t move along.
:Expected outcome: The screen doesn’t move along.
Obtained outcome: …
:Obtained outcome: …
5. Move left and right within response time and exceeding the maximum deviation of the
5. Move left and right within response time and exceeding the maximum deviation of the
screen.
screen.
Expected outcome: The screen moves along with your face.
:Expected outcome: The screen moves along with your face.
Obtained outcome: …
:Obtained outcome: …
6. Move left and right within response time without exceeding the maximum deviation.
6. Move left and right within response time without exceeding the maximum deviation.
Expected outcome: The screen doesn’t move along.
:Expected outcome: The screen doesn’t move along.
Obtained outcome: …
:Obtained outcome: …
7. Move left and right exceeding the response time and exceeding the maximum deviation of
7. Move left and right exceeding the response time and exceeding the maximum deviation of
the screen.
the screen.
Expected outcome: The screen doesn’t move along.
:Expected outcome: The screen doesn’t move along.
Obtained outcome: …
:Obtained outcome: …
8. Move left and right exceeding the response time without exceeding the maximum
8. Move left and right exceeding the response time without exceeding the maximum
deviation.
deviation.
Expected outcome: The screen doesn’t move along.
:Expected outcome: The screen doesn’t move along.
Obtained outcome: …
:Obtained outcome: …
9. Rotate back and forth in X-Z plane within response time and exceeding the maximum
9. Rotate back and forth in X-Z plane within response time and exceeding the maximum
angle deviation.
angle deviation.
Expected outcome: The screen moves along with your face.
:Expected outcome: The screen moves along with your face.
Obtained outcome: …
:Obtained outcome: …
10. Rotate back and forth in X-Z plane within response time without exceeding the maximum
10. Rotate back and forth in X-Z plane within response time without exceeding the maximum
angle deviation.
angle deviation.
Expected outcome: The screen doesn’t move along.
:Expected outcome: The screen doesn’t move along.
Obtained outcome: …
:Obtained outcome: …
11. Rotate back and forth in X-Z plane exceeding the response time and exceeding the
11. Rotate back and forth in X-Z plane exceeding the response time and exceeding the
maximum angle deviation.
maximum angle deviation.
Expected outcome: The screen doesn’t move along.
:Expected outcome: The screen doesn’t move along.
Obtained outcome: …
:Obtained outcome: …
12. Rotate back and forth in X-Z plane exceeding the response time without exceeding the
12. Rotate back and forth in X-Z plane exceeding the response time without exceeding the
maximum angle deviation.
maximum angle deviation.
Expected outcome: The screen doesn’t move along.
:Expected outcome: The screen doesn’t move along.
Obtained outcome: …
:Obtained outcome: …
13. Rotate back and forth in Y-Z plane within response time and exceeding the maximum
13. Rotate back and forth in Y-Z plane within response time and exceeding the maximum
angle deviation.
angle deviation.
Expected outcome: The screen moves along with your face.
:Expected outcome: The screen moves along with your face.
Obtained outcome: …
:Obtained outcome: …
 
14. Rotate back and forth in Y-Z plane within response time without exceeding the maximum
14. Rotate back and forth in Y-Z plane within response time without exceeding the maximum
angle deviation.
angle deviation.
Expected outcome: The screen doesn’t move along.
:Expected outcome: The screen doesn’t move along.
Obtained outcome: …
:Obtained outcome: …
15. Rotate back and forth in Y-Z plane exceeding the response time and exceeding the
15. Rotate back and forth in Y-Z plane exceeding the response time and exceeding the
maximum angle deviation.
maximum angle deviation.
Expected outcome: The screen doesn’t move along.
:Expected outcome: The screen doesn’t move along.
Obtained outcome: …
:Obtained outcome: …
16. Rotate back and forth in Y-Z plane exceeding the response time without exceeding the
16. Rotate back and forth in Y-Z plane exceeding the response time without exceeding the
maximum angle deviation.
maximum angle deviation.
Expected outcome: The screen doesn’t move along.
:Expected outcome: The screen doesn’t move along.
Obtained outcome: …
:Obtained outcome: …
17. Move forward within the response time to a distance too close to the screen.
17. Move forward within the response time to a distance too close to the screen.
Expected outcome: The screen will move backwards in order to maintain the minimal
:Expected outcome: The screen will move backwards in order to maintain the minimal distance.
distance.
:Obtained outcome: …
Obtained outcome: …
18. Move backwards within the response time to a distance too far from the screen.
18. Move backwards within the response time to a distance too far from the screen.
Expected outcome: The screen will move forward in order to maintain the maximal distance.
:Expected outcome: The screen will move forward in order to maintain the maximal distance.
Obtained outcome: …
:Obtained outcome: …
19. Move back and forth exceeding the response time.
19. Move back and forth exceeding the response time.
Expected outcome: The screen won’t move along.
:Expected outcome: The screen won’t move along.
Obtained outcome: …
:Obtained outcome: …
20. The screen is illuminated with light, but the brightness of the screen in comparison to the
20. The screen is illuminated with light, but the brightness of the screen in comparison to the
external light is still sufficient.
external light is still sufficient.
Expected outcome: The screen won’t adjust its brightness.
:Expected outcome: The screen won’t adjust its brightness.
Obtained outcome: …
:Obtained outcome: …
21. The screen is illuminated with enough light so that the brightness of the screen in
21. The screen is illuminated with enough light so that the brightness of the screen in comparison to the external light is not sufficient anymore.
comparison to the external light is not sufficient anymore.
:Expected outcome: The screen adjusts its brightness until the difference in comparison to the external light is sufficient.
Expected outcome: The screen adjusts its brightness until the difference in comparison to
:Obtained outcome: …
the external light is sufficient.
Obtained outcome: …
22. Use the StealthChop to make the actuator less noisy.
22. Use the StealthChop to make the actuator less noisy.
Expected outcome: The actuator gets less noisy.
:Expected outcome: The actuator gets less noisy.
Obtained outcome: …
:Obtained outcome: …
23. Install new thresholds and move/rotate within response time exceeding the new defined
23. Install new thresholds and move/rotate within response time exceeding the new defined
thresholds.
thresholds.
Expected outcome: The screen will move along.
:Expected outcome: The screen will move along.
Obtained outcome: …
:Obtained outcome: …
24. Install new thresholds and move/rotate within response time without exceeding the new
24. Install new thresholds and move/rotate within response time without exceeding the new
defined thresholds.
defined thresholds.
Expected outcome: The screen won’t move along.
:Expected outcome: The screen won’t move along.
Obtained outcome: …
:Obtained outcome: …
25. Install new thresholds and move/rotate exceeding the response time and exceeding the
25. Install new thresholds and move/rotate exceeding the response time and exceeding the
new defined thresholds.
new defined thresholds.
Expected outcome: The screen won’t move along.
:Expected outcome: The screen won’t move along.
Obtained outcome: …
:Obtained outcome: …
26. Install new thresholds and move/rotate exceeding the response time without exceeding
26. Install new thresholds and move/rotate exceeding the response time without exceeding
the new defined thresholds.
the new defined thresholds.
 
:Expected outcome: The screen won’t move along.
Expected outcome: The screen won’t move along.
:Obtained outcome: …
Obtained outcome: …
27. Fill in the input parameters (like height, physical issues, etc.).
27. Fill in the input parameters (like height, physical issues, etc.).
Expected outcome: The screen will position itself in the optimal position according to the
:Expected outcome: The screen will position itself in the optimal position according to the parameters given.
parameters given.
:Obtained outcome: …
Obtained outcome: …
28. Let the screen run for two hours.
28. Let the screen run for two hours.
Expected outcome: After the two hours, the screen will lock itself down for 15 minutes.
:Expected outcome: After the two hours, the screen will lock itself down for 15 minutes.
Obtained outcome: …
:Obtained outcome: …
29. Let the screen bump into an obstacle, exceeding the maximum amount of resistance it will
29. Let the screen bump into an obstacle, exceeding the maximum amount of resistance it will
take.
take.
Expected outcome: The screen will stop moving.
:Expected outcome: The screen will stop moving.
Obtained outcome: …
:Obtained outcome: …
30. Let the screen bump into an obstacle, without exceeding the maximum amount of
30. Let the screen bump into an obstacle, without exceeding the maximum amount of
resistance it will take.
resistance it will take.
Expected outcome: The screen will keep moving.
:Expected outcome: The screen will keep moving.
Obtained outcome: …
:Obtained outcome: …

Revision as of 17:48, 30 September 2018

Test plan

Introduction

In order to be able to present our design to potential buyers (Atlas), everything needs to be tested first. The aim of this test plan is to make sure that everything works as it supposed to work. If any defects are found, improvements to the design can be made in order to eliminate these errors. Every defect found can be categorised as being a critical, high, medium or low defect. Of course, the critical defects will be fixed first followed by the high, medium and low defects. The goal is to have in the end zero critical and high defects, and as less medium and low defects as possible. In the beginning, all individual components will be tested whether they’re working as well as the chains of these components before integrating them in our actual design. These are the unit and integration tests. Once our design is ready, the requirements will be tested first e.g. whether the monitor can move and rotate at all, do the cameras work, etc. When everything is all right, the thresholds and the min/max deviations can be installed. It will then be verified whether these are working by executing some more tests. These are the tests described in more detail below. Mainly these tests are about the detection of movement of the user. In case there is some time left, some negative testing can be done when desired. These are tests where one tries to let the device fail. By doing this, one can figure out how easy it would be to mislead the device.

Overview

Functional Requirements

  • Height of the screen to eyes and max deviation up down.
  • Centre of the screen to eyes and max deviation left right.
  • Rotation through X-Z plane.
  • Rotation through Y-Z plane.
  • Min/max distance eye to screen.
  • Brightness of the screen in comparison to external light.

Non-Functional Requirements

  • Minimum response time to adapt (all functional requirements except).
  • Maximum noise.
  • Custom made thresholds.
  • Input profile parameters.
  • Mandatory rest periods.
  • Reaction to resistance.

Test Types

  • Unit test: test individual components e.g. stepper motors. Executed by project team.
  • Integration test: test end to end chain of components. Executed by project team.
  • User test: test performed by an user. Executed by independent users.

Acceptance Criteria

  • Definition severity (critical-high-medium-low) of defects.
  • Threshold to accept product.

Test Scripts

  • Description of individual tests; describe expected results and obtained results.


Method

The following sections details every individual test script that will be performed when this test plan is executed. Each sub-test includes a hypothesis. The results of the experiment will be added using the Obtained outcome feature.

1. Move up and down within response time and exceeding the maximum deviation of the screen.

Expected outcome: The screen moves along with your face.
Obtained outcome: …

2. Move up and down within response time without exceeding the maximum deviation.

Expected outcome: The screen doesn’t move along.
Obtained outcome: …

3. Move up and down exceeding the response time and exceeding the maximum deviation of the screen.

Expected outcome: The screen doesn’t move along.
Obtained outcome: …

4. Move up and down exceeding the response time without exceeding the maximum deviation.

Expected outcome: The screen doesn’t move along.
Obtained outcome: …

5. Move left and right within response time and exceeding the maximum deviation of the screen.

Expected outcome: The screen moves along with your face.
Obtained outcome: …

6. Move left and right within response time without exceeding the maximum deviation.

Expected outcome: The screen doesn’t move along.
Obtained outcome: …

7. Move left and right exceeding the response time and exceeding the maximum deviation of the screen.

Expected outcome: The screen doesn’t move along.
Obtained outcome: …

8. Move left and right exceeding the response time without exceeding the maximum deviation.

Expected outcome: The screen doesn’t move along.
Obtained outcome: …

9. Rotate back and forth in X-Z plane within response time and exceeding the maximum angle deviation.

Expected outcome: The screen moves along with your face.
Obtained outcome: …

10. Rotate back and forth in X-Z plane within response time without exceeding the maximum angle deviation.

Expected outcome: The screen doesn’t move along.
Obtained outcome: …

11. Rotate back and forth in X-Z plane exceeding the response time and exceeding the maximum angle deviation.

Expected outcome: The screen doesn’t move along.
Obtained outcome: …

12. Rotate back and forth in X-Z plane exceeding the response time without exceeding the maximum angle deviation.

Expected outcome: The screen doesn’t move along.
Obtained outcome: …

13. Rotate back and forth in Y-Z plane within response time and exceeding the maximum angle deviation.

Expected outcome: The screen moves along with your face.
Obtained outcome: …

14. Rotate back and forth in Y-Z plane within response time without exceeding the maximum angle deviation.

Expected outcome: The screen doesn’t move along.
Obtained outcome: …

15. Rotate back and forth in Y-Z plane exceeding the response time and exceeding the maximum angle deviation.

Expected outcome: The screen doesn’t move along.
Obtained outcome: …

16. Rotate back and forth in Y-Z plane exceeding the response time without exceeding the maximum angle deviation.

Expected outcome: The screen doesn’t move along.
Obtained outcome: …

17. Move forward within the response time to a distance too close to the screen.

Expected outcome: The screen will move backwards in order to maintain the minimal distance.
Obtained outcome: …

18. Move backwards within the response time to a distance too far from the screen.

Expected outcome: The screen will move forward in order to maintain the maximal distance.
Obtained outcome: …

19. Move back and forth exceeding the response time.

Expected outcome: The screen won’t move along.
Obtained outcome: …

20. The screen is illuminated with light, but the brightness of the screen in comparison to the external light is still sufficient.

Expected outcome: The screen won’t adjust its brightness.
Obtained outcome: …

21. The screen is illuminated with enough light so that the brightness of the screen in comparison to the external light is not sufficient anymore.

Expected outcome: The screen adjusts its brightness until the difference in comparison to the external light is sufficient.
Obtained outcome: …

22. Use the StealthChop to make the actuator less noisy.

Expected outcome: The actuator gets less noisy.
Obtained outcome: …

23. Install new thresholds and move/rotate within response time exceeding the new defined thresholds.

Expected outcome: The screen will move along.
Obtained outcome: …

24. Install new thresholds and move/rotate within response time without exceeding the new defined thresholds.

Expected outcome: The screen won’t move along.
Obtained outcome: …

25. Install new thresholds and move/rotate exceeding the response time and exceeding the new defined thresholds.

Expected outcome: The screen won’t move along.
Obtained outcome: …

26. Install new thresholds and move/rotate exceeding the response time without exceeding the new defined thresholds.

Expected outcome: The screen won’t move along.
Obtained outcome: …

27. Fill in the input parameters (like height, physical issues, etc.).

Expected outcome: The screen will position itself in the optimal position according to the parameters given.
Obtained outcome: …

28. Let the screen run for two hours.

Expected outcome: After the two hours, the screen will lock itself down for 15 minutes.
Obtained outcome: …

29. Let the screen bump into an obstacle, exceeding the maximum amount of resistance it will take.

Expected outcome: The screen will stop moving.
Obtained outcome: …

30. Let the screen bump into an obstacle, without exceeding the maximum amount of resistance it will take.

Expected outcome: The screen will keep moving.
Obtained outcome: …