Beta Testing

240:205 Instructional Computing Design

30 points

 

You have done your best to debug your program.  Now it is time for you to make the final test.  This is where you have uninvolved users try break your software.  As well as trying to make your software fail, these tests will allow you to see how "actual learners" will use the software.

Follow the seven-step process explained on Page 550 of the Alessi and Trollip book to hold the beta test sessions.  Read the specific sections that explain each of the steps.

Assignment:

  • Perform the beta test sessions.
  • Create a document that explains how you complete each of the seven steps:

1. Select the learners

Who did you select?  How did you select them? How many did you select and why did you decide that this was the proper number? What are the demographics of each tester?

2. Explain the procedure to them. 

How much prompting did you give the beta testers?  What did you tell them?  Will the actual users have this sort of introduction to using the software?

3. Find out how much of the subject matter they know already. 

How did you identify their beginning level of knowledge?

4. Observe them going through the program.

What were you observing while the testers used the software?  What were the results of your observations? 

5. Interview them afterward

What was the setting for the interviews?  What did you ask them?  What were their responses?

6. Assess their learning.

How did you assess their learning?  What did you find?

7. Revise the program.

Create a formalized plan with revisions to be complete, who is responsible for each revision, an estimated amount of time it will take to complete each revision, and the deadline for each of these revisions to be complete.

Submit:

  • Your notes on each of the beta testers.
  • Your formalized document which explains how you complete each of the seven steps.

 

CATEGORY

3

2

1

Pts.

Notes on beta testers

 

 

All notes are complete.

 

Beta test document

 

 

 

 

Learners selected

Learner information is complete and valid.

90% of the learner information is complete and valid.

80% of the learner information is complete and valid.

 

Procedure explanation

Procedure explanation is complete and valid

90% of the procedure explanation is complete and valid

80% of the procedure explanation is complete and valid

 

Pretest

Pretest explanation is complete and valid

90% of the pretest explanation is complete and valid

80% of the pretest explanation is complete and valid

 

Observation

Observations are complete and valid

90% of the observations are complete and valid

80% of the observations are complete and valid

 

Interview

Interview information is complete and valid

90% of the interview information is complete and valid

80% of the interview information is complete and valid

 

Posttest

Posttest explanation is complete and valid

90% of the posttest explanation is complete and valid

80% of the posttest explanation is complete and valid

 

Formalized revision plan

 

 

 

 

Problems listed

 

 

All problems listed.

 

Activities

Reasonable activities listed to answer each problem.

Reasonable activities listed to answer 90% of the problems.

Reasonable activities listed to answer 80% of the problems.

 

Responsibilities

 

Specific person listed for each activity.

Specific person listed for 90% of the activities.

 

Time estimates

Reasonable time estimates listed for each activity.

Reasonable time estimates listed for 90% of the activities.

Reasonable time estimates listed for 80% of the activities.

 

Deadlines

 

Reasonable deadlines listed for each activity.

Reasonable deadlines listed for 90% of the activities.

 

 

**Spelling and/or grammar errors in your project (over 2) will cost 1 point each.

This page was last updated by Dr. Z on 1/6/03