Important Evaluation Concepts and Methods

1. After reading Chapter 4 and doing additional research as needed, describe the differences between the terms reliability and validity. What impact do you think these concepts have on data-gathering activities such as observations, interviews, questionnaires, and tests?

Reliability is the ability of a person or system to perform and maintain its functions in routine circumstances, as well as hostile or unexpected circumstances. When talking about gathering data, it has to deal with the consistency of a set of measurements. Validity means something is justifiable or relevant to the subject. Information can be reliable, and still not be valid. An example from Wikipedia states that there are many reliable tests of specific abilities, but not all of them would be valid for predicting job performance. When dealing with the four types of data-gathering, you have to have a reliable way to measure the data, but making sure what you measure is actually related to what you need.

2. After reading Chapter 4, list a variety of instances where using each of the following research methods would be appropriate:
• Observation

a. Showing someone how to use a new program. The learning person would observe the teacher.

b. When evaluating instructor performance, an observer may have to interpret facial expressions and body language to see if the instructor is being encouraging or discouraging.

• Interview

a. When exploring the quality of something, such as customer service quality from different companies.

• Survey

a. Deciding what type of store most shop at.

b. When deciding to release a new product to the market, giving a sample to many people and asking them to comment on the product.

• Test

a. To determine the level knowledge of your audience before you instruct or teach.

b. To identify learning problems.

• Experiment

a. When comparing anything, such as styles of teaching or test driving cars.

b. When companies need to figure out who would be handling newer technology within the company (older or younger people).