Open Questions

Recently, while reviewing a training game on team formation, I came across this question:

What are the four stages of team development?

You probably know the answer: forming, storming, norming, and performing.

If you answered the question correctly, what does it prove? Sure, you can recall the four stages of team development. But does this mean that you can apply them to real-world teams?

Compare the previous question with these questions:

  • What is an example of effective facilitation behavior during the norming stage?

  • What is an example of effective team-member behavior during the storming stage?

  • Which team-development stage is the most critical one? Why do you think so?

  • What additional stages would you add to the four team-development stages?

I am sure that you have noticed the differences between the original question and the latter questions. The latter questions require more thinking. They reflect the type of questions that professionals face more frequently. They challenge the participants. They require a deeper understanding of the four stages. They are intellectually stimulating.

Unfortunately, however, the type of questions that are most frequently used in training games is similar to the original question. This type features closed, convergent questions that fall in the one-correct-answer category. These recall questions require the lowest levels of thinking. They are meaningless, impersonal, mechanical questions that patronize the learner by asking to determine if a statement is true or to select the best answer among four insipid alternatives.

Why is this type of closed questions so frequently used in training activities? Because it is easy to determine whether the answer is correct or not, because the answers can be evaluated by any player, and because you can program a computer to check the answer.

The use of closed questions conveys a strong impression that players are incapable of producing or recognizing creative responses to open-ended questions.

Don’t get me wrong. I believe recall questions are very important. Beginning learners should master the fundamental facts, figures, terminology, and definitions. They should practice these items until they acquire the required level of fluency.

But I am bothered by the perception that games and interactive exercises are effective only for drill practice. Most trainers and participants and managers believe that games are limited to the basic knowledge and comprehension. These perceptions are reinforced by the trivial questions that are incorporated in most instructional games. For example, people look at this question

By what percent did the Asian population in the U. S. grow in the decade 1980 to 1990?

and wonder what that has to do with the skills of getting along with a coworker from a different culture.

For the past 30 years, I have designed and used games with open-ended, divergent questions that require application, analysis, evaluation, problem-solving, and synthesis. My secret? A fundamental belief that the players are capable of comparing different responses and deciding which one is the best. Also, a belief that by comparatively judging other players’ responses, you master the criteria for effective responses and learn to apply them to your own responses. For example, in a game called Peer Judgement, participants take turns to play the role of a judge and select the best response to an open-ended question.

Here’s a closed question: Is it not better for you to start using open-ended questions in your training games? (Give yourself 1 point if you answered “Yes”.)

Here’s an open-ended question: What strategies can we use for encouraging players to produce and recognize creative responses? (Decide for yourself how many points you deserve.)