Ordering: Standard Question Type

Follow

Ordering questions evaluate students' ability to put items in a sequential order.

Use the links below to jump to a specific area of the article:

Question Setup

Enter your questions or instructions in the Question Setup field.  Then, enter the terms you would like students to arrange in each Options field. Click +Option to add additional choices to the question. Click the x to the right of an option field to remove the choice from the question.

Ordering_question_set_up.gif

Important Note: Do not create an ordering question with the list of Options already in the correct order. If the student does not need to move any of the items to correctly sort them in sequential order, the assessment system will not recognize that the student has answered the question.

Back to top

Correct Answer Setup

The terms you enter in the Options field in Question Setup auto-populate under Correct Answer Setup. Here, drag and drop the options into the correct sequential order.

ordering_correct_answer.gif

Click the + button at the top of the Correct Answer Setup area to enable an additional order that is at least partially correct.

ordering_additional_correct.gif

Click into the percentage field to the right of the additional answer to determine whether the alternate answer is worth partial credit and to set the percentage of possible points students can receive for this answer. 

ordering_additional__.gif

If you create an additional Correct Answer tab, the formula for scoring the question remains the same but instead will use the modified percentage field for the points received calculation:

(Value of percentage field / # slots) * (# correctly filled slots)

Back to top

Scoring Type

Once you have established the correct order, choose your Scoring Type for the question.

ordering_scoring_type.gif

Exact Match

Check Exact Match to require that students order the options in the correct sequence. This option allocates 100% of the possible points for all items in the correct order, and zero points if one or more of the items is not in the correct sequential order.

Partial Match

Check Partial Match to award points relative to the number of "slots" students correctly fill in the ordered list. If the Scoring Type is set to Partial Match, the formula for scoring the question is:

(Value of percentage field / # slots) * (# correctly filled slots) = Partial Match Value

Notes: 
  • The Partial Match Value does not represent how many points the response will receive, but the percentage of the total possible points.
  • The value of the percentage field is always taken from the Correct tab setup (100%), rather than from any of the Alternate correct answer options.
  • For example: If there are four blanks, and a student correctly fills two slots and incorrectly fills two, the value produced by the formula would be 50. (100 percent / 4 slots) * (2 correctly filled slots) = 50(%). If the question is worth 10 points, the student would receive 5 points (50% of 10 is 5).

Partial Pairwise Per Response

Check Partial Pairwise Per Response to determine the score by comparing the options in pairs. If the Scoring Type is set to Partial Pairwise Per Response, an established algorithm will evaluate all possible responses and award points to each possible response based on how closely it resembles the Correct Answer. This calculation is based on each option's position relative to the other options.

For example, if the following is the Correct Answer and Partial Pairwise Per Response has been selected: 

Partial_Pairwise_correct_answer_setup.png

The following incorrect response will be awarded 0 points, because none of the options are in their correct relative positions: 

Partial_Pairwise_incorrect_answer.png

However, if some of the options are in the correct position relative to each other, even if the options are not in the correct slots, the response will be awarded partial credit: 

Partial_pairwise_10.png

Responses with some options in their correct slots will be weighed more favorably:

Partial_pairwise_16.67.png

Note: Partial Match will only award points if an option is in its correct slot, whereas Partial Pairwise Per Response will award points if an option is in a correct relative position to the other options.

Back to top

Additional Setup Options

Select a Layout from the drop-down menu to determine how the options will appear to students.

ordering_layout.gif

Layout Examples:

Button

ordering_layout_ex_button.gif

List

ordering_layout_ex_list.gif

Inline

ordering_layout_ex_inline.gif

Enter Author Notes to explain why certain choices are incorrect, or why you chose to allocate a certain percentage of possible points to alternate answers.If you have edit access to a question, you will see this field. This information will not display to students.

MC_Author_Notes.gif

Back to top

Align Learning Objectives

Click Learning Objectives to open the Learning Objectives browser window.

learning_objectives_button.gif

Click Browse/Search to find and add specific objectives.

ordering_obj_find.gif  ordering_obj_search.gif

Click Manage for objectives already aligned to the question.

ordering_obj_manage.gif

To see how the question will appear to a student taking it in an assessment, click Preview Question.

Preview_Question.gif

To exit the preview screen and return to the question editor, click Edit Question.

Ordering_edit_question.gif

Once you are finished editing the question, click Save.

Save_Question.gif

Back to top

Video Walkthrough

Review this video for guidance on the basics of creating Ordering questions.

Back to top


Comments

0 comments

Article is closed for comments.

Powered by Zendesk