The ordinally rank submissions task allows reviewers to rank submissions using a "Top 10" (or "Top x") system. When using this system, the scoring can be set to rank from 1st, most preferred submission, to last, but can also be customized using the task options to meet the needs of the review round and your process. To read more about this customization, refer to the Eligibility tab options described below.
In this Article...
- How to Create an Ordinal Ranking Review Task
- Basic Information
- Stage & Group
- Behaviour
- Eligibility
- Visibility
- How to Complete an Ordinal Ranking Review Task
To create an Ordinal Ranking Review task:
- Click on Edit your Site
- Go to Workflow Designer
- Locate the bottom of the stage you wish to add the task to.
NOTE: If you haven't added any stages to your site, Add a New Stage - Select the dropdown icon located in the "Add a new task" field.
- Select the reviewer group you want to add the task for.
- Select "Ordinally rank submissions"
- Select the "Create Task" icon
- Go to Basic Information and Set a Name for your task
- Go to Stage & Group and set the applicable settings
- Go to Behaviour
i. Decide if your task will be Required
ii. Decide if your task will have a Deadline - Go to Eligibility
i. Adjust the ranking settings including the number of submissions to rank and the ranking type to fit your process. - Go to Visibility
i. Decide if this task will be visible to other reviewer groups in the site.
NOTE: Only recommended if the completed review should not be visible to other reviewers when Result Sharing has been enabled. - Save the task
The Basic Information tab provides a quick overview of the elementary descriptions (Title and Description) associated with the task, and can be formatted using the Visual Editor.
| Setting | Description |
| Name |
The name of the task - how it will appear to the user completing the task and how it is referred to in every other instance within your site. |
| Set a Description |
This description is shown to applicants who fill out this form. Specifying a description is optional. When checked, the Visual Editor is displayed, which allows the content to be formatted accordingly. |
The Stage & Group tab allows the administrator to select which stage the task will be in, as well as the group the task should be applicable to.
| Setting | Description |
| Stage |
The specific stage the task should be affiliated with can be selected from this drop down menu. |
| Group |
The Group this task should be assigned to can be selected from this drop down menu. |
| Submission categories |
Unless explicitly specified, this task will be available to all submission categories. NOTE: This option is dependent on categories having been created. |
The Behaviour tab presents critical options that affect the visibility of the task, as well as its importance.
| Setting | Description |
| Required |
This option makes the task required to progress further in the contest. It is not possible to submit the application if a required task has not been completed. |
| Viewable upon completion |
This option will determine whether the user can view their task after completing it. |
| Allow deletion |
This option will allow the applicant to clear completion data of their tasks. |
| Set a deadline |
Deadlines dictate when a user must complete this task by. |
The Eligibility tab determines which reviewer group should have access to this task. This is useful if your site has multiple reviewer groups, each with separate ranking forms.
| Setting | Description |
| This task should only be available for submissions in group |
Select from the drop down which group submissions this ranking application should apply to. |
| This task should be available to |
Select from the drop-down which reviewers should have access to this task. |
| Restrict to members of review team |
If review teams are present on the site you can restrict the ranking task to only members of a specific team. |
| Submissions should be ranked by top |
Numerically define what the scale should be for ranking submissions. |
| Submission scoring should be handled as |
Select how the overall ranking hierarchy should appear. Options available: |
| Make this task available to submissions in any stage |
Selecting this option allows the task to be completed regardless of which round the submission is in. |
The Visibility tab allows the administrator to specify which groups this task will be visible to.
| Setting | Description |
| Modify visibility |
This option will allow you to hide this task from users in specific groups. |
A reviewer will be able to rank submissions using an ordinal ranking system once the review task has been created and the submissions have been assigned to the reviewer. The reviewers will be able to review assigned submissions in their entirety within the review portal by selecting the submission title to view submitted material. Once reviewed, the user can then select Click to Complete in the ordinal review task column which will direct them to a new page where a assigned submissions will be listed and can then be ranked in order from most favourable (1st of x) to least favourable.
NOTE: This selection process is dependent on the setup of submission scoring within the Eligibility tab of this task.