Choose One Task or Multiple Tasks, depending on the amount of data to be annotated. If the amount of data is too large, you can choose to create Multiple Tasks.

1. Select One Task: proceed with the subsequent setting options directly.
2. Select Multiple Tasks: you need to configure the amount of data for each task and the task naming rules, then click the Regenerate Tasks button to generate the task details table.
3. Click the Config button in the task sheet to enter the subsequent configuration pages for each task. You can also bulk-configure the tasks by selecting all tasks at the top left corner and then clicking Config.

On the workflow setting panel, project managers can add review stages for tasks, assign workers to each stage, or share the task with external partners etc.

1. Assign Annotators: On the annotation stage card, choose team members and check the names as annotators to perform annotation work.

   

2. Add Review Stage: If you would like to add review stages to the task, just click Add Stage to add a review stage, and check the team member names to assign reviewers. Up to 5 review stages can be added. You can also click the delete icon at the top right corner of a review stage card to delete it.

   

3. Share with Partner team: If the data amount of the task is too large for one team to handle and you would like to share the task with a Partner team, you can click the Partner tab beside Team Members on the annotation or review stage card, and then select a Partner team. You can also click +Create to jump to the Team center, click Invite Partner and input Partner team ID to invite new Partners.

   

4. Claim Size and Max Claim Duration: At the bottom of each stage card, you can customize theClaim Size which is the number of data that each worker can claim at a time, and Max Claim Duration which is the maximum number of minutes allowed for finishing a claim of data.

   

Check the team member names to assign Task Admin and Inspector to the task. Task Admin is responsible for task management. Only the Inspector has permission to accept the task.

Click and select comment tags that can be displayed on the tool page, such as Missed ,Wrong Object,Wrong Label,Not Fit, etc. All comment tags are pre-selected by default.

Configure task basic settings here which include the following options:

1. When to Start

It controls when the task starts after it is published.

Automatically: Start immediately after the task is published.

All Stages Ready: If share the task with partners is selected in the workflow, the task will only start after all partners accept it.

Wait for My Confirmation: Admins need to start the task manually.

2. History Access Permissions

If you would like to give workers access to view / restore history result versions on the tool page, you can click on the worker roles to grant permissions: Annotator, Reviewer, or Inspector. Multiple selection is supported here. Keep in mind that any changes made to history results can affect performance.

3. Data Accuracy

This is the object accuracy threshold used to determine if the data are accurate. Set the accuracy threshold as needed, and the default threshold is 95%.

4. Allow workers to view submitted data.

If enabled, all workers in the task can view submitted data.

5. Include group results in accuracy and missing rate calculations.

This determins whether to include group results when calculating accuracy and missing rates.

6. Allow the same worker to work on the same data at different stages

If this option is clicked on, it means there are no restrictions on whether a worker has participated in certain data when assigning tasks at different stages.

Annotation Setting provides configuration options including annotaion constraints and pre-settings, which can be applied to the tool page. Annotation results that violate those settings will not be able to be submitted. The specific setting options can be different according to certain dataset types. Below are the total setting options for reference.

1. Results must have Ontology Classes or Classifications.

This determines if your objects and data must have ontology classes or completed classifications to be submitted. If yes, you need to specify how this rule will apply to a group result:

All Results: applied to all instance and segmentation results including groups.

Non-Group Results: applied to all instance and segmentation results except groups.

Group Results Only: applied only to group results in the instance or segmentation results.

📘

The default setting is that all results must have classes or classifications. Group results mean that multiple results are combined together into a group on the tool page. You can check our Group guide in Lidar Fusion Tool chapter for an example.

2. Whether to allow a single result to exist in different groups?

This determines whether the same result can be combined into different group results on the tool page.

3. Should the result be allowed to exceed the image area?

This defines if the object result can exceed the image area on the tool page. If yes, it means workers can create and save results exceeding or outside the image area on the tool page as shown in the screenshot below:

4. Should submission be allowed if the result exceeds the Class limit?

Choose whether to allow submission if results exceed class limits on the tool page. If no, the results which exceed class limits cannot be submitted.

Class limits refer to size limits or constraints when configuring ontology classes linked with the dataset. Many tool types can be set up with customized size limits. Please refer to the Tool Type guide for detailed explanations about class limits of different tool types.

5. Measure Line, Measure Tools and Equisector are all measure auxiliary tools for Image Dataset. You can enable the buttons if needed on the tool page. For LiDAR Dataset, it only displays the Measure Tools setting option.

Measure Line: after enabling, select the color for the measure line.

Measure Tools: after enabling, select the color and add a circle or a rectangle with customized size limits. The radius or distance value unit is meter.

Equisector (Bisector): after enabling, select the color and define the width, vertical and horizontal values.

For example, if you add a circle with a radius of 50m, when you enter the tool page of LiDAR or Image data, the circle will automatically display on the canvas.

6. Allow submitting uncompleted skeleton.

This option appears only in Image Tasks. If enabled, it allows unfinished skeleton points to be submitted on the tool page. If not, then submission of unfinished skeleton points is not allowed.

7. Overlap allowed.

This option appears only in Audio&Video Tasks for clip annotation. If enabled, it means segmented audio clips can overlap with one another on the tool page.