Project Management & KPIs

As a Project Manager, after creating a project there's many things you can do to keep track of the progress.

There are also two charts: one shows the amount of tasks annotated per day and the other one shows the tasks status: how many of them were flagged, fixed, completed or pending.

If you need to take a closer look to your annotators' work this is very helpful. Use the dropdowns to select an annotator and if you want the data to be of their daily or weekly work.

See and sort out by Annotator, Tasks, Progress, Labels, Last annotation, Average time per task or Total time.

Also, you can view their annotations by clicking on the eye icon or you can download them at any point during the project.

See all tasks that have been flagged - Task #, Task Name, Annotator, Comments, Time when it was flagged, if it was Reviewed and Fixed.

You can click on any task to open it.

It shows how many times each label has been used.

You can use this feature to check if your dataset is balanced. For instance, in a sentiment analysis project, you'd usually want to have a balanced representation of positive/negative labels, otherwise you may have a dataset that may train the algorithm wrong.

Also, you can check if the annotators are using the tags correcly. For example, you may see someone over-using a specific tag or not using one at all. If your dataset is balance, this could be an indication of incorrect annotation.

Find out how much your annotators agreed on the project. In order to have data, each task must have been completed by all annotators.

On the left you see:

On the right you get a list of all tasks. You can click on each one to see what each annotator has classified the task as.

If there is an AI Model you want to add to your project, you can do it from here. Depending on the project this process may take some time, you can keep using the platform as usual while it processes.

Keep track of all annotators' actions. See when and what they have done on the project.

Team: Add new Project Managers / QAs / Annotators or delete them.

Dataset: preview the dataset by clicking on it or download it.



Tagset: view your tagset, delete it or add another one



Guidelines: download the guidelines if needed

General: see and edit the Name, Description or Client of the project.

Close: By closing the project annotators won't be able to acces to it. You will be able to reopen the project at any moment.

Delete: By deleting the project, all the information and the annotations will be deleted. This action cannot be undone.