Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Programmatic way to deal with greater numbers of documents and users #5081

Open
saveli opened this issue Oct 2, 2024 · 4 comments
Open

Programmatic way to deal with greater numbers of documents and users #5081

saveli opened this issue Oct 2, 2024 · 4 comments

Comments

@saveli
Copy link

saveli commented Oct 2, 2024

Is your feature request related to a problem? Please describe.
I'm always frustrated when manually managing 20ish documents and users per semester I have to assign in a specific pattern, e.g.

  • the workload matrix is huge and easy to confuse lines/columns when you have to scroll both vertically/horizontally
  • bulk changes only count for rows, so selecting a couple documents and a couple users does affect all users, not just the selected ones
  • creating and assigning each user as they change regularly (students in a course)
  • managing/keeping track of what users do

Describe the solution you'd like
Since the GUI is, in my opinion, optimised for few documents and users per project, it could stay that way, and projects with a huge number of documents/users and frequent changes should be managed using an API endpoint.

Describe alternatives you've considered
I tried to look for existing APIs and found AERO and pycaprio. To my understanding, they lack the support for the aforementioned problems.

Additional context
I'd be happy, if there are already existing other solutions.

@reckart
Copy link
Member

reckart commented Oct 2, 2024

Have you tried dynamic workload mode?

@reckart
Copy link
Member

reckart commented Oct 2, 2024

Oh, and have you had a look at the new functionality in the static workload mode to automatically pre-distribute documents to annotators based on a "x annotators per document" setting?

@saveli
Copy link
Author

saveli commented Oct 2, 2024

Sorry, forgot to mention this, I cannot use dynamic mode, since I have to assign in a specific (rule-based) pattern. This is also the root cause.

@reckart
Copy link
Member

reckart commented Oct 2, 2024

If you need a short-term solution, I would recommend you have a look at the database tables and write a script to inject your custom assignments there. The relevant table is annotation_document.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants