Curation of a document classification project

[Raia Abu Ahmad]

Dear INCEpTION developers, 

We've recently started a project of document classification, where I used the default setting when creating such a project and just changed the tagset to match my purposes. 

However, when I go to the curation page to start looking at the annotations, the annotations are not visible for me as a curator. I do see the two windows of annotators and the symbol that they finished their annotations and closed the document, but the annotation itself doesn't show up for me. I attach a screenshot. 

The curation, as opposed to the annotation seems to show up as separate lines in a document, when my project has a document annotation scheme rather than annotating spans on separate lines. So maybe this is straightforward and I missed something in the settings? 

I would appreciate your help as soon as possible, since the project is quite urgent. 

Thank you, 

Raia Abu Ahmad

[Richard Eckart de Castilho]

Hello Raia,

> On 19. Feb 2025, at 10:48, Raia Abu Ahmad <raya.ab...@gmail.com> wrote:
>
> We've recently started a project of document classification, where I used the default setting when creating such a project and just changed the tagset to match my purposes.
>
> However, when I go to the curation page to start looking at the annotations, the annotations are not visible for me as a curator. I do see the two windows of annotators and the symbol that they finished their annotations and closed the document, but the annotation itself doesn't show up for me. I attach a screenshot.

I'm afraid the curation of document-level annotations is currently not possible:

https://github.com/inception-project/inception/issues/2702

There is also an info box in the documentation pointing this out:

https://inception-project.github.io/releases/35.3/docs/user-guide.html#_document_level_annotations

> The curation, as opposed to the annotation seems to show up as separate lines in a document, when my project has a document annotation scheme rather than annotating spans on separate lines. So maybe this is straightforward and I missed something in the settings?

In recent versions of INCEpTION you can choose if your want to use the traditional "split view" curation page or a new "integrated view" which looks like the annotation page.

You can switch between the two in the "Curation" panel of your project's settings.

Cheers,

-- Richard

[Richard Eckart de Castilho]

Hi again,

> On 19. Feb 2025, at 10:48, Raia Abu Ahmad <raya.ab...@gmail.com> wrote:
>

> The curation, as opposed to the annotation seems to show up as separate lines in a document, when my project has a document annotation scheme rather than annotating spans on separate lines. So maybe this is straightforward and I missed something in the settings?
>
> I would appreciate your help as soon as possible, since the project is quite urgent.

Maybe what you could do as a workaround for document-level annotation is:

* go to the agreement page in your project
* select a document-level layer/feature which you would like to curate
* use the export diff to download the annotations in a CSV format

At least that should give you an easy way to see disagreements between your annotators and something that you can easily edit e.g. in a spreadsheet application.

Cheers,

-- Richard

[Raia Abu Ahmad]

Hi Richard, 

Thanks! I did not notice the info box, so thanks for pointing that out and for your workaround tip. We will either do that or switch the project to token-level annotations where we annotate the first token with the document-level label as a workaround and take it from there. 

Best regards, 

Raia

--
You received this message because you are subscribed to a topic in the Google Groups "inception-users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/inception-users/4-IXhbfzlhE/unsubscribe.
To unsubscribe from this group and all its topics, send an email to inception-use...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/inception-users/683EA82E-4CAF-425D-84DC-C5C65D6FEF3D%40gmail.com.