Using WebAnno for curation only?

[Kaja Dobrovoljc]

Dear WebAnno Team,

Is it possible to use WebAnno for curation only? We are working on a project, in which the annotated files will be provided by a third-party tool, but we would like to import those into WebAnno for curation. 

I tried setting up a project in our local installation (WebAnno 3.6.6.), exporting it, replacing the files in the 'annotation' directory with our pre-annotated files and reimporting this as a new project, but, unsurprisingly, this results in an error (Error importing project: IllegalArgumentException: User must be specified).

Do you have any other suggestions on how to import pre-annotated files by two users for curation only?

Thank you in advance and best regards,

Kaja Dobrovoljc

-----

dr. Kaja Dobrovoljc

Artificial Intelligence Laboratory

Jozef Stefan Institute

+386 40 24 26 52

https://ailab.ijs.si/

[Richard Eckart de Castilho]

> On 21. Jul 2021, at 15:08, Kaja Dobrovoljc <kaja.do...@gmail.com> wrote:
>
> Do you have any other suggestions on how to import pre-annotated files by two users for curation only?

You can enable the remote API [1] and then upload annotated documents per-user through it.

It requires though that you have created user accounts for the annotators that you wish to curate and that these annotators have been added to the project. Also, the original texts
must have been imported into the project before you can upload annotations for them. The
texts must match *exactly* the texts in the annotation files you upload including any whitespace so that the offsets of the uploaded annotations can be projected correctly to the
original texts and are comparable between annotators.

Cheers,

-- Richard

[1] https://webanno.github.io/webanno/releases/3.6.7/docs/admin-guide.html#sect_remote_api

----

P.S.: You like WebAnno?

Switch to INCEpTION!

https://inception-project.github.io

INCEpTION has all the flexibility and many more exciting features including a completely new human-in-the-loop annotation assistance support, the ability to search texts and annotations, support for RDF/SPARQL knowledge bases for entity linking, and much more.
And best: it can import your WebAnno annotation (1) projects.

(1) Projects of type 'automation' or 'correction' are not supported.

[Kaja Dobrovoljc]

Dear Richard,

Thank you for the quick reply. We will give it a try and let you know if any issues arise.

Best regards,

Kaja

V V sre., 21. jul. 2021 ob 21:50 je oseba Richard Eckart de Castilho <richard...@gmail.com> napisala:

[Kaja Dobrovoljc]

Dear WebAnno Team,

I'm glad to report that your proposed solution worked as described, thanks again.

However, we have observed some unexpected behavior in Curation mode. Namely, the interface marks some sentences as different (RED), even though the annotations provided by the two users are completely identical (see the screenshot attached). Does this have anything to do with the enigmatic "Invisible annotations on other pages" notification? 

Thanks in advance.

Best regards,

Kaja

V V čet., 22. jul. 2021 ob 10:59 je oseba Kaja Dobrovoljc <kaja.do...@gmail.com> napisala:

[Seid Muhie Yimam]

Dear Kaja

It seems there is an invisible annotation (sentence 4-->5). Can you increase the number of sentences and see if there are sentences crossing the sentence?

Best

Seid M.

[Richard Eckart de Castilho]

On 18. Aug 2021, at 12:07, Kaja Dobrovoljc <kaja.do...@gmail.com> wrote:

However, we have observed some unexpected behavior in Curation mode. Namely, the interface marks some sentences as different (RED), even though the annotations provided by the two users are completely identical (see the screenshot attached). Does this have anything to do with the enigmatic "Invisible annotations on other pages" notification? 

The curation page in INCEpTION [1] has recently seen a lot of improvement, in particular with respect to the coloring of the sidebar. You can simply export your project from WebAnno, import it into INCEpTION and test-drive. The Remote API also works in INCEpTION.

It looks odd that you have an invisible annotation hint here since the dependency annotation layer should normally be configured to not allow cross-sentence annotations. So none of your POS and dependency annotations should cross the sentence boundary - all of them should be visible.

Cheers,

-- Richard

[1] https://inception-project.github.io

[Richard Eckart de Castilho]

On 18. Aug 2021, at 21:27, Richard Eckart de Castilho <richard...@gmail.com> wrote:
>
>> However, we have observed some unexpected behavior in Curation mode. Namely, the interface marks some sentences as different (RED), even though the annotations provided by the two users are completely identical (see the screenshot attached). Does this have anything to do with the enigmatic "Invisible annotations on other pages" notification?#

Just to wrap this up for readers of the list:

The problem was that the sentence end offsets were not matching the end offset of the last token in a sentence. For example, the last token in a sentence would end at position 10,
but then enclosing sentence would only end at 11. This difference can lead to problems in
WebAnno. After fixing the offsets, everything worked as expected.

Cheers,

-- Richard