[h-dev] Image annotation

33 views
Skip to first unread message

Mitar

unread,
Apr 8, 2014, 3:33:41 PM4/8/14
to d...@list.hypothes.is
Hi!

Is image annotation already possible? Where can I find code for that?


Mitar

--
http://mitar.tnode.com/
https://twitter.com/mitar_m
--
To unsubscribe, send an email to dev+uns...@list.hypothes.is

Ujvari, Gergely

unread,
Apr 8, 2014, 5:28:06 PM4/8/14
to d...@list.hypothes.is
Hi Mitar,

So currently it is not in our develop branch, and it seems it won't be
there for another some months.

But, the code is here (I'll show branches):
Hypothes.is: https://github.com/hypothesis/h/tree/380-typed-image-13
Annotator: https://github.com/hypothesis/annotator/tree/typed-image-14
and the annotorious plugin here:
https://github.com/gergely-ujvari/annotorious/tree/new-annotator-plugin

This'll go through many refactoring in the future, but the image work is
here.
Let me know if I can help you with the details.

Gergely

On 04/08/2014 09:33 PM, Mitar wrote:
> Hi!
>
> Is image annotation already possible? Where can I find code for that?
>
>
> Mitar
>

--

Mitar

unread,
Apr 8, 2014, 6:39:15 PM4/8/14
to d...@list.hypothes.is
Hi!

Thanks!

Can you maybe explain how all this comes together? So how does
Annotorious come into the play here?


Mitar

--
http://mitar.tnode.com/
https://twitter.com/mitar_m

Ujvari, Gergely

unread,
Apr 8, 2014, 7:12:20 PM4/8/14
to d...@list.hypothes.is
Hello,

Sure, here is it in a nutshell:

Annotorious: This library handles selecting a part of an image (with pluggable selectors) and creating this selection as an annotation in an image, besides this of course it can show the already created image annotations, highlight them, etc. It does both the selection and display with a canvas above the image. (So every image wrapped with annotorious has two canvas above them)

Now, originally there is an Okfn plugin for annotorious but I've replaced this to be compatible with our highlighting system, and be a gateway between Annotator and Annotorious (I'm talking about this file: https://github.com/gergely-ujvari/annotorious/blob/new-annotator-plugin/src/okfn/okfn_image_plugin.js ) Sadly this has to be complied and packed together with the annotorious stuff, because annotorious uses Closure, and this code touches that too.
Through this we can control annotorious to add/remove/highlight/update etc. its image annotations and of course annotation data from them to Annotator is going throught this.

Now, inside the annotator we have the a new plugin called ImageAnchors (https://github.com/hypothesis/annotator/blob/typed-image-14/src/plugin/imageanchors.coffee ) which has an ImageAnchor and ImageHighlight class inside (similar to the TextHighlight and TextAnchor classes) and it implements all necessary functions needed for image annotations. This component speaks with annotorious (with okfn_image_plugin)

For Image annotations we have a new selector type (currently called ShapeSelector) which is added to annotation.target for image annotations.
Format:
����������������selector: [
�������������� type: "ShapeSelector"
�������������� source: image.src
�������������� index: image index on the page
�������������� id: image id property (if has any) shapeType: shape (currently rect or poly)
������������������ geometry: geometry (annotorious defined geometry serialized it contains fraction values, not pixels)
�������������� ]


and with this they all can be handled inside annotator as text-annotations
Our code in H does the selected area thumbmail creation for image annotations (instead of displaying a quote, it displays a thumbnail) and of course uses this image annotator branch.

Happy to elaborate more if needed.


Gergely

Mitar

unread,
May 10, 2014, 4:10:39 AM5/10/14
to d...@list.hypothes.is
Hi!

Just wanted to say thank you for this excellent explanation. This
really made things much more clear.


Mitar

On Tue, Apr 8, 2014 at 4:12 PM, Ujvari, Gergely

--
http://mitar.tnode.com/
https://twitter.com/mitar_m

CCC Founder

unread,
Jan 7, 2021, 11:38:53 PM1/7/21
to dev, Ujvari, Gergely, d...@list.hypothes.is
Hello everyone, 
Any new update (after 6 years!) on image annotation? Having snapshots of pdf segments is crucial for many disciplines (when heavy math is involved or diagrams are present). Is this on the roadmap anymore? I'd appreciate any comments on this. 

Thanks!
-A

Katelyn Lemay

unread,
Jan 8, 2021, 4:21:07 PM1/8/21
to c3fo...@gmail.com, Ujvari, Gergely, d...@list.hypothes.is
Hi there,

Image annotation is absolutely something we still want to bring to Hypothesis, but the past few years have been used to bring features like private and publisher groups, an LTI-compliant offering for major LMSes, and various scaling + infrastructure improvements. We will be heavily focused on our LMS app for the next while, but image annotation will be incredibly useful for our education customers so it is still indeed on the roadmap.

Best,
Katelyn Lemay
Product Manager

--
You received this message because you are subscribed to the Google Groups "dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dev+uns...@list.hypothes.is.
To view this discussion on the web visit https://groups.google.com/a/list.hypothes.is/d/msgid/dev/f5241c9c-e4fb-4aed-8100-ecf6573a5057n%40list.hypothes.is.


--
Katelyn Lemay (pronouns: she/her)
Product Manager, Hypothesis

Reply all
Reply to author
Forward
0 new messages