Submission of encapsulated version of our instances linking tool

[Bill Happi]

Hello everyone, 

please on which platform should I submit the encapsulated version of ours instances linking tool?

Thanks
Bill

[Ernesto Jimenez-Ruiz]

Hi Bill

Are you participating in the MELT tracks or the HOBBIT tracks? Submission to Hobbit tracks should be made directly via the HOBBIT platform.

The deadline has however passed for the OAEI 2022 campaign (apart from the Bio-ML track).

Ernesto

--
You received this message because you are subscribed to the Google Groups "Ontology Alignment Evaluation Initiative (OAEI)" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ontology-alignment-evaluatio...@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/ontology-alignment-evaluation-initiative-oaei/1b527c87-5b68-4692-acd8-6e7dd2369429n%40googlegroups.com.

--

Ernesto Jiménez-Ruiz
Lecturer in Artificial Intelligence

Department of Computer Science

School of Science & Technology
City, University of London

https://www.city.ac.uk/people/academics/ernesto-jimenez-ruiz

[Bill Happi]

Hi Ernesto, 

Hobbit tracks

Bill

[Ernesto Jimenez-Ruiz]

Please give a look to the instructions here: http://oaei.ontologymatching.org/2022/hobbit/index.html

Ernesto

To view this discussion on the web, visit https://groups.google.com/d/msgid/ontology-alignment-evaluation-initiative-oaei/106ba7ee-158a-47e2-a999-c8756618d98dn%40googlegroups.com.

[Bill Happi]

I have some evaluation of these data available here : https://github.com/BillGates98/DLinker

My tool was already saved inside the campaign under the name "DLinker" 

Thanks

Bill

[Ernesto Jimenez-Ruiz]

Hi Nina

Could you assist Bill? He is participating in the Hobbit tracks with DLinker.

Ernesto

To view this discussion on the web, visit https://groups.google.com/d/msgid/ontology-alignment-evaluation-initiative-oaei/e71c6d8c-2fbc-458a-8560-a94e90959e69n%40googlegroups.com.

[jsaveta]

Hi Ernesto,

I have already executed the challenges as I did not find the DLinker system integrated into the HOBBIT platform. 

If you check both OAEI SPIMBENCH benchmark and Spatial Benchmark Version 2.0 in the platform (https://master.project-hobbit.eu/benchmarks)

there is no DLinker system integrated.

If Bill can integrate them soon I can re-run the challenges (this requires some action from Micha). 

A system integration tutorial can be found here: https://hobbit-project.github.io/system_integration.html 

and LogMap integration that I personally find the most useful is here: https://gitlab.com/ernesto.jimenez.ruiz/logmap-hobbit. 

DLinker is supposed to participate in both challenges SPIMBENCH and Spatial? 

Best Regards,

Nina

[Bill Happi]

Hi all, 

please can the python code be encapsulated by the system adapter? if so, how? i could look into it quickly and get back to you in short time.
About the registration of my tool, it has been registered to the OAEI 2022 campaign(confert madam cassia trojahn), I currently have a version encapsulated with MELT that I was supposed to submit unfortunately I don't see on which platform to submit it nevertheless I have already done evaluations on SPATEN and SPIMBENCH HOBBIT which are available on my git that you can consult(https://github.com/BillGates98/DLinker).

I am 100% available to put me online if I am ever late

Thanks
Bill

[Bill Happi]

Hi all,

the link for tool registration is unavailable : http://tiny.cc/oaei21-participation

Thanks

Bill

[hertli...@googlemail.com]

Hi Bill,

in case you have a MELT version of your tool, you can submit it to HOBBIT with the help of the tutorial here:

https://dwslab.github.io/melt/matcher-packaging/hobbit

an example of a python matcher for hobbit can be found here:

https://github.com/dwslab/melt/tree/master/examples/externalPythonMatcherHobbit

Best regards

Sven

[Bill Happi]

Hi sven,
 I'll start right away

Thanks 

Bill

[Bill Happi]

Sven please the output must be as https://github.com/dwslab/melt/blob/master/examples/externalPythonMatcherWeb/oaei-resources/AlignmentFormat.py ? 

Thanks 

Bill

[Bill Happi]

I have already submitted my tool under the name "DLinker-external-python-matcher-hobbit-1.0". 

Thanks for all

Bill 

[jsaveta]

Hi Bill,

I can see your system now under the benchmarks in the Hobbit platform but when I try to execute an experiment it crashes. 

You need to run some experiments (for both benchmarks) and make sure that the system adapter is implemented correctly and the experiments run properly.

* We do not need to spam the whole ontology group. You can privately answer the emails :)

Regards,

Nina

To view this discussion on the web, visit https://groups.google.com/d/msgid/ontology-alignment-evaluation-initiative-oaei/1e5d86d5-7483-4a9b-84ef-a76be0e46119n%40googlegroups.com.

[Bill Happi]

please the output must be as https://github.com/dwslab/melt/blob/master/examples/externalPythonMatcherWeb/oaei-resources/AlignmentFormat.py ? 

[Bill Happi]

this line "<cmd><shell>java -cp "${project.build.finalName}.${project.packaging}:lib/*" org.hobbit.core.run.ComponentStarter de.uni_mannheim.informatik.dws.melt.receiver_hobbit.HobbitWrapper</shell></cmd>" in pom.xml, create problem because inside the "main" folder we have "DemoPythonMatcher" which can received data from any external source as URL, by different with "...HobbitWrapper" which need a system adapter to received the data. 

please, Can we take us online to solve the problem? 

Thanks

Bill

[jsaveta]

The output must be the same as the training datasets that are given here:  https://hobbit-project.github.io/OAEI_2022.html

To view this discussion on the web, visit https://groups.google.com/d/msgid/ontology-alignment-evaluation-initiative-oaei/69a91ef4-80c2-4b39-bd09-6aaf9683af2cn%40googlegroups.com.

[Bill Happi]

Hi all, I have developed a java adapter but when building the image, an error pops up telling me that my account on https://git.project-hobbit.eu/users/sign_in is blocked.
please how can i unblock it?
Thanks
Bill

[Bill Happi]

Hi to all, I have submitted my image "DLinker-external-python-matcher-hobbit-1.0"  I am waiting for your returns about my the evaluations. 

Thanks

Bill

[Bill Happi]

Good evening to all, it seems to me that there is a problem with the platform. I launched the evaluation of the image and it crashed until it became untraceable and my account suddenly disappeared.

Bill

[jsaveta]

Dear Bill, 

You need to make sure that your system adapter is implemented correctly and not just upload the docker image. Thus, you have to run some experiments for each benchmark, make changes in your adapter if needed until it runs. I tested your latest image for the small dataset of spimbench benchmark and "The benchmarked system could not be created.". So the system is not implemented correctly. 

Regards, 

Nina

To view this discussion on the web, visit https://groups.google.com/d/msgid/ontology-alignment-evaluation-initiative-oaei/6a92052e-d67b-4f66-8270-81820df6769bn%40googlegroups.com.

[Bill Happi]

Thanks madame, can i send you by code  ? i need some return of you thanks

Bill

[Bill Happi]

there is way to test my image locally please ? 

[jsaveta]

It is quite complicated to test it locally so I suggest to test it online. 

To view this discussion on the web, visit https://groups.google.com/d/msgid/ontology-alignment-evaluation-initiative-oaei/caee6e40-885d-4126-8ab8-03fea8d8a525n%40googlegroups.com.

[Bill Happi]

it seems that my account on https://master.project-hobbit.eu/home has been deleted or blocked.

now i have updated my image and i need to push it again by i have this message "denied: requested access to the resource is denied".
what should i do?

once make i will wait for your permission to run evaluations.

Thanks
Bill

[jsaveta]

Your account is not blocked I just tested it. Are you sure you are using the correct credentials?

You do not need permission to run experiments. After you successfully run some experiments and make sure everything is running smoothly I will re-run the challenge including DLinker.

Please try again to follow all the steps correctly and debug the system adapter and we can check again on Monday. 

To view this discussion on the web, visit https://groups.google.com/d/msgid/ontology-alignment-evaluation-initiative-oaei/cb63b5a3-0881-4e01-9c01-9ac59f214893n%40googlegroups.com.

[Bill Happi]

I see that the adapter launches well and perhaps receives the data. So I wonder if the server supports processes that launch sub-processes. Because I execute the python command with the script of my tool as input from the files received in the redefined methods.

I was able to execute a version of my image that is just waiting. I attach to this message a screenshot

Thank you for everything
Bill 

[jsaveta]

The system is not just waiting, has crashed. Click the link with the experiment number (https://master.project-hobbit.eu/experiments/1664054304758) and download the system log in order to debug it. 

To view this discussion on the web, visit https://groups.google.com/d/msgid/ontology-alignment-evaluation-initiative-oaei/686c73cc-963f-4eeb-a525-9eae3300ba00n%40googlegroups.com.

[Bill Happi]

I just made an update thank you for the new feedback. thank you for your availability especially.

Thank you
Bill

[Bill Happi]

I made a statement about 'spimbench_small_2018' as the channel delivering the source data and 'spimbench_task' as the channel delivering the target data that I found in the system logs to point my adapter to the data coming from those. I then updated my image online.
 
Thanks
Bill

[jsaveta]

On Sun, Sep 25, 2022, 10:32 Bill Happi <bill...@gmail.com> wrote:

I made a statement about 'spimbench_small_2018' as the channel delivering the source data and 'spimbench_task' as the channel delivering the target data that I found in the system logs to point my adapter to the data coming from those.

Sorry but I don't get what do you mean. You just need to implement your system adapter and the benchmark will provide you with the datasets automatically. You also need to check that the system is running correctly for the Spatial benchmark. 

You do not need to inform me for each step that you are doing. When it runs correctly just let me know. 

Nina

To view this discussion on the web, visit https://groups.google.com/d/msgid/ontology-alignment-evaluation-initiative-oaei/07642b65-7fc4-4814-b31b-ae5dc38a3105n%40googlegroups.com.

[Bill Happi]

Good evening to all, 

Sorry for the delay, thanks for the patience. I finalized the adapter and I tested it, it runs and produces the expected output(.rdf) but I notice that the benchmark orders the return of the results as soon as the adapter is launched. You can test it again('Dlinker Tool-1.0' on the spatial benchmark and spimbench). I am waiting for your feedback.

I also join the link containing the logs of my tool(system log) :
https://master.project-hobbit.eu/experiments/1664223040836

Overall the tool is already ready to work on the benchmark, especially if the tool orders the sending of the results in a respected time frame as on the platform(60 minutes) before asking for the closing of the systems.

Thanks
Bill

[Bill Happi]

for precision you can look at line 10 and 11 of the log file of my system, the immediate closure of the adapter before sending the results obtained.

Thanks
Bill 

[Bill Happi]

test only spatial benchmark sorry

Thank

Bill

[jsaveta]

Dear Bill, 

The benchmark cannot be changed as all the other participants can complete the experiments without an issue.

 

As an experiment is not returning results it means that the system is not correctly implemented and ready to participate into the challenge yet. So please make sure that you produce the output in the exact same format as given in the training datasets (https://hobbit-project.github.io/OAEI_2022.html). Spimbench requires .rdf as output and Spatial .nt fomat (check also the content of the files). 

To view this discussion on the web, visit https://groups.google.com/d/msgid/ontology-alignment-evaluation-initiative-oaei/f223ef33-1531-4071-a591-264fec82eecbn%40googlegroups.com.

[Bill Happi]

Hello everyone, the problem I raise here is a finding from the analysis of logs.

https://master.project-hobbit.eu/experiments/1664268258511
 
in the file '1664268258511 benchmark log.txt', line 226-227

2022-09-27T08:46:32.473Z git.project-hobbit.eu:4567/jsaveta1/spatialtaskgenerator:2.0 spatialtaskgenerato-ea858bdefe8f408c9443ada0ed433ba3.1.311tbckmkearo32somgrpuf8o [pool-1-thread-1] INFO org.hobbit.core.components.AbstractTaskGenerator - Received signal to finish.
2022-09-27T08:46:32.473Z git.project-hobbit.eu:4567/jsaveta1/spatialbenchmarkcontroller:2.0 spatialbenchmarkcontrolle-36c7d169591b4d9895e5aad7f51b41cb.1 .tivbiaumfrelvyykfvv7412yl [main] INFO org.hobbit.spatialbenchmark.platformConnection.BenchmarkController - Waiting for the task generators to finish their work.

as soon as it waits for the system to finish its work it sends a termination signal without waiting for the results.

In my logs I have the results in the requested format but they arrive after the termination signal.

I would like to know if this is related to the fact that I have a guest account?
Thanks
Bill

[Bill Happi]

concerning the content of the files, everything is okay on my side because I have the file size of my result which is calculated very well.

Thanks
Bill