Testing vocbench to build a thesaurus from scratch - VB3 and SemanticTurkey issues

141 views
Skip to first unread message

charly....@univ-grenoble-alpes.fr

unread,
Dec 1, 2017, 6:09:08 AM12/1/17
to vocbench-user

Hi all,

I've been testing VB3 for few days now and it seems to be the perfect tool for building the thesaurus I need to control the vocabulary of my web app!
However I'm facing some issues and some help would be much appreciated.

VB3 web app start properly and I can start to create my thesaurus.

  • First problem occurs while I'm trying to align one of my concept with an external concept. I'd like to set a skos properties toward concepts of thesaurus already published (AGROVOC, GACS...) but I cannot browse anything.


  • Second problem (much more annoying) is that I'm losing all the previous work I've done after restarting SemanticTurkey server. I get the following message:

This is probably due to the fact that I cannot stop SemanticTurkey server properly. I've been using the semanticturkey-2.0 pre-built version. I'm using a debian 9 distribution and I first add to change to file format of all .sh files from windows to unix in order to be able to execute them. Still, only the st_server-run script seems to work fine. While running stop script I have the following return:
./stop: 142: exec: /home/charly/semantic-turkey/semanticturkey-2.0/bin/karaf: not found



  • At that point I tried to build the project from the download repository using maven in order to have a clean installation for my distribution. No problem for VocBench, however SemanticTurkey building failed... below the error I get.
[INFO] ------------------------------------------------------------------------
[INFO] Building Semantic Turkey CORE Framework 3.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[WARNING] The POM for it.uniroma2.art.coda:coda-osgi-bundle:jar:1.5-SNAPSHOT is missing, no dependency information available
[WARNING] The POM for it.uniroma2.art.coda:coda-converters:jar:1.5-SNAPSHOT is missing, no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Semantic Turkey .................................... SUCCESS [  0.948 s]
[INFO] Codegen - Annotations .............................. SUCCESS [  7.157 s]
[INFO] st-changetracking-sail ............................. SUCCESS [ 19.252 s]
[INFO] Semantic Turkey CORE Framework ..................... FAILURE [  0.499 s]
[INFO] Codegen - AnnotationProcessors ..................... SKIPPED
[INFO] Semantic Turkey CORE Services ...................... SKIPPED
[INFO] Semantic Turkey Console ............................ SKIPPED
[INFO] Semantic Turkey Builder ............................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 34.059 s
[INFO] Finished at: 2017-12-01T11:56:37+01:00
[INFO] Final Memory: 32M/351M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project st-core-framework: Could not resolve dependencies for project it.uniroma2.art.semanticturkey:st-core-framework:bundle:3.0-SNAPSHOT: The following artifacts could not be resolved: it.uniroma2.art.coda:coda-osgi-bundle:jar:1.5-SNAPSHOT, it.uniroma2.art.coda:coda-converters:jar:1.5-SNAPSHOT: Failure to find it.uniroma2.art.coda:coda-osgi-bundle:jar:1.5-SNAPSHOT in http://clojars.org/repo was cached in the local repository, resolution will not be reattempted until the update interval of clojars.org has elapsed or updates are forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :st-core-framework

Here is my configuration, I'm using Debian 9 distribution
Apache Maven 3.3.9
Maven home: /usr/share/maven
Java version: 1.8.0_151, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
Default locale: fr_FR, platform encoding: UTF-8
OS name: "linux", version: "4.9.0-4-amd64", arch: "amd64", family: "unix"

Looking forward to read you guys!
Best regards,

Charly



Auto Generated Inline Image 1
Auto Generated Inline Image 2

Armando Stellato

unread,
Dec 1, 2017, 5:52:54 PM12/1/17
to charly....@univ-grenoble-alpes.fr, vocbench-user

Dear Charly,

 

Point by point:

 

I've been testing VB3 for few days now and it seems to be the perfect tool for building the thesaurus I need to control the vocabulary of my web app!

Happy you have positive feelings with it :-) let’s solve the issues here below:

 

> However I'm facing some issues and some help would be much appreciated.

> VB3 web app start properly and I can start to create my thesaurus.

  • First problem occurs while I'm trying to align one of my concept with an external concept. I'd like to set a skos properties toward concepts of thesaurus already published (AGROVOC, GACS...) but I cannot browse anything.

cid:autoGeneratedInlineImage1

 

Currently, you can align a concept to concepts from another thesaurus/ontology also loaded in VB in another project. On a same VB3 instance you might have projects hold by different users and thus we want to protect access to others’ content. So, in order to access other projects’ content, you need to setup the visibility of content among projects. As an administrator, you will be seeing the list of projects as in the following window:

 

Import a Project

 

Click on the ACL, and give access to the project you are working on, to the project you want to make visible. For instance, in the following table you are controlling which projects can access the content of testSKOS. SYSTEM is considered to be the standard access (that is, when you are accessing testSKOS content being logged on testSKOS itself), while the lines related to the other projects express the possibility to access testSKOS content from them (i.e. when logged on them). After you have setup the access, I recommend to close and reopen the projects in order to refresh the visibility. After that, you can access from a project X all projects which have granted access to their content to project X

 

  • Second problem (much more annoying) is that I'm losing all the previous work I've done after restarting SemanticTurkey server. I get the following message:

cid:autoGeneratedInlineImage2


This is probably due to the fact that I cannot stop SemanticTurkey server properly. I've been using the semanticturkey-2.0 pre-built version. I'm using a debian 9 distribution and I first add to change to file format of all .sh files from windows to unix in order to be able to execute them. Still, only the st_server-run script seems to work fine. While running stop script I have the following return:

./stop: 142: exec: /home/charly/semantic-turkey/semanticturkey-2.0/bin/karaf: not found



No worries, this is a known issue with only a configuration of RDF4J. This is mentioned here:

http://vocbench.uniroma2.it/doc/faq/#bug_and_issues

you are not losing the repository, but the changes brought during the last session

 

the short answer is: if you close the project before closing ST, then the data will be stored without any loss. In any case, since it is always possible to have a sudden breakdown/crash/whatever, I recommend to use a separate triple store (http://vocbench.uniroma2.it/doc/sys/#separate_triple_store) or, for very small projects, use the in-memory configuration of RDF4J. The separate triple store is in any case highly recommended for collaborative projects and/or big amount of data. I would use an internal repo only for editing an ontlogy, never for a thesaurus.

Thanks for the detailed configuration, much appreciated as it “helps in helping”. However the thing is simple. Sometimes during the evolution of ST, we may have evolved also other dependencies under our control (this is the case in this period) and thus cannot be resolved automatically through Maven but need to be downloaded and compiled as well.

The project here is: http://art.uniroma2.it/coda/

Hope they help. Pls let us now if you need further assistance,

Cheers,

Armando

 

 

 

 



--
You received this message because you are subscribed to the Google Groups "vocbench-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to vocbench-use...@googlegroups.com.
Visit this group at https://groups.google.com/group/vocbench-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/vocbench-user/59a8f1f2-3739-4de6-a187-101d9cfa5cf5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

charly....@univ-grenoble-alpes.fr

unread,
Dec 4, 2017, 11:39:03 AM12/4/17
to vocbench-user
Dear Armando,

Thank you for your assistance. I managed to import agrovoc rdf file into GraphDB database and I loaded it into VocBench.
However something curious appeared, I've only been able to see the information (title and stuffs) of the AGROVOC project on the project tab (sorry I didn't take screenshot). The other projects information were empty. As I couldn't delete any of the project (delete button shaded) and I wanted to clean all those test projects I decided to start over with a clean install (VB3 built with maven, SemanticTurkey 2.2 PRE-BUILT Version, GraphDB PRE-BUILT version). I could register a new account at first access as expected but somehow I cannot create any new project. Nothing append while actioning "Create" button.

I'm surely missing something but I can't figure what this is. Any clue?

Cheers,

Charly

Armando Stellato

unread,
Dec 5, 2017, 5:30:38 AM12/5/17
to charly....@univ-grenoble-alpes.fr, vocbench-user

Dear Charly,

 

Sorry I’m not sure I got what you mean by “were empty”. You mean the project entry is available as a row on the project list, but the metadata (model,  lexicalization model etc..) is not present?

 

A few notes for you just by going blind…

 

  1. Sometimes it is not evident: in order to delete a project, you need to click on a project and then when the light blue selection stripe appears (see screenshot here), you can click on the delete button.

 

  1. You don’t need to delete/reinstall everything even if you want to start from scratch. Removing the SemanticTurkeyData directory would suffice. In order to clean also the application (in most cases not necessary), it suffices to remove the data directory from the semanticturkey installation directory. Pls notice that this data folder only holds data related to plugins, logging etc… everything else about the application (projects, ontology mirror etc…) is in the SemanticTurkeyData directory that I first mentioned

 

    1. Conversely, if you want to start from scratch, just replacing the old ST with a new one does not suffice, you need to remove the SemanticTurkeyData directory. If you don’t do it, the new ST will just look into the same folder again. Pls also consider that the data in GDB for remote repositories won’t be affected (even when you delete a project from ST)

 

  1. Most probably you have paid attention to that but, just to be sure: if you build something from our GIT repository, pls check that it is exactly the same version (use the tags from GIT). If you built VB3 from the latest trunk and then use it with a specific version, you might have client and server misaligned. I suggest to just use the distributed version.

 

  1. The sentence you wrote initially raised some doubts in me: you said “I managed to import agrovoc rdf file into GraphDB database and I loaded it into VocBench.”
    Sorry, again maybe you did everything properly, but the fact that you said that you first imported Agrovoc in GDB first, and then loaded it into VB, made me think there could be some strange procedure.
    Normally, you load the data through VB. VB gets the data from the user and sends it to GDB. The procedure is here:
    http://vocbench.uniroma2.it/doc/user/global_data_management.jsf#load_data so you don’t need to load anything in advance in GDB. Conversely, if you have a project with already loaded data (e.g. you removed a project developed in the past, but the data is still in GDB, when you create a new project, you can then ask to connect to the pre-existing repository in GDB).

 

Hope it helps,

 

Armando

 

 

--

You received this message because you are subscribed to the Google Groups "vocbench-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to vocbench-use...@googlegroups.com.
Visit this group at https://groups.google.com/group/vocbench-user.

charly....@univ-grenoble-alpes.fr

unread,
Dec 5, 2017, 12:09:29 PM12/5/17
to vocbench-user

Dear Armando,

Thank you for your assistance.
Indeed the project entry was available as a row but the metadata and the folder icon were not present. I managed to solve the problem deploying the .war file of the pre-built version in my SemanticTurkey instance!

Regarding to the import of AGROVOC into VB3, you understood well what I've done. Indeed I imported .rdf file in GDB before to load it in VB3 using the "AccessExistingRemote" function while creating a new project. I tried to do using VB3 but I actually have JVM issue... This is a big file and I don't know how import is managed. The file is imported quite fast in GDB though. I'll try to allocate more memory to SemanticTurkey tomorrow and I'll let you know how it goes.  Please find below the log file presents in the error message I got while loading the .rdf file directly from VB3.

Cheers,

Charly

<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=UTF-8"
/>
<title>Error 500 Server Error</title>
</head>
<body><h2>HTTP ERROR 500</h2>
<p>Problem accessing
/semanticturkey/it.uniroma2.art.semanticturkey/st-core-services/InputOutput/loadRDF.
 Reason:
<pre>    Server Error</pre></p><h3>Caused
by:
</h3><pre>org.springframework.web.util.NestedServletException:
 Handler processing failed; nested exception is
java.lang.OutOfMemoryError: Java heap space
        at
org.springframework.web.servlet.DispatcherServlet.triggerAfterCompletionWithError(DispatcherServlet.java:1275)
        at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:951)
        at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:867)
        at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:953)
        at
org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:855)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
        at
org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:829)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
        at
org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812)
        at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669)
        at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)
        at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118)
        at
org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84)
        at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
        at
org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)
        at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
        at
org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103)
        at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
        at
org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113)
        at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
        at
org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter.doFilter(RememberMeAuthenticationFilter.java:146)
        at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
        at
org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54)
        at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
        at
org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45)
        at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
        at
org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91)
        at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
        at
org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183)
        at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
        at
org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105)
        at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
        at
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)
        at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
        at
it.uniroma2.art.semanticturkey.security.CORSFilter.doFilter(CORSFilter.java:40)
        at
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)
        at
org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192)
        at
org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160)
        at
org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:343)
        at
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:260)
        at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
        at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
        at
org.ops4j.pax.web.service.jetty.internal.HttpServiceServletHandler.doHandle(HttpServiceServletHandler.java:70)
        at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
        at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
        at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
        at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
        at
org.ops4j.pax.web.service.jetty.internal.HttpServiceContext.doHandle(HttpServiceContext.java:271)
        at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
        at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
        at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
        at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at
org.ops4j.pax.web.service.jetty.internal.JettyServerHandlerCollection.handle(JettyServerHandlerCollection.java:80)
        at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:499)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311)
        at
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
        at
org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
        at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
        at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
        at java.util.Arrays.copyOf(Arrays.java:3236)
        at
java.io.ByteArrayOutputStream.toByteArray(ByteArrayOutputStream.java:191)
        at
org.eclipse.rdf4j.repository.http.HTTPRepositoryConnection.addModel(HTTPRepositoryConnection.java:589)
        at
org.eclipse.rdf4j.repository.http.HTTPRepositoryConnection.flushTransactionState(HTTPRepositoryConnection.java:642)
        at
org.eclipse.rdf4j.repository.http.HTTPRepositoryConnection.addWithoutCommit(HTTPRepositoryConnection.java:572)
        at
org.eclipse.rdf4j.repository.base.AbstractRepositoryConnection.addWithoutCommit(AbstractRepositoryConnection.java:606)
        at
org.eclipse.rdf4j.repository.base.AbstractRepositoryConnection.add(AbstractRepositoryConnection.java:471)
        at
org.eclipse.rdf4j.repository.base.RepositoryConnectionWrapper.add(RepositoryConnectionWrapper.java:186)
        at
it.uniroma2.art.semanticturkey.ontology.impl.OntologyManagerImpl.loadOntologyData(OntologyManagerImpl.java:1022)
        at
it.uniroma2.art.semanticturkey.services.core.InputOutput.loadRDFInternal(InputOutput.java:134)
        at
it.uniroma2.art.semanticturkey.services.core.InputOutput.loadRDF(InputOutput.java:109)
        at
it.uniroma2.art.semanticturkey.services.core.InputOutput$$FastClassBySpringCGLIB$$ef882a37.invoke(&lt;generated&gt;)
        at
org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
        at
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:700)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at
org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:93)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at
it.uniroma2.art.semanticturkey.search.SearchUpdateInterceptor.invoke(SearchUpdateInterceptor.java:91)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at
it.uniroma2.art.semanticturkey.versioning.VersioningMetadataInterceptor.invoke(VersioningMetadataInterceptor.java:139)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at
it.uniroma2.art.semanticturkey.history.HistoryMetadataInterceptor.invoke(HistoryMetadataInterceptor.java:153)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at
it.uniroma2.art.semanticturkey.services.aspects.WritabilityCheckerInterceptor.invoke(WritabilityCheckerInterceptor.java:48)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at
org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:64)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at
org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:96)
        at
org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:260)
        at
org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at
org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:51)
</pre>
<h3>Caused by:</h3><pre>java.lang.OutOfMemoryError:
Java heap space
        at java.util.Arrays.copyOf(Arrays.java:3236)
        at
java.io.ByteArrayOutputStream.toByteArray(ByteArrayOutputStream.java:191)
        at
org.eclipse.rdf4j.repository.http.HTTPRepositoryConnection.addModel(HTTPRepositoryConnection.java:589)
        at
org.eclipse.rdf4j.repository.http.HTTPRepositoryConnection.flushTransactionState(HTTPRepositoryConnection.java:642)
        at
org.eclipse.rdf4j.repository.http.HTTPRepositoryConnection.addWithoutCommit(HTTPRepositoryConnection.java:572)
        at
org.eclipse.rdf4j.repository.base.AbstractRepositoryConnection.addWithoutCommit(AbstractRepositoryConnection.java:606)
        at
org.eclipse.rdf4j.repository.base.AbstractRepositoryConnection.add(AbstractRepositoryConnection.java:471)
        at
org.eclipse.rdf4j.repository.base.RepositoryConnectionWrapper.add(RepositoryConnectionWrapper.java:186)
        at
it.uniroma2.art.semanticturkey.ontology.impl.OntologyManagerImpl.loadOntologyData(OntologyManagerImpl.java:1022)
        at
it.uniroma2.art.semanticturkey.services.core.InputOutput.loadRDFInternal(InputOutput.java:134)
        at
it.uniroma2.art.semanticturkey.services.core.InputOutput.loadRDF(InputOutput.java:109)
        at
it.uniroma2.art.semanticturkey.services.core.InputOutput$$FastClassBySpringCGLIB$$ef882a37.invoke(&lt;generated&gt;)
        at
org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
        at
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:700)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at
org.springframework.validation.beanvalidation.MethodValidationInterceptor.invoke(MethodValidationInterceptor.java:93)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at
it.uniroma2.art.semanticturkey.search.SearchUpdateInterceptor.invoke(SearchUpdateInterceptor.java:91)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at
it.uniroma2.art.semanticturkey.versioning.VersioningMetadataInterceptor.invoke(VersioningMetadataInterceptor.java:139)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at
it.uniroma2.art.semanticturkey.history.HistoryMetadataInterceptor.invoke(HistoryMetadataInterceptor.java:153)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at
it.uniroma2.art.semanticturkey.services.aspects.WritabilityCheckerInterceptor.invoke(WritabilityCheckerInterceptor.java:48)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at
org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:64)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at
org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:96)
        at
org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:260)
        at
org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at
org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:51)
</pre>
<hr><i><small>Powered by
Jetty://
</small></i><hr/>

</body>
</html>

               


Armando Stellato

unread,
Dec 5, 2017, 12:58:07 PM12/5/17
to charly....@univ-grenoble-alpes.fr, vocbench-user

Hi Charly,

 

Yes a change in the heap will solve.

 

If you load first in GDB first and then you access as you wrote, it is fine.

http://vocbench.uniroma2.it/doc/user/global_data_management.jsf#load_data

 

However, if you project supports validation and you need to load large amounts of data, you might be missing the possibility to do the following:

http://vocbench.uniroma2.it/doc/user/global_data_management.jsf#loading_large_amounts_of_data_on_projects_requiring_validation

Pls consider that, if you have validation enabled, the import of a large dataset will be very expensive. However, the above option (that you can enable only through VB) will allow the operation to skip the validation of the data it loads. Otherwise, since the validation is managed through a sail (and is thus part of the manager of the repository) every action passed directly through GDB has to undergo validation.

 

For Agrovoc, for a project with both history and validation, I had to setup (if I recall well) the max memory of the heap to 6Gb,

 

Cheers,


Armando

 

 

 

From: vocben...@googlegroups.com [mailto:vocben...@googlegroups.com] On Behalf Of charly....@univ-grenoble-alpes.fr
Sent: Tuesday, December 5, 2017 6:09 PM
To: vocbench-user <vocben...@googlegroups.com>
Subject: [vocbench-user] Re: Testing vocbench to build a thesaurus from scratch - VB3 and SemanticTurkey issues

 

--

You received this message because you are subscribed to the Google Groups "vocbench-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to vocbench-use...@googlegroups.com.
Visit this group at https://groups.google.com/group/vocbench-user.

Reply all
Reply to author
Forward
0 new messages