Re: [Dspace-tech] Fw: ##Urgent## Emergency## Technical Problem in DSpace- using it for my Masters Thesis of Computer Science ## Student of HUNAN UNIVERSITY, CHANGSHA, HUNAN, CHINA.

[Mark H. Wood]

On Fri, Apr 24, 2015 at 08:32:04AM +0000, Usman wrote:
> I want to analyze, filter and work on the 'User log files' of Dspace. That means those log files which contain user's information about their interactions with the system,their searches (content searched for) etc. 
> Can anyone please tell me that where are these user log files? In which folder ? On which path? 

Wherever you installed DSpace, you should find a subdirectory named
'log'. log/dspace.log.* should contain such information.

It is possible to configure DSpace to write its logs elsewhere. Find
the value of 'log.dir' in config/dspace.cfg to see where the logs have
been directed.

--
Mark H. Wood
Lead Technology Analyst

University Library
Indiana University - Purdue University Indianapolis
755 W. Michigan Street
Indianapolis, IN 46202
317-274-0749
www.ulib.iupui.edu

[Luiz dos Santos]

Are you using xmlui or jspui? I am face up the same problem here, in our case we are using xmlui, but we have a apache http server in front of Dspace, so in actually I'm looking at access log, because over there I can see the ip of the request that are coming, but if you just want see the trafic, the cocoon log could be an option.

regards

Luiz

------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
DSpace-tech mailing list
DSpac...@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Bruno Zanette]

Usman,

Dspace.log do contains those infos.

For instance, filtering for "anonymous" on my dspace.log files i get things like:
dspace.log.2015-03-23:2015-03-23 16:57:18,072 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_item:handle=123456789/583
dspace.log.2015-03-23:2015-03-23 16:57:18,082 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_item:handle=123456789/578
dspace.log.2015-03-23:2015-03-23 16:57:18,092 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_item:handle=123456789/597
dspace.log.2015-03-23:2015-03-23 16:57:18,102 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_item:handle=123456789/584
dspace.log.2015-03-23:2015-03-23 16:57:18,112 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_item:handle=123456789/585
dspace.log.2015-03-23:2015-03-23 16:57:18,122 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_item:handle=123456789/586
dspace.log.2015-03-23:2015-03-23 16:57:18,132 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_item:handle=123456789/587
dspace.log.2015-03-23:2015-03-23 16:57:18,141 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_item:handle=123456789/544
dspace.log.2015-03-23:2015-03-23 16:57:18,151 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_item:handle=123456789/523
dspace.log.2015-03-23:2015-03-23 16:57:26,344 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_collection:collection_id=72
dspace.log.2015-03-23:2015-03-23 16:57:43,958 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_collection:collection_id=72
dspace.log.2015-03-23:2015-03-23 16:57:56,416 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_community:community_id=2
dspace.log.2015-03-23:2015-03-23 16:57:56,433 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_community:community_id=8
dspace.log.2015-03-23:2015-03-23 16:57:56,447 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_community:community_id=9
dspace.log.2015-03-23:2015-03-23 16:57:56,460 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_community:community_id=13
dspace.log.2015-03-23:2015-03-23 16:57:56,472 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_community:community_id=15
dspace.log.2015-03-23:2015-03-23 16:57:56,485 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_community:community_id=11
dspace.log.2015-03-23:2015-03-23 16:57:56,497 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_community:community_id=14
dspace.log.2015-03-23:2015-03-23 16:57:56,511 INFO  org.dspace.usage.LoggerUsageEventListener @ anonymous::view_community:community_id=12

Filtering by an specific person:
2015-04-24 12:09:26,296 INFO  org.dspace.usage.LoggerUsageEventListener @ ad...@dspace.com:session_id=E1CB8F85AD7EAD8F62B3B501C48B2538:ip_addr=X.X.X.X:view_bitstream:bitstream_id=375
2015-04-24 16:56:44,859 INFO  org.dspace.authenticate.PasswordAuthentication @ anonymous:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:authenticate:attempting password auth of user=ad...@dspace.com
2015-04-24 16:56:44,875 INFO  org.dspace.authenticate.PasswordAuthentication @ ad...@dspace.com:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:authenticate:type=PasswordAuthentication
2015-04-24 16:56:44,877 INFO  org.dspace.eperson.EPerson @ ad...@dspace.com:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:update_eperson:eperson_id=1
2015-04-24 16:56:44,880 INFO  org.dspace.app.xmlui.utils.AuthenticationUtil @ ad...@dspace.com:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:login:type=explicit
2015-04-24 16:56:45,391 INFO  org.dspace.app.xmlui.aspect.artifactbrowser.CommunityBrowser @ ad...@dspace.com:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:view_community_list:
2015-04-24 16:56:54,184 INFO  org.dspace.usage.LoggerUsageEventListener @ ad...@dspace.com:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:view_community:community_id=8
2015-04-24 16:56:55,323 INFO  org.dspace.usage.LoggerUsageEventListener @ ad...@dspace.com:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:view_bitstream:bitstream_id=375
2015-04-24 16:56:56,664 INFO  org.dspace.usage.LoggerUsageEventListener @ ad...@dspace.com:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:view_collection:collection_id=32
2015-04-24 16:56:58,291 INFO  org.dspace.usage.LoggerUsageEventListener @ ad...@dspace.com:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:view_item:handle=123456789/195

And looking for "search:query":
2015-04-24 16:37:42,532 INFO  org.dspace.app.xmlui.aspect.discovery.AbstractSearch @ anonymous:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:search:query="Testing Log",results=(0,0,0)
2015-04-24 16:37:46,467 INFO  org.dspace.app.xmlui.aspect.discovery.AbstractSearch @ anonymous:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:search:query="Testing Log",results=(0,0,0)
2015-04-24 16:37:48,161 INFO  org.dspace.app.xmlui.aspect.discovery.AbstractSearch @ anonymous:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:search:query="Testing Log",results=(0,0,0)
2015-04-24 16:38:08,559 INFO  org.dspace.app.xmlui.aspect.discovery.AbstractSearch @ anonymous:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:search:query="teste",results=(0,0,0)
2015-04-24 16:40:08,974 INFO  org.dspace.app.xmlui.aspect.discovery.AbstractSearch @ anonymous:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:search:query="XYZ",results=(0,0,0)
2015-04-24 16:42:43,687 INFO  org.dspace.app.xmlui.aspect.discovery.AbstractSearch @ anonymous:session_id=A17B5C0C2A22718B5A1C8358CAEFB2CA:ip_addr=X.X.X.X:search:query="teste",results=(0,0,0)

However, i've just noticed that recent logged results are always "(0,0,0)", even when the query returns more than 1 result. It might be a bug or a miss-configuration on my servers.

You may also take a look at Solr page and logs, and Tomcat/Apache logs for user access logs.

And please, do not use Bold and Highlights on your messages. It's is very annoying. Simply give us more precise examples and explanations.

Em sex, 24 de abr de 2015 às 10:56, Usman <usman...@yahoo.com> escreveu:

Hello Everyone!

Thank you so much for all your help and support. 

I think that my question has been greatly misunderstood . Talking about those log files which contains user queries or their specific search requests.

For instance if :

User 1 searches for a specific item;then it should be logged in the file.

User 2 searches for another item....etc....

All their "user" interactions and activities with the system. 

DSpace.log only contains program related debug output. 

Hope that can help ; to make  my question  rightly understandable.

On Friday, April 24, 2015 4:22 PM, Usman <usman...@yahoo.com> wrote:

Dear all,

Let me introduce myself first. 

I am currently doing Masters in Computer Science and Application Technology in Hunan University. Our University is located in Changsha City, Hunan Province, China.

My topic for my Masters Thesis is : " Analyzing User Log Files of Online Digital Library using Searching and Recommending".

The Digital Library  that I have chosen is "Dspace". 

Everything seems OK.

However,there is a very big technical issue and question.

I want to analyze, filter and work on the 'User log files' of Dspace. 

That means those log files which contain user's information about their interactions with the system,their searches (content searched for) etc. 

Can anyone please tell me that where are these user log files? In which folder ? On which path? 

And if these log files are not generated by the system, then can anyone please send me a release compiled build of DSpace; which can generate these kind of logs.????

Please its URGENT. !!!

Thank you for anyone's help!!!

[Bruno Zanette]

No problem! Just an advice ;)

Em sáb, 25 de abr de 2015 02:12, Usman <usman...@yahoo.com> escreveu:

Yes. Thank you. That really helped. 

Next time, no bolds. 

Maybe I used bolds because of being nervous. 

[Bruno Zanette]

Usman,

The first problem doesn't seem to be related to Dspace at all. Did you added some app named "myWebApp"?

The second problem is related to SOLR. I've had some problems with SOLR in the past caused by permission, since Tomcat was being executed by Root and Dspace by a normal user. But in your case the problem seems to be an invalid SOLR's folder. Does the folder "C:\dpace\webapps\solr" exists? Something went wrong during installation? Did you compiled SOLR during installation?

If possible, send us some details about your servers, such as which OS you're using, Tomcat and DSpace version, and how you had configured tomcat's "server.xml" file. Did you copied Dspace's webapps to Tomcat's webapps folder, or did you configured tomcat's to use Dspace's webapp folders as default?

Em sáb, 25 de abr de 2015 14:05, Usman <usman...@yahoo.com> escreveu:

Hey guys , now I am facing a new problem. 

These are the error debug lines in the log file of Tomcat server: 

FAIL - Application at context path /myWebApp could not be started

FAIL - Encountered exception org.apache.catalina.LifecycleException: 

         Failed to start component 

         [StandardEngine[Catalina].StandardHost[localhost].StandardContext[/myWebApp]]

And in dspace.log; following lines occur: 

25-Apr-2015 21:40:24.213 SEVERE [http-nio-8080-exec-24] org.apache.catalina.core.ApplicationContext.log FAIL - Application at context path /solr could not be started

 org.apache.catalina.LifecycleException: Failed to start component [StandardEngine[Catalina].StandardHost[localhost].StandardContext[/solr]]

at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:154)

at org.apache.catalina.manager.ManagerServlet.start(ManagerServlet.java:1293)

at org.apache.catalina.manager.HTMLManagerServlet.start(HTMLManagerServlet.java:673)

at org.apache.catalina.manager.HTMLManagerServlet.doPost(HTMLManagerServlet.java:221)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:648)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:291)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

at org.apache.catalina.filters.CsrfPreventionFilter.doFilter(CsrfPreventionFilter.java:213)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

at org.apache.catalina.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:108)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)

at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:219)

at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:106)

at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:614)

at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:142)

at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:79)

at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:610)

at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:88)

at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:518)

at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1091)

at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:668)

at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:223)

at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1517)

at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1474)

at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)

at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)

at java.lang.Thread.run(Unknown Source)

Caused by: org.apache.catalina.LifecycleException: Failed to start component [org.apache.catalina.webresources.StandardRoot@1880fab]

at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:154)

at org.apache.catalina.core.StandardContext.resourcesStart(StandardContext.java:4844)

at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:4974)

at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)

... 33 more

Caused by: java.lang.IllegalArgumentException: The main resource set specified [C:\dpace\webapps\solr] is not valid

at org.apache.catalina.webresources.StandardRoot.createMainResourceSet(StandardRoot.java:723)

at org.apache.catalina.webresources.StandardRoot.startInternal(StandardRoot.java:684)

at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)

I think that the solr is not loading. Because whenever I search for some specific text; the above error lines are printed.

Please help!

On Saturday, April 25, 2015 1:10 PM, Usman <usman...@yahoo.com> wrote:

Yes. Thank you. That really helped. 

Next time, no bolds. 

Maybe I used bolds because of being nervous. 

On Saturday, April 25, 2015 4:00 AM, Bruno Zanette <brunon...@gmail.com> wrote:

[Usman]

.....

[Usman]

Hello Everyone!

Thank you so much for all your help and support. 

I think that my question has been greatly misunderstood . Talking about those log files which contains user queries or their specific search requests.

For instance if :

User 1 searches for a specific item;then it should be logged in the file.

User 2 searches for another item....etc....

All their "user" interactions and activities with the system. 

DSpace.log only contains program related debug output. 

Hope that can help ; to make  my question  rightly understandable.

[Usman]

Yes. Thank you. That really helped. 

Next time, no bolds. 

Maybe I used bolds because of being nervous. 

On Saturday, April 25, 2015 4:00 AM, Bruno Zanette <brunon...@gmail.com> wrote:

[Usman]