Proxy Settings For OAI Harvester In XMLUI

48 views
Skip to first unread message

Gavin Spomer

unread,
Oct 4, 2021, 4:32:20 PM10/4/21
to DSpace Technical Support
When testing the settings for the harvester in DSpace 6.3 / xmlui, it eventually times out with error "OAI server could not be reached". I'm guessing it's because of being behind our campus web proxy, but I've configured the host and port in both Tomcat's setenv.sh:

   JAVA_OPTS="$JAVA_OPTS -Dhttp.proxySet=true -Dhttp.proxyHost=our.proxyhost.edu -Dhttp.proxyPort=3128"

and my local.cfg file:

   http.proxy.host = our.proxyhost.edu
   http.proxy.port = 3128

Shouldn't that be enough? Which proxy settings does the harvester in xmlui use? 

Gavin Spomer

unread,
Oct 5, 2021, 12:51:33 PM10/5/21
to DSpace Technical Support
I tried using a "fake oai server" for the harvester test in xmlui that was internal to our university and not only did it output something other than "OAI server could not be reached" (was "OAI did not respond to ListMetadataFormats query (:null ; :null): null"), but it didn't hang for a long time either. So I'm reasonably sure the problem is that it's not using our campus web proxy to contact the bepress oai server. Checked both the tomcat and dspace logs, but nothing in there related to this.

If someone knows which proxy settings the xmlui harvest test uses (tomcat, local.cfg or ???), I'd really appreciate it.

Gavin Spomer

unread,
Oct 6, 2021, 2:15:23 PM10/6/21
to DSpace Technical Support
Throwing in the towel on this; something I rarely do. Nothing I've tried is able to get the harvester to reach our Bepress host.

I've had good luck importing an item via command line / simple archive format, so I'm going to write my own script that fetches the metadata and files via OAI and create the archive / item directories.

 - Gavin 

Reply all
Reply to author
Forward
0 new messages