Error: The requested URL could not be retrieved

Eric NIMPAYE

unread,

Dec 26, 2014, 9:41:35 AM12/26/14

to open-semant...@googlegroups.com

Hi,

I have been trying to install OSF on Fedora bit by bit. Since I'm not using Ubuntu, I am not sure my error could be reproducible. But any help will be much appreciated.

So, MariaDB, Drupal, Virtuoso, Apache server, Apache Solr and all the set of OSF dependencies are running nicely; I installed them using the distribution's tools. After adapting the OSF's installlation scripts to get them working on Fedora, almost everything ran smoothly but the PMT failed due to a control access problem. I would like to understand from where the access is being denied. Following is the issued command :

$ pmt --create-group="http://localhost/role/5/owner" --app-id="administer"

And the error message is :

Couldn't create the new group.Forbidden<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd"><html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"><title>ERROR: The requested URL could not be retrieved</title><style type="text/css"></style></head><body id=ERR_ACCESS_DENIED><div id="titles"><h1>ERROR</h1><h2>The requested URL could not be retrieved</h2></div><hr><div id="content"><p>The following error was encountered while trying to retrieve the URL: <a href="http://localhost/ws/auth/registrar/group/?interface=default&group_uri=http%3A%2F%2Flocalhost%2Frole%2F5%2Fowner&app_id=administer&action=create">http://localhost/ws/auth/registrar/group/?interface=default&group_uri=http%3A%2F%2Flocalhost%2Frole%2F5%2Fowner&app_id=administer&action=create</a></p><blockquote id="error"><p><b>Access Denied.</b></p></blockquote><p>Access control configuration prevents your request from being allowed at this time. Please contact your service provider if you feel this is incorrect.</p><p>Your cache administrator is <a href="mailto:...">webmaster</a>.</p><br></div><hr><div id="footer"><p>Generated Fri, 26 Dec 2014 14:15:11 GMT by ... (squid/3.3.11)</p></div></body></html>

What could that "Access control configuration prevents your request from being allowed at this time." mean ? Does privileges' lack stem from the MariaDB server, the Apache server or from another place ?

Best regards,

Eric.

Frederick Giasson

unread,

Dec 26, 2014, 8:39:08 PM12/26/14

to open-semant...@googlegroups.com

Hi Eric!

I have been trying to install OSF on Fedora bit by bit. Since I'm not using Ubuntu, I am not sure my error could be reproducible. But any help will be much appreciated.

Wonderful :) If you ever have time to write a tutorial about how to do this, it would be fanstastic!

So, MariaDB, Drupal, Virtuoso, Apache server, Apache Solr and all the set of OSF dependencies are running nicely; I installed them using the distribution's tools. After adapting the OSF's installlation scripts to get them working on Fedora, almost everything ran smoothly but the PMT failed due to a control access problem. I would like to understand from where the access is being denied. Following is the issued command :

$ pmt --create-group="http://localhost/role/5/owner" --app-id="administer"

And the error message is :

Couldn't create the new group.Forbidden<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd"><html><head><meta http-equiv="Content-Type" content="text/html; "><title>ERROR: The requested URL could not be retrieved</title><style type="text/css"></style></head><body id=ERR_ACCESS_DENIED><div id="titles"><h1>ERROR</h1><h2>The requested URL could not be retrieved</h2></div><hr><div id="content"><p>The following error was encountered while trying to retrieve the URL: <a href="http://localhost/ws/auth/registrar/group/?interface=default&group_uri=http%3A%2F%2Flocalhost%2Frole%2F5%2Fowner&app_id=administer&action=create">http://localhost/ws/auth/registrar/group/?interface=default&group_uri=http%3A%2F%2Flocalhost%2Frole%2F5%2Fowner&app_id=administer&action=create</a></p><blockquote id="error"><p><b>Access Denied.</b></p></blockquote><p>Access control configuration prevents your request from being allowed at this time. Please contact your service provider if you feel this is incorrect.</p><p>Your cache administrator is <a href="mailto:...">webmaster</a>.</p><br></div><hr><div id="footer"><p>Generated Fri, 26 Dec 2014 14:15:11 GMT by ... (squid/3.3.11)</p></div></body></html>

The error appears to be coming from a Squid proxy. Check if you have Squid setup on your server, or somewhere in your network that would prevent localhost queries to be delivered to the OSF web services (the DMT/PMT/OMT/DVT tools communicates with the OSF web services, so they need to have the proper network access to do it.

Hope it helps,

Thanks,

Fred

Eric NIMPAYE

unread,

Dec 27, 2014, 10:35:42 AM12/27/14

to open-semant...@googlegroups.com

Hi Fred,

Thanks for the reply. I will check if Squid is the troublemaker on Monday and will post back about it. As for documenting how to set up OSF for Fedora, it will be my pleasure as soon as the remaining installation tasks will have been overcame.

Cheers,

Eric.

Eric NIMPAYE

unread,

Dec 29, 2014, 5:20:57 AM12/29/14

to open-semant...@googlegroups.com

Hi Fred,

As the query and outputs below show, I checked the server configuration and it seems there isn't any squid package installed.

[~]# rpm -q lightsquid squidGuard lightsquid-apache squid-sysvinit squid calamaris awstats ccze dansguardian kranky-fonts libecap mod_auth_ntlm_winbind tinyproxy

package lightsquid is not installed
package squidGuard is not installed
package lightsquid-apache is not installed
package squid-sysvinit is not installed
package squid is not installed
package calamaris is not installed
package awstats is not installed
package ccze is not installed
package dansguardian is not installed
package kranky-fonts is not installed
package libecap is not installed
package mod_auth_ntlm_winbind is not installed
package tinyproxy is not installed

By the way, when I try to register an endpoint, the operation half-succeed : the endpoint is listed at the OSF API Endpoints'page but the logs are filled with a bunch of errors reporting about fails in users and groups creation. As last week, all errors are related to some denied access and I can't catch what that could mean. Following are the screen shots of the endpoint page and errors.

1- "Half-created" endpoint

2- Users and groups are not created

I don't know if there is any other useful data I should provide to try to solve this.

The best,

Eric.

Frederick Giasson

unread,

Dec 29, 2014, 9:04:44 AM12/29/14

to open-semant...@googlegroups.com

Hi Eric,

As the query and outputs below show, I checked the server configuration and it seems there isn't any squid package installed.

[~]# rpm -q lightsquid squidGuard lightsquid-apache squid-sysvinit squid calamaris awstats ccze dansguardian kranky-fonts libecap mod_auth_ntlm_winbind tinyproxy

package lightsquid is not installed
package squidGuard is not installed
package lightsquid-apache is not installed
package squid-sysvinit is not installed
package squid is not installed
package calamaris is not installed
package awstats is not installed
package ccze is not installed
package dansguardian is not installed
package kranky-fonts is not installed
package libecap is not installed
package mod_auth_ntlm_winbind is not installed
package tinyproxy is not installed

Is it possible that it is elsewhere on your network? It is clear that a Squid proxy rejected your query to the Registrar: Group web service endpoint.

By the way, when I try to register an endpoint, the operation half-succeed : the endpoint is listed at the OSF API Endpoints'page but the logs are filled with a bunch of errors reporting about fails in users and groups creation. As last week, all errors are related to some denied access and I can't catch what that could mean. Following are the screen shots of the endpoint page and errors.

1- "Half-created" endpoint

2- Users and groups are not created

Until we are sure that the squid server is not intervening into this, we shouldn't spend time trying other things.

Thanks,

Fred

Eric NIMPAYE

unread,

Dec 29, 2014, 10:06:38 AM12/29/14

to open-semant...@googlegroups.com

Hi Fred,

Is it possible that it is elsewhere on your network? It is clear that a Squid proxy rejected your query to the Registrar: Group web service endpoint.

Until we are sure that the squid server is not intervening into this, we shouldn't spend time trying other things.

Sure, that's quite possible the Squid is acting from another level in the local network, since I'm using different machines as client and server. I will check all the machine chain I use, your insight is very valuable.

Thanks for your time,

Eric.

Eric NIMPAYE

unread,

Dec 30, 2014, 1:41:30 PM12/30/14

to open-semant...@googlegroups.com

Hi Fred,

To avoid the network behaviours to go out of my control, all the client & server applications are now installed on the same machine. I still miss a way to make OMT, DMT and PMT running. Till now I can't understand how Squid could interfere with the local network loop if it is not installed on the host machine. In the following logs, how to deduce Squid is to blame for the error ? Perhaps a helpful information, I should notice I'm not a sysadmin; that's why I'm struggling to grasp where to do the debugging and fixs.

The command is ran at the top of the OMT's folder, under the root user.

# omt --load-advanced-index="true" --load-all --load-list="/home/osf-installer/resources/osf-web-services/ontologies.lst" --osf-web-services="http://localhost/ws/"

The ontologies.lst has the following content :

# cat /home/osf-installer/resources/osf-web-services/ontologies.lst

http://localhost/osf/data/ontologies/files/aggr.owl http://localhost/osf/data/ontologies/files/iron.owl http://localhost/osf/data/ontologies/files/owl.rdf http://localhost/osf/data/ontologies/files/rdfs.xml http://localhost/osf/data/ontologies/files/rdf.xml http://localhost/osf/data/ontologies/files/sco.owl http://localhost/osf/data/ontologies/files/wgs84.owl http://localhost/osf/data/ontologies/files/wsf.owl http://localhost/osf/data/ontologies/files/drupal.owl

For each of the 9 XML/RDF/OWL files, the OMT command fails with this error pattern :

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=

StructuredDynamics\osf\php\api\ws\auth\lister\AuthListerQuery::__set_state(array(

'endpoint' => 'auth/lister/',

'method' => 'get',

'mime' => 'resultset',

'timeout' => 0,

'resultset' => NULL,

'network' => 'http://localhost/ws/',

'supportedMimes' =>

array (

0 => 'text/xml',

1 => 'application/json',

2 => 'application/rdf+xml',

3 => 'application/rdf+n3',

4 => 'application/iron+json',

5 => 'application/iron+csv',

6 => 'resultset',

),

'httpStatus' => '403',

'httpStatusMessage' => 'Forbidden',

'httpStatusMessageDescription' => '<?xml version="1.0" encoding="utf-8"?> <error> <id>WS-AUTH-VALIDATION-100</id> <webservice>/ws/auth/lister/</webservice> <name>Unauthorized Request</name> <description>Your request cannot be authorized for this web service call</description> <debugInformation></debugInformation> <level>Fatal</level> </error> ',

'appID' => 'administer',

'apiKey' => 'CE0C269F724F5CF48A948936163260B3',

'userID' => 'http://localhost/wsf/users/admin',

'params' =>

array (

'mode' => 'ws',

'target_webservice' => 'all',

'interface' => 'default',

),

'error' =>

StructuredDynamics\osf\framework\QuerierError::__set_state(array(

'id' => 'WS-AUTH-VALIDATION-100',

'level' => 'fatal',

'webservice' => '/ws/auth/lister/',

'name' => 'Unauthorized Request',

'description' => 'Your request cannot be authorized for this web service call',

'debugInfo' => '',

)),

))

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=

Is Squid still involved in that or is it something else ?

Thanks,

Eric.

P.S. Happy new year !

Frederick Giasson

unread,

Jan 4, 2015, 8:50:07 PM1/4/15

to open-semant...@googlegroups.com

Hi Eric

To avoid the network behaviours to go out of my control, all the client & server applications are now installed on the same machine. I still miss a way to make OMT, DMT and PMT running. Till now I can't understand how Squid could interfere with the local network loop if it is not installed on the host machine.

Ok good

No. The "WS-AUTH-VALIDATION-100" error is returned when the "keys.ini" file cannot be read by OSF. Make sure that the keys.ini file is located at the place configured for the $keys_ini variable at the line #30 of the WebService.php file.

Once you make sure everything is properly located, it should start working (at least, getting another error than that one :)

Thanks,

Fred

Reply all

Reply to author

Forward