Help - MAPIT_ID_WHITELIST - configuration issues

78 views
Skip to first unread message

Michael Fabunmi

unread,
Jun 27, 2020, 12:54:40 PM6/27/20
to fixmy...@mysociety.org
Hi All,
I have an issue whereby I get an error message when populating the area ID list into the parameter  MAPIT_ID_WHITELIST.. I have 774 local government areas in the country I am setting up.. Each one of them has an area ID and I figured I would need a distinct body associated with them to send messages to. However, after adding just over 100 area IDs, I get the message in the attached screenshot. "(en) Please come back later".
What am I doing wrong?
The instance is http://fixmyarea4us.com. It is being developed for the country Nigeria.

On a separate note, i also have a few other issues as follows;

1. I would like a pointer to the best way to enable SSL - perhaps some documentation relevant to the AWS image based configuration we are using.
2. I would like to change the "FixMyStreet" sign on the top left hand cover to "FixMyArea4US.
3. How do i enable the option "or use my location" on the landing screen ( like on https://www.fixmystreet.com/)? 


Regards,
Michael Fabunmi
07803761341
FixMyArea03.PNG
FixMyArea04.PNG
FixMyArea02.PNG
FixMyArea05.png
FixMyArea06.PNG
FixMyArea01.PNG

Matthew Somerville

unread,
Jul 1, 2020, 12:32:39 PM7/1/20
to FixMyStreet
Hi,

I'm not sure what that could be, you will need to look in your
server's error log to see what the actual error message is. I don't
see why it shouldn't be working, but I'm not sure it's something that
anyone has tried before either; if you're after so many areas, it
might be you need to set up your own MapIt installation with only the
boundaries you need in it. But let's see what the error message says.

On your other questions:
1. Setting up SSL depends how you want to set it up. You could do it
directly on the server by using something like certbot to get an SSL
certificate and then updating your nginx configuration to host it. As
you're on Amazon, I imagine Amazon can do this for you if you use one
of their products such as Elastic Load Balancer or CloudFront, but
I've not used them, sorry.
2. Yes, that's covered in the documentation:
https://fixmystreet.org/customising/logo/
3. Geolocation only works on HTTPS websites, so once your site is
HTTPS, that will automatically appear.

ATB,
Matthew

Michael Fabunmi

unread,
Jul 2, 2020, 6:54:02 AM7/2/20
to Matthew Somerville, FixMyStreet, cola...@gmail.com
Hi Matthew,
Thanks for the information you provided in your reply. I believe I can make progress with attempting to resolve most of the issues - except for the present restriction on the number of bodies I can create based on unique area codes. For that particular issue, i might have to share my screen remotely so you (or any other team member), can have a look at the present configuration and see the error firsthand.

.Cheers,
Micael Fabunmi

--
You received this message because you are subscribed to the Google Groups "FixMyStreet" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fixmystreet...@mysociety.org.
To view this discussion on the web visit https://groups.google.com/a/mysociety.org/d/msgid/fixmystreet/CAKs8PY1W-dYVQxU7yyZvsSGnJfX7iKspBR7WQfm%3DR4CNUor2Gw%40mail.gmail.com.

Michael Fabunmi

unread,
Jul 6, 2020, 5:14:44 AM7/6/20
to Matthew Somerville, FixMyStreet, cola...@gmail.com
Hi Matthew,
I followed up on the hints you provided and was able to resolve most of the issues except for the maximum "area ID" count restriction I seem to be witnessing. 
Would it be possible to arrange to have you remotely observe both the present configuration, and the issue itself with me, at your convenience?

Cheers,
Michael Fabunmi

Matthew Somerville

unread,
Jul 9, 2020, 5:49:22 AM7/9/20
to Michael Fabunmi, FixMyStreet, cola...@gmail.com
Hi,

Glad to hear you've made some progress. I'm afraid I do not have the
time to do any sort of remote debugging, sorry. Like I said, you'll
need to find your server's error log and see what the actual error
message is, and work from there; feel free to post the actual error
message here when you've found it if it's unclear as to what the issue
might be.

ATB,
Matthew

Michael Fabunmi

unread,
Jul 9, 2020, 9:35:17 AM7/9/20
to Matthew Somerville, FixMyStreet, cola...@gmail.com
Hi Matthew,
Can I confirm exactly which one of the log files you are referring to? 

Cheers,
Michael

Matthew Somerville

unread,
Jul 10, 2020, 6:02:56 AM7/10/20
to FixMyStreet
If you've used the install script or AMI, the web server logs will be
in somewhere like /var/www/fixmystreet/logs, with the error_log
containing error messages.
If you've set up your server another way, then the log files will be
wherever you have configured your webserver to put them.

ATB,
Matthew

Michael Fabunmi

unread,
Jul 10, 2020, 7:56:44 AM7/10/20
to Matthew Somerville, FixMyStreet, cola...@gmail.com
Hi Matthew,
Thanks for pointing me in the right direction. Please find attached log files (zipped ) I copied off the system after adding an extra area ID to trigger the issue, then removing the additional entry again to recover from the issue.

Cheers,
Michael Fabunmi

server-logs.zip

Matthew Somerville

unread,
Jul 10, 2020, 2:34:55 PM7/10/20
to FixMyStreet
Hi,

Because you are asking for so many area IDs from Global MapIt,
FixMyStreet has to make a POST request, not a GET request.
Global MapIt is https only, so if you make a http POST request, it
redirects to an HTTPS page that no longer includes your query.
If you change your MAPIT_URL to be https instead of http, then there
should be no redirect needed and your query should then get a
response.
I still say this might not be the best way for you to proceed, but it
should at least hopefully deal with this issue.

ATB,
Matthew

Michael Fabunmi

unread,
Jul 10, 2020, 5:29:42 PM7/10/20
to Matthew Somerville, FixMyStreet
Hi Matthew,
You are correct. Using HTTPS resolved the issue.
Now, if there is a more elegant solution to the problem of having 774 local government areas, plus 36 states, I would appreciate if you could point me in the right direction in respect of the relevant documentation.

Cheers,
Michael Fabunmi

Michael Fabunmi

unread,
Aug 21, 2021, 3:44:51 AM8/21/21
to Matthew Somerville, FixMyStreet

Hi Matthew,

I have recently noticed an issue with my EC2 AMI fixmystreet setup. It started with the Chrome browser complaining about insecure connectivity, even when the device appears to have a valid SSL certificate. I have tried to provide in as much details as possible, the troubleshooting steps I have carried out. However, a high level summary of the issues i see is as follows;

  • The client browser used to access the web application has the following behaviour:-
  1. The form is only submitted correctly and sent to the council, when connected to the server FQDN (see config 3 below).
  2. The server always resets its configuration back to config 2 (see below), after a reboot.
  3. It appears that the reports are only being sent, when I manually run the command "send-report".
My Summary:
Is there a way I can test using http://fixmyarea4us.org without the automatic redirection to https://fixmyarea4us.org?
Please find attached details of my configuration and the results of some of my tests.

Configuration 1

A summary of this site's configuration, running version v3.1.

Variablegeneral.yml valueCobrand module override
URLs
BASE_URLhttp://fixmyarea4us.org
ADMIN_BASE_URLhttps://fixmyarea4us.org/admin
SECURE_PROXY_SSL_HEADER
Display
Site titleFixMyArea4US
ALLOWED_COBRANDSfixmyarea4us
Web templates/var/www/fixmystreet/fixmystreet/templates/web/fixmyarea4us
MAP_TYPEOSM
EXAMPLE_PLACESRing Road, Ibadan, Oyo, Awolowo Road, Ikoyi, Lagos
LANGUAGESen-gb,English,en_GB
Language override-
ALL_REPORTS_PER_PAGE100
RSS_LIMIT20
OPEN311_LIMIT1000
AREA_LINKS_FROM_PROBLEMS
Geocoder
GEOCODER<em>(None; default Nominatim OSM)</em>
GEOCODING_DISAMBIGUATION
MapIt
MAPIT_URL<a href='https://global.mapit.mysociety.org'>https://global.mapit.mysociety.org</a>
MAPIT_TYPESO02, O03, O04, O06, O08
MAPIT_ID_WHITELIST665825688604665820665820665821697520665823806678972861665975665771972769666052960791794869794870960768960793960765960767960772960769960784662850960788960778960779960782794868960783960766960770960771960773960792960775662829960795662830960794960777806693666058666070665996665997972870665999666000666001697531665796665802972785665799960781665797972784665800665787665793665788972781665790972782665792665794972783665995972869972868665992665991972867665989665988665987972866972865665984665983972864806705972863972862665978665977665974665973666049666051666053666056697537666059666060666061972884666064666065666066666067806722666069666071666072666073666074972885666076666077666078972886666080666081662851960790665971972859972858972857665967972856972855972854972853665962972852972851665959665958665957665956665955665954960780972780972779972778972777972776972775972774972773972771972770972768972767665772665770972766972835665935972837972838972839972841665943665942972842972843972844972845972846665949972847972848972850960789960785806695972836972816806680806691806692972824806696806679806682809646972822972817806683974979972818972820960786972813665881972840958758697538806721972821972819972823
MAPIT_GENERATION
MAPIT_TYPES_CHILDREN
Database
FMS_DB_HOST
FMS_DB_PORT5432
FMS_DB_NAMEfixmystreet
FMS_DB_USERfms
Email
EMAIL_DOMAINfixmyarea4us.org
CONTACT_NAMEfixmyareaadmin
CONTACT_EMAILfixmyare...@fixmyarea4us.org
DO_NOT_REPLY_EMAILdo-not...@fixmyarea4us.org
Development
STAGING_SITE
STAGING_FLAGShide_staging_banner:0, send_reports:0, skip_checks:0
UPLOAD_DIR
GEO_CACHE../cache/
TESTING_COUNCILS
SMTP_SMARTHOSTemail-smtp.eu-west-1.amazonaws.com
TIME_ZONE
GAZE_URLhttps://gaze.mysociety.org/gaze


After Reboot

Configuration 2

A summary of this site's configuration, running version v3.1.

Variablegeneral.yml valueCobrand module override
URLs
BASE_URLhttp://ec2-63-34-20-174.eu-west-1.compute.amazonaws.com
ADMIN_BASE_URLhttps://fixmyarea4us.org/admin
SECURE_PROXY_SSL_HEADER
Display
Site titleFixMyArea4US
ALLOWED_COBRANDSfixmyarea4us
Web templates/var/www/fixmystreet/fixmystreet/templates/web/fixmyarea4us
MAP_TYPEOSM
EXAMPLE_PLACESRing Road, Ibadan, Oyo, Awolowo Road, Ikoyi, Lagos
LANGUAGESen-gb,English,en_GB
Language override-
ALL_REPORTS_PER_PAGE100
RSS_LIMIT20
OPEN311_LIMIT1000
AREA_LINKS_FROM_PROBLEMS
Geocoder
GEOCODER<em>(None; default Nominatim OSM)</em>
GEOCODING_DISAMBIGUATION
MapIt
MAPIT_URL<a href='https://global.mapit.mysociety.org'>https://global.mapit.mysociety.org</a>
MAPIT_TYPESO02, O03, O04, O06, O08
MAPIT_ID_WHITELIST665825688604665820665820665821697520665823806678972861665975665771972769666052960791794869794870960768960793960765960767960772960769960784662850960788960778960779960782794868960783960766960770960771960773960792960775662829960795662830960794960777806693666058666070665996665997972870665999666000666001697531665796665802972785665799960781665797972784665800665787665793665788972781665790972782665792665794972783665995972869972868665992665991972867665989665988665987972866972865665984665983972864806705972863972862665978665977665974665973666049666051666053666056697537666059666060666061972884666064666065666066666067806722666069666071666072666073666074972885666076666077666078972886666080666081662851960790665971972859972858972857665967972856972855972854972853665962972852972851665959665958665957665956665955665954960780972780972779972778972777972776972775972774972773972771972770972768972767665772665770972766972835665935972837972838972839972841665943665942972842972843972844972845972846665949972847972848972850960789960785806695972836972816806680806691806692972824806696806679806682809646972822972817806683974979972818972820960786972813665881972840958758697538806721972821972819972823
MAPIT_GENERATION
MAPIT_TYPES_CHILDREN
Database
FMS_DB_HOST
FMS_DB_PORT5432
FMS_DB_NAMEfixmystreet
FMS_DB_USERfms
Email
EMAIL_DOMAINec2-63-34-20-174.eu-west-1.compute.amazonaws.com
CONTACT_NAMEfixmyareaadmin
CONTACT_EMAILfixmyare...@fixmyarea4us.org
DO_NOT_REPLY_EMAILdo-not...@fixmyarea4us.org
Development
STAGING_SITE
STAGING_FLAGShide_staging_banner:0, send_reports:0, skip_checks:0
UPLOAD_DIR
GEO_CACHE../cache/
TESTING_COUNCILS
SMTP_SMARTHOSTemail-smtp.eu-west-1.amazonaws.com
TIME_ZONE
GAZE_URLhttps://gaze.mysociety.org/gaze


Configuration 3

A summary of this site's configuration, running version v3.1.

Variablegeneral.yml valueCobrand module override
URLs
BASE_URLhttp://ec2-63-34-20-174.eu-west-1.compute.amazonaws.com
ADMIN_BASE_URLhttps://fixmyarea4us.org/admin
SECURE_PROXY_SSL_HEADER
Display
Site titleFixMyArea4US
ALLOWED_COBRANDSfixmyarea4us
Web templates/var/www/fixmystreet/fixmystreet/templates/web/fixmyarea4us
MAP_TYPEOSM
EXAMPLE_PLACESRing Road, Ibadan, Oyo, Awolowo Road, Ikoyi, Lagos
LANGUAGESen-gb,English,en_GB
Language override-
ALL_REPORTS_PER_PAGE100
RSS_LIMIT20
OPEN311_LIMIT1000
AREA_LINKS_FROM_PROBLEMS
Geocoder
GEOCODER<em>(None; default Nominatim OSM)</em>
GEOCODING_DISAMBIGUATION
MapIt
MAPIT_URL<a href='https://global.mapit.mysociety.org'>https://global.mapit.mysociety.org</a>
MAPIT_TYPESO02, O03, O04, O06, O08
MAPIT_ID_WHITELIST665825688604665820665820665821697520665823806678972861665975665771972769666052960791794869794870960768960793960765960767960772960769960784662850960788960778960779960782794868960783960766960770960771960773960792960775662829960795662830960794960777806693666058666070665996665997972870665999666000666001697531665796665802972785665799960781665797972784665800665787665793665788972781665790972782665792665794972783665995972869972868665992665991972867665989665988665987972866972865665984665983972864806705972863972862665978665977665974665973666049666051666053666056697537666059666060666061972884666064666065666066666067806722666069666071666072666073666074972885666076666077666078972886666080666081662851960790665971972859972858972857665967972856972855972854972853665962972852972851665959665958665957665956665955665954960780972780972779972778972777972776972775972774972773972771972770972768972767665772665770972766972835665935972837972838972839972841665943665942972842972843972844972845972846665949972847972848972850960789960785806695972836972816806680806691806692972824806696806679806682809646972822972817806683974979972818972820960786972813665881972840958758697538806721972821972819972823
MAPIT_GENERATION
MAPIT_TYPES_CHILDREN
Database
FMS_DB_HOST
FMS_DB_PORT5432
FMS_DB_NAMEfixmystreet
FMS_DB_USERfms
Email
EMAIL_DOMAINfixmyarea4us.org
CONTACT_NAMEfixmyareaadmin
CONTACT_EMAILfixmyare...@fixmyarea4us.org
DO_NOT_REPLY_EMAILdo-not...@fixmyarea4us.org
Development
STAGING_SITE
STAGING_FLAGShide_staging_banner:0, send_reports:0, skip_checks:0
UPLOAD_DIR
GEO_CACHE../cache/
TESTING_COUNCILS
SMTP_SMARTHOSTemail-smtp.eu-west-1.amazonaws.com
TIME_ZONE
GAZE_URLhttps://gaze.mysociety.org/gaze

Regards,
Michael Fabunmi
FixMyArea4US-Error04.JPG
FixMyArea4US-Error14.JPG
FixMyArea4US-Error12.JPG
FixMyArea4US-Error13.JPG
FixMyArea4US-Error11.JPG
FixMyArea4US-Error10.JPG
FixMyArea4US-Error15.JPG
FixMyArea4US-Error05.JPG
FixMyArea4US-Error01.JPG
FixMyArea4US-Error02.JPG
FixMyArea4US-Error03.JPG
FixMyArea4US-Error07.JPG
FixMyArea4US-Error06.JPG
FixMyArea4US-Error08.JPG
FixMyArea4US-Error09.JPG

Paco López L.

unread,
Oct 4, 2021, 12:33:10 AM10/4/21
to FixMyStreet, mfabun...@gmail.com
Exactly the same thing happens to me. 

Suddenly from one day to the next the https: // functionalities stopped working. I didn't move anything. 

Geolocation no longer works for me and in the same way the search engine in the front is reported as insecure by the browser. 

I can no longer see the admin/bodies screen or the map with all the reports! 
It seems that it has something to do with the update that Letsencrypt made on August 21 2021, I checked the next day and many things were not working. 
 I tried to renew the certificate but apparently it got more broken, now I can't see the report map anymore.

 It probably has to do with the https: // certificate from global.mapit.mysociety.org/  API calls from fixmystreet core.

 I have done two reinstallations, two new installations in development (ubuntu 18 and 16) and in effect, when I add the configurations (nginx with certbot) the same thing happens in these clean installations.

 I suspect that the way we have been configuring https in nginx (and that I work for 3 years) is no longer compatible with the recent changes to LetsEncrypt. 

 I'll keep studying the matter (in logs or with other certificate different that letsencrypt or recent changes in letsencrypt) , it definitely has to do with the way the fixmystreet proxy interacts in relation to Lets Encrypt changes. 


Paco López.

Michael Fabunmi

unread,
Jan 1, 2022, 3:28:01 PM1/1/22
to Matthew Somerville, FixMyStreet
Hi Matthew,
Below is the original very detailed message I sent to you about the SSL error message.
It is the same issue i am still contending with

Cheers,
Michael
FixMyArea4US-Error04.JPG
FixMyArea4US-Error14.JPG
FixMyArea4US-Error12.JPG
FixMyArea4US-Error13.JPG
FixMyArea4US-Error11.JPG
FixMyArea4US-Error10.JPG
FixMyArea4US-Error15.JPG
FixMyArea4US-Error05.JPG
FixMyArea4US-Error01.JPG
FixMyArea4US-Error02.JPG
FixMyArea4US-Error03.JPG
FixMyArea4US-Error07.JPG
FixMyArea4US-Error06.JPG
FixMyArea4US-Error08.JPG
FixMyArea4US-Error09.JPG

john simpson

unread,
Sep 24, 2023, 10:42:09 AM9/24/23
to FixMyStreet, mfabun...@gmail.com, matthew
Michael,
I see your website is now working.
May I ask how you resolved the 'insecure data' issue ?
Thanks,
John
Reply all
Reply to author
Forward
0 new messages