Using Open Street Maps (.OSM files) instead of shapefiles directly in Gama

[Ariadni Michalitsi]

Dear all,

I have recently started working on Gama to run simulation experiments for my PhD thesis. The documentation you provide is really helpful. Let me also say that your work with COMOKIT is really inspiring.

I run some issues, though, with the loading of GIS data in my simulation. I have decided to work with .OSM data, although I see more options in your documentation for shapefiles. Are OSM data not that appropriate for some reason in GAMA?

Since I am from Greece, I am trying to run my simulations there, and I have encountered some problems, particularly buildings missing from the simulation. Taking, for example, my university, National Technical University of Athens, and trying to simulate the campus, buildings are missing, although taken into account in the filtering. For example the building "Electrical and Comp. Eng. School" although it is a "university" building and I have considered it in the filtering (as you can see below) is not displayed. On the contrary, the building beside, “Mining Engineering and Metallurgy school” is well displayed. I also attach a screenshot of my simulation and the referred .osm data file.

The filtering I have used is:

map filtering <- (["highway"::["primary", "secondary", "tertiary", "motorway", "living_street","residential", "unclassified", "service", "secondary_link", "pedestrian", "footway", "steps"],

"building"::["yes", "dormitory", "university", "church", "office", "residential", "commercial", "house", "hotel", "apartments", "industrial", "retail", "hospital", "government"]]);

 

And the code after that:

//OSM file to load

file<geometry> osmfile <-  file<geometry>(osm_file("../includes/emp1.osm", filtering))  ;

 

 

//compute the size of the environment from the envelope of the OSM file

geometry shape <- envelope(osmfile);

create osm_agent from:osmfile with: [highway_str::string(read("highway")), building_str::string(read("building"))];

 

//from the created generic agents, creation of the selected agents

ask osm_agent {

if (length(shape.points) = 1 and highway_str != nil ) {

create node_agent with: [shape ::shape, type:: highway_str];

} else {

if (highway_str != nil ) {

create road with: [shape ::shape, type:: highway_str];

} else if (building_str != nil){

create building with: [shape ::shape];

} 

}

//do the generic agent die

do die;

}

 

I would be more than grateful if you could help me understand what I am doing wrong.

 

Kind Regards,

Ariadni

[Benoit Gaudou]

Dear,

GAMA management of geographical data has been designed in a way closer to shapefile spirit than to OSM one.

In particular, GAMA manipulates species of agents with attributes, which can be directly translated into a shapefile.

So GAMA has more tools related to shapefile (in particular to export agents).

So commonly,  when input data are OSM, a small model is developed to import the relevant entities from the OSM and to export them into shapefiles (after cleaning if needed, for example for road network).

then shapefiles will be used as input file of the model.

I had a  look at the data of the area, and indeed it seems that we have an issue in GAMA reading the osm file.

(I get a very small osm file with the 2 buildings you mention).

I  open it in  QGIS and can observe  the 2  buildings, but not in GAMA (and in its OSM Viewer).

We will  have  a  look at that point.

cheers

Benoit Gaudou

--
You received this message because you are subscribed to the Google Groups "GAMA" group.
To unsubscribe from this group and stop receiving emails from it, send an email to gama-platfor...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gama-platform/CAD3_mVdVdwQHDBXT0VWGZnr8TGjB-uo8wXwS9QcS%2B4x8G-QLbA%40mail.gmail.com.

[Patrick Taillandier]

Hi,

Sorry for my late reply.

You are right, there is an issue here (I am going to fix it as soon as possible): the university (and maybe some other buildings) has a value for the "amenity" attribute that is not nil, so GAMA, instead of considering it both as an amenity and as a building seems to consider it just as an amenity.

A workaround is just to add the building amenity to the filtering map:

 map filtering <- (["highway"::["primary", "secondary", "tertiary", "motorway", "living_street","residential", "unclassified", "service", "secondary_link", "pedestrian", "footway", "steps"],"amenity"::["university"], "building"::["yes", "dormitory", "university", "church", "office", "residential", "commercial", "house", "hotel", "apartments", "industrial", "retail", "hospital", "government"]]);

Cheers,

Patrick

To view this discussion on the web visit https://groups.google.com/d/msgid/gama-platform/CAD4GtYG3QE%3DQ9J7FGCGk15jyqBSFj1SASFmjwGvsxfb8btgZVg%40mail.gmail.com.

[Ariadni Michalitsi]

Dear Benoit,

Thank you for your explanations and your consideration of this issue. 

Please let me know if you have any updates!

All the best,

Ariadni Michalitsi

[Ariadni Michalitsi]

Dear Patrick,

I now saw your reply. Thank you for the explanation.

I will, for now, follow the workaround you suggest!

Best, 

Ariadni 

[Patrick Taillandier]

Hi,

Just an update. Thanks to Benoit, I was able to identify a type of OSM structures poorly imported by GAMA. I'll take care of fixing this tomorrow (it will be available for GAMA users on Thursday I think).

Patrick

To view this discussion on the web visit https://groups.google.com/d/msgid/gama-platform/858b344a-4ae9-4921-a89d-91c6b4737803n%40googlegroups.com.

[Ariadni Michalitsi]

Dear Patrick, 

Did you have the chance to work on that error?

I tried the workaround you suggested, but with no success. 

In particular, we converted filtered amenities into building agents. 

The problem with that is that, for this area of the NTUA campus, many things are defined as university amenities (such as parking spaces, wifi hotspots, etc) which are not buildings. 

As a result, when we incorporate university amenities into the simulation, buildings are created that are not buildings, and the simulation collapses.

I tried using shapefiles instead, to skip that problem. 

But, not being familiar with this type of files, I tried extracting my area of interest from BBBike (https://extract.bbbike.org/), and also converting its .osm file to shapefile using MyGeodata Cloud converter (https://mygeodata.cloud/). 

Both options had the same problem. The "buildings.shp" and the  "roads.shp" that I am getting from these actions probably do not contain the full graph (that is my guess), because most agents do not move at all and their path (by inspection of them) is always nil. 

I tested the same code to your shapefiles from the tutorials and everything works fine. 

So, my other question is if you have any other suggestion about how to get the shapefiles of areas of interest to be used in GAMA, if my approach is not the best one.

Please excuse my ignorance.

All the best,

Ariadni 

On Tuesday, February 9, 2021 at 5:09:16 AM UTC+2 Patrick Taillandier wrote:

[Srirama Bhamidipati]

Hi Ariadni,

This problem was fixed on February 9 by Patrick. Did you try updating GAMA? or may be downloading the latest GAMA? and then try your exercise ? 

I hope the update solves your problem. 

Srirama

[Ariadni Michalitsi]

Hello Srirama, 

Thank you for your answer! I downloaded the latest GAMA and ran the simulation, but the problem remains. 

There might be that some buildings have been added (I am not sure), but there are still lots missing.

I also attach two screenshots, one for the NTUA campus, using shapefiles and one by using .osm data to see the difference. 

Based on the changes you have made, should I have seen more than the ones that appear in the screenshot?

I would switch to the shapefiles to get my job done, but they do not work either. All buildings are created as they should have, but the agents do not move properly. 

This happens with all shapefiles that I am creating (downloaded from either BBBike or MyGeodata). There should probably be a problem with the shapefiles I am using and the way I extract them? I also attach the shapefiles for your reference.

Thank you for all your support!

Best, 

Ariadni 

[Quang Nghi HUYNH]

I will take a look if gama updates is still working

To view this discussion on the web visit https://groups.google.com/d/msgid/gama-platform/58510954-2d4c-4deb-83f0-89bf33e1af5en%40googlegroups.com.

[Quang Nghi HUYNH]

Hi,

This release is built Feb 24, so if the fix is Feb 9, it should be fine. Release Continuous build · gama-platform/gama (github.com)

To view this discussion on the web visit https://groups.google.com/d/msgid/gama-platform/58510954-2d4c-4deb-83f0-89bf33e1af5en%40googlegroups.com.

--

-------

HUYNH Quang-Nghi, Ph.D.

Lecturer

CICT - CTU,  Can Tho, Viet Nam

Core Developer of GAMA modeling and simulation platform

http://gama-platform.org/

[Vietnam] +84909128322

[Ariadni Michalitsi]

Hello,

You are right. I haven't used the latest release. Many thanks!! The problem is solved now. 

Best, 

Ariadni

You received this message because you are subscribed to a topic in the Google Groups "GAMA" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/gama-platform/xDyKRqK4HF0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to gama-platfor...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/gama-platform/CANNWKoep68RVpYdiuqkiKO2CNG2DYuQPt4o1DiMEf%3DRxt%2B5KqQ%40mail.gmail.com.