DAY 5 - DATA FLOW SCHEMA

60 views
Skip to first unread message

Federica Foglini

unread,
Jul 27, 2012, 3:47:24 AM7/27/12
to cocon...@googlegroups.com

First of all thanks for your fruitful cooperation in this workshop,

 Today we start a new topic but we will continue the discussion about UML and Metadata.

It is fundamental for receiving data to to create a simple way to submit  data for all partners.

 The general idea of the data flow is(please have a look to the schema ):

The COCONET partners will submit the GIS data for the WPs they are involved, in a proper folder. The GIS group will harmonize the data following the COCONET data model, they will check the data quality and will implement the Geodatabases as shown in the schema.We will set up four distributed Geodatabase as replicas that will be synchronized in a central Geodatabase for the Mediterranean and Black Sea. GIS Data for the pilot project will be stored in two dedicated Geodatabase replicas and then synchronized in a central Geodatabase for pilot projects. We define the regional or thematic Coordinators for GEODBs as shown in the following schema.

We still need to define the Coordinator for WP4 Geodatabase. Some Ideas and volunteer?

Which is the best way of submitting data for COCONET partners? Remind that most of the participants are not familiar with GIS and they should make and effort to submit data. In order to succeed we need to be as clear as possible since the beginning and write a sort of quick and easy manual to distribute to people.

Oltion Fociro will make a proposal for data submission, please revise it and make comments.

Contact person for GEODB

GeoDB1

CONISMA

Francesco De Leo

GeoDB2

CNRS

Aurore Chassanite and ?

GeoDB3

HCMR

VIVi' Drakopoulou

GeoDB4

INCDM

Alina Spinu

GeoDB5

CNR ISMAR

Federica Foglini

Central GeoDB

for Piltot project

UkrSCES

Richard Lisovsky and his team

 

Central GeoDB Mediterranean and Black Sea

CNR ISMAR

Federica Foglini and his team

 


DataFlowSchema.pdf

Oltion Fociro

unread,
Jul 27, 2012, 4:30:59 AM7/27/12
to cocon...@googlegroups.com
Dear all,

Welcome to the 5-th day of this virtual workshop. I want to propose a way in my view easy and efficient to download and upload data from the server.
Database
Like firs step we need a DBMS to store the data and their attributes where all uploaded files will be indexed for each meeting. This is necessary to index the files and make possible a search of files like the need of the costumer. The database will be create in respect of the geodatabase.The creation of this database would need a reasonable use of a DBMS as MySQL. Designing the database should be taken into account, probably a search engine that can arise in such way that finding desired files should be easy and efficient.

Creation of the system

The system is logically composed of two blocks:

 

1)      Administrator: who will manage all users and all files in the system making possible to add or delete users, delete or modify files and their indexed attributes in the database.  The administrator will have a graphical interface different from interfaces of normal users. The Administrator will perform a normal login as any user but the page that will be visualized will have the administrators instruments.

 

2)      User: who will be able to upload and download different formats and files. This block will be divided into three main blocks:

a.       Upload: will be a section where, if the user has rights to upload, he can upload different files.

b.      Download: will be a section where, if the user has rights to download he can download files that are in the system.

c.       Search Engine: is a page where the user can do a search according to attributes or keywords. We thus he can find the files he needs.

 

To make possible the implementation of this system are required several instruments. The first is a server installation of mySQL database server. In the same server should be also installed a web server such as apache 2.2 and php scripting language. All these tools are open source. And don’t represent an obstruction by the administrative way.

 

This is not so easy to build but the user will download and upload files very easily.


Federica Foglini

unread,
Jul 27, 2012, 5:11:36 AM7/27/12
to cocon...@googlegroups.com

Dear Oltino,

please take into account that the data we will receive will be in different format and there will be Spatial Data.
The GIS group will get the data, check the data quality and then load the data in the Geodatabase.

Olexander can you make a comment on that.
I know your realized system for data exchange in previous projects. What do you think about this proposal
I think we need to go for easy solution also to realize.

Who can realize this system?




Oltion Fociro

unread,
Jul 27, 2012, 5:22:38 AM7/27/12
to cocon...@googlegroups.com
the system will be format independent. We can decide witch kind of format will upload and download.
To realize this system i can organize my students and i work on it.

Oltion Fociro

unread,
Jul 27, 2012, 5:30:00 AM7/27/12
to cocon...@googlegroups.com
maybe it's not feasible but i think you can manage better the files than with a ftp server or SVN.

Vivi Drakopoulou

unread,
Jul 27, 2012, 7:14:20 AM7/27/12
to cocon...@googlegroups.com
Dear Federica
I' d like to add Angelo Lykiardopoulos as regional or thematic coordinators for GEODBs.
He is the director of our computer center add he is expert on DBMS managment and data exchange.
So:  GeoDB3 - HCMR - Vivi Drakopoulou and Angelo Lykiardopoulos.
Vivi

Federica Foglini

unread,
Jul 27, 2012, 7:23:44 AM7/27/12
to cocon...@googlegroups.com
Devrim

What about metadata submission?
How Partners will send metadata? email to you? ftp site?

I think we should ask to submit metadata and data at the same time

What do you thinks about that?

Oleksandr Neprokin

unread,
Jul 27, 2012, 7:35:40 AM7/27/12
to cocon...@googlegroups.com

Dear Federica, Dear Oltion

We are thinking about the data exchange within our Project. On Monday we will come up with our opinion and maybe proposal.
We have a question to Oltion, please explain: The database will be create in respect of the geodatabase. What does this mean ?


Devrim Tezcan

unread,
Jul 27, 2012, 8:35:34 AM7/27/12
to cocon...@googlegroups.com
In my opinion, as the size of the xml files are only few kb each, e-mail is quite enough to submit the metadata. The metadata can be submitted before the data but not later please.


Aurore Chassanite

unread,
Jul 27, 2012, 9:24:19 AM7/27/12
to cocon...@googlegroups.com
Hello Frederica,
 
Following our discussion in Istanbul, concerning the link between the WP9 and the WP3 and WP4 in the dataflow schema:
as the data are really different for those 2 WP and there is a lot of information needed for the WP4. I would like to ask if it is possible to split the geodatabase (GeoDB2) into two geodatabase. As we (CNRS) have only two person-month for the WP8 and 2 for the WP9, I think it will be enough for me to deal with a geodatabase only for the WP3. I think that CSIC (as WP4 coordinator) should be in charge of the other geodatabase concerning only the WP4.
 
Let me know what do you think about my proposition.
 
Aurore

Federica Foglini

unread,
Jul 27, 2012, 9:29:29 AM7/27/12
to cocon...@googlegroups.com
Hello Aurore,

I agree with you position, and I am sure you need help from someone within WP4. The problem is that there are not GIS expert in WP4 able to deal with Geodatabase.

We can split the Geodatabases but we need a representative for WP4.  Are there volunteer within this group? Someone close to WP4?
Antoni what do you think about?

I will wait some proposale and then we will see how to manage this kind of data

Thanks



Antoni García Rubies

unread,
Jul 30, 2012, 4:30:59 AM7/30/12
to cocon...@googlegroups.com
Dear Federica,

I'm very sorry because I had to quit the virtual meeting suddenly on Friday. My uncle died... and you know what that means in a Mediterranean country...
After the meeting I am absolutely aware that I know nothing about GIS. That's why we are looking for someone who knows something in order to properly define the attributes of layers defined in WP4. I will also assist to a GIS formation course just after the summer... On the other hand, I do believe that the CEAB should be the coordinator for WP4 Geodatabase. I have to ask the technician if the server is powerful enough to cope with all the data, but I think that there will be no problem. Al we need is some time...

Yours,

Toni
-- 
Antoni Garcia Rubies
Centre d'Estudis Avançats de Blanes (CSIC)
Accés a la Cala St. Francesc, 14
17300 BLANES, GIRONA (SPAIN)
TEL +34 972336101
FAX +34 972337806
e-mail <ton...@ceab.csic.es>
Reply all
Reply to author
Forward
0 new messages