[postgis-users] view raster data and query performance

13 views
Skip to first unread message

Melpati, Muni

unread,
Jul 27, 2012, 5:22:43 PM7/27/12
to postgi...@postgis.refractions.net

Hi,

I am having some performance issues in querying data with arcgis and pgadmin itself.

1)      If the vector data has many records like 60,000 records, arcgis, from remote machine, could not retrieve all the records of the vector data.  If I select all feature it displays the attributes with a warning that it take long time to retrieve large data. It takes considerable time before being able to see all selected attributes. If switch selection, in this case no selection, again, I would not be able to see any records. I open task manager in the server machine and noticed, while I switch between select all to none feature, the cpu is shooting all the way upto 60%.

2)      I have also imported raster data by splitting  a raster file into  400 tiles. It is taking considerable time even to view all rows in pgadmin III. It is also considerably slow in view in QGIS, on the same machine, as well.

What must be going wrong.

I have also changed postgresql.config file to improve the performance with no noticeble difference. Can anyone faced this problem or have any suggestion to improve the performance? Thanks in advance.

Paolo Cavallini

unread,
Jul 30, 2012, 6:16:52 AM7/30/12
to postgi...@postgis.refractions.net
Il 27/07/2012 23:22, Melpati, Muni ha scritto:

I have also changed postgresql.config file to improve the performance with no noticeble difference. Can anyone faced this problem or have any suggestion to improve the performance? Thanks in advance.


Agreed, it is so slow to be barely usable in real world. I suppose this is due to the GDAL provider, right?
All the best.
-- 
Paolo Cavallini - Faunalia
www.faunalia.eu
Full contact details at www.faunalia.eu/pc
Nuovi corsi QGIS e PostGIS: http://www.faunalia.it/calendario

Melpati, Muni

unread,
Jul 30, 2012, 4:26:40 PM7/30/12
to postgi...@postgis.refractions.net

I cannot answer for that. If anyone had this problem and fixed it, I would like to know how they have done it.

Moreover, When I tries to store raster data outside the database, I could not even add the layer from QGIS. When I tried to add the layer using postgis plugin, I find raster layer related columns (pixel type, is extrernal file, pixel size x, pixel size y in the “load potgis raster layer “ interface, has values none. I must have done something wrong. When I add this raster layer, QGIS crashes.

Here is the syntax I have used:

raster2pgsql -I -R -e -Y -F -s 26986 -t 128x128  c:\PostGIS\raster\dowell.jpg public.raster | psql -U postgres -d gisdb -h localhost -p 5432

 

Anything wrong with it. Thanks.

 

 

 

Date: Mon, 30 Jul 2012 12:16:52 +0200

From: Paolo Cavallini <cava...@faunalia.it>

Subject: Re: [postgis-users] view raster data and query performance

To: postgi...@postgis.refractions.net

Message-ID: <50165F14...@faunalia.it>

Content-Type: text/plain; charset="iso-8859-1"

Bborie Park

unread,
Jul 30, 2012, 5:04:03 PM7/30/12
to postgi...@postgis.refractions.net
For QGIS, you need to use the PostGIS Raster plugin, not the PostGIS plugin.

-bborie

On 07/30/2012 01:26 PM, Melpati, Muni wrote:
> I cannot answer for that. If anyone had this problem and fixed it, I would like to know how they have done it.
>
> Moreover, When I tries to store raster data outside the database, I could not even add the layer from QGIS. When I tried to add the layer using postgis plugin, I find raster layer related columns (pixel type, is extrernal file, pixel size x, pixel size y in the "load potgis raster layer " interface, has values none. I must have done something wrong. When I add this raster layer, QGIS crashes.
>
> Here is the syntax I have used:
>
> raster2pgsql -I -R -e -Y -F -s 26986 -t 128x128 c:\PostGIS\raster\dowell.jpg public.raster | psql -U postgres -d gisdb -h localhost -p 5432
>
>
>
> Anything wrong with it. Thanks.
>
>
>
>
>
>
>
> Date: Mon, 30 Jul 2012 12:16:52 +0200
>
> From: Paolo Cavallini <cava...@faunalia.it<mailto:cava...@faunalia.it>>
>
> Subject: Re: [postgis-users] view raster data and query performance
>
> To: postgi...@postgis.refractions.net<mailto:postgi...@postgis.refractions.net>
>
> Message-ID: <50165F14...@faunalia.it<mailto:50165F14...@faunalia.it>>
>
> Content-Type: text/plain; charset="iso-8859-1"
>
>
>
> Il 27/07/2012 23:22, Melpati, Muni ha scritto:
>
>>
>
>> I have also changed postgresql.config file to improve the performance
>
>> with no noticeble difference. Can anyone faced this problem or have
>
>> any suggestion to improve the performance? Thanks in advance.
>
>>
>
>>
>
> Agreed, it is so slow to be barely usable in real world. I suppose this is due to the GDAL provider, right?
>
> All the best.
>
>
>
> --
>
> Paolo Cavallini - Faunalia
>
>
>
>
> _______________________________________________
> postgis-users mailing list
> postgi...@postgis.refractions.net
> http://postgis.refractions.net/mailman/listinfo/postgis-users
>

--
Bborie Park
Programmer
Center for Vectorborne Diseases
UC Davis
530-752-8380
bkp...@ucdavis.edu
_______________________________________________
postgis-users mailing list
postgi...@postgis.refractions.net
http://postgis.refractions.net/mailman/listinfo/postgis-users

Paolo Cavallini

unread,
Jul 30, 2012, 6:17:40 PM7/30/12
to postgi...@postgis.refractions.net
Il 30/07/2012 23:04, Bborie Park ha scritto:
> For QGIS, you need to use the PostGIS Raster plugin, not the PostGIS plugin.
>
not quite right: take QGIS 1.8 (latest released) and use the embedded DB
Manager, dragging and dropping on the canvas should just work.
All the best.

--
Paolo Cavallini - Faunalia
www.faunalia.eu
Full contact details at www.faunalia.eu/pc
Nuovi corsi QGIS e PostGIS: http://www.faunalia.it/calendario

Reply all
Reply to author
Forward
0 new messages