[Django] #28518: improve performance of loading geometries from DB

13 views
Skip to first unread message

Django

unread,
Aug 22, 2017, 4:10:40 PM8/22/17
to django-...@googlegroups.com
#28518: improve performance of loading geometries from DB
------------------------------------------------+------------------------
Reporter: Sergey Fedoseev | Owner: nobody
Type: Cleanup/optimization | Status: new
Component: GIS | Version: master
Severity: Normal | Keywords:
Triage Stage: Unreviewed | Has patch: 0
Needs documentation: 0 | Needs tests: 0
Patch needs improvement: 0 | Easy pickings: 0
UI/UX: 0 |
------------------------------------------------+------------------------


--
Ticket URL: <https://code.djangoproject.com/ticket/28518>
Django <https://code.djangoproject.com/>
The Web framework for perfectionists with deadlines.

Django

unread,
Aug 22, 2017, 4:10:52 PM8/22/17
to django-...@googlegroups.com
#28518: improve performance of loading geometries from DB
-------------------------------------+-------------------------------------
Reporter: Sergey Fedoseev | Owner: Sergey
Type: | Fedoseev
Cleanup/optimization | Status: assigned
Component: GIS | Version: master
Severity: Normal | Resolution:

Keywords: | Triage Stage:
| Unreviewed
Has patch: 0 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 0
Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------
Changes (by Sergey Fedoseev):

* owner: nobody => Sergey Fedoseev
* status: new => assigned


--
Ticket URL: <https://code.djangoproject.com/ticket/28518#comment:1>

Django

unread,
Aug 22, 2017, 4:25:59 PM8/22/17
to django-...@googlegroups.com
#28518: improve performance of loading geometries from DB
-------------------------------------+-------------------------------------
Reporter: Sergey Fedoseev | Owner: Sergey
Type: | Fedoseev
Cleanup/optimization | Status: assigned
Component: GIS | Version: master
Severity: Normal | Resolution:

Keywords: | Triage Stage:
| Unreviewed
Has patch: 0 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 0
Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------

Comment (by Sergey Fedoseev):

[https://github.com/django/django/pull/8956 PR]

Before:
{{{
In [2]: %timeit for x in City.objects.values_list('point')[:1000]: pass
64.4 ms ± 644 µs per loop (mean ± std. dev. of 7 runs, 10 loops each)
}}}
After:
{{{
In [3]: %timeit for x in City.objects.values_list('point')[:1000]: pass
49.8 ms ± 957 µs per loop (mean ± std. dev. of 7 runs, 10 loops each)
}}}

--
Ticket URL: <https://code.djangoproject.com/ticket/28518#comment:2>

Django

unread,
Aug 23, 2017, 2:22:58 PM8/23/17
to django-...@googlegroups.com
#28518: improve performance of loading geometries from DB
-------------------------------------+-------------------------------------
Reporter: Sergey Fedoseev | Owner: Sergey
Type: | Fedoseev
Cleanup/optimization | Status: assigned
Component: GIS | Version: master
Severity: Normal | Resolution:
Keywords: | Triage Stage: Accepted
Has patch: 1 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 1

Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------
Changes (by Tim Graham):

* needs_better_patch: 0 => 1
* has_patch: 0 => 1
* stage: Unreviewed => Accepted


--
Ticket URL: <https://code.djangoproject.com/ticket/28518#comment:3>

Django

unread,
Aug 24, 2017, 2:45:25 PM8/24/17
to django-...@googlegroups.com
#28518: improve performance of loading geometries from DB
-------------------------------------+-------------------------------------
Reporter: Sergey Fedoseev | Owner: Sergey
Type: | Fedoseev
Cleanup/optimization | Status: closed
Component: GIS | Version: master
Severity: Normal | Resolution: fixed
Keywords: | Triage Stage: Accepted
Has patch: 1 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 1

Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------
Changes (by Tim Graham <timograham@…>):

* status: assigned => closed
* resolution: => fixed


Comment:

In [changeset:"1a85b07bddbf43da00311bdbb3ef5519a3165dc6" 1a85b07]:
{{{
#!CommitTicketReference repository=""
revision="1a85b07bddbf43da00311bdbb3ef5519a3165dc6"
Fixed #28518 -- Improved performance of loading geometries from DB.
}}}

--
Ticket URL: <https://code.djangoproject.com/ticket/28518#comment:4>

Django

unread,
Aug 25, 2017, 4:41:38 AM8/25/17
to django-...@googlegroups.com
#28518: improve performance of loading geometries from DB
-------------------------------------+-------------------------------------
Reporter: Sergey Fedoseev | Owner: Sergey
Type: | Fedoseev
Cleanup/optimization | Status: closed
Component: GIS | Version: master

Severity: Normal | Resolution: fixed
Keywords: | Triage Stage: Accepted
Has patch: 1 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 1

Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------

Comment (by Sergey Fedoseev):

[https://github.com/django/django/pull/8971 another PR]

Before:


{{{
In [3]: %timeit for x in City.objects.values_list('point')[:1000]: pass

49.5 ms ± 367 µs per loop (mean ± std. dev. of 7 runs, 10 loops each)
}}}
After:
{{{
In [4]: %timeit for x in City.objects.values_list('point')[:1000]: pass
32.1 ms ± 1.54 ms per loop (mean ± std. dev. of 7 runs, 10 loops each)
}}}

--
Ticket URL: <https://code.djangoproject.com/ticket/28518#comment:5>

Django

unread,
Sep 5, 2017, 9:55:11 AM9/5/17
to django-...@googlegroups.com
#28518: improve performance of loading geometries from DB
-------------------------------------+-------------------------------------
Reporter: Sergey Fedoseev | Owner: Sergey
Type: | Fedoseev
Cleanup/optimization | Status: closed
Component: GIS | Version: master

Severity: Normal | Resolution: fixed
Keywords: | Triage Stage: Accepted
Has patch: 1 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 1

Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------

Comment (by Tim Graham <timograham@…>):

In [changeset:"2ef4b4795e29be8c33a6de9cc0c05b59025d13a5" 2ef4b479]:
{{{
#!CommitTicketReference repository=""
revision="2ef4b4795e29be8c33a6de9cc0c05b59025d13a5"
Refs #28518 -- Improved performance of loading geometries from DB.
}}}

--
Ticket URL: <https://code.djangoproject.com/ticket/28518#comment:6>

Django

unread,
Nov 4, 2017, 11:18:25 AM11/4/17
to django-...@googlegroups.com
#28518: improve performance of loading geometries from DB
-------------------------------------+-------------------------------------
Reporter: Sergey Fedoseev | Owner: Sergey
Type: | Fedoseev
Cleanup/optimization | Status: closed
Component: GIS | Version: master

Severity: Normal | Resolution: fixed
Keywords: | Triage Stage: Accepted
Has patch: 1 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 1

Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------

Comment (by Tim Graham <timograham@…>):

In [changeset:"8869142a4d5b069c61781c0e4c5fdc971b017949" 8869142a]:
{{{
#!CommitTicketReference repository=""
revision="8869142a4d5b069c61781c0e4c5fdc971b017949"
Fixed #28632 -- Updated docs about using raw SQL with GIS and doc'd
changes from refs #28518 in release notes.
}}}

--
Ticket URL: <https://code.djangoproject.com/ticket/28518#comment:7>

Django

unread,
Nov 4, 2017, 11:51:25 AM11/4/17
to django-...@googlegroups.com
#28518: improve performance of loading geometries from DB
-------------------------------------+-------------------------------------
Reporter: Sergey Fedoseev | Owner: Sergey
Type: | Fedoseev
Cleanup/optimization | Status: closed
Component: GIS | Version: master

Severity: Normal | Resolution: fixed
Keywords: | Triage Stage: Accepted
Has patch: 1 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 1

Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------

Comment (by Tim Graham <timograham@…>):

In [changeset:"a44fb4aa02ed6d87f22d96a48907dbe833e1d392" a44fb4aa]:
{{{
#!CommitTicketReference repository=""
revision="a44fb4aa02ed6d87f22d96a48907dbe833e1d392"
[2.0.x] Fixed #28632 -- Updated docs about using raw SQL with GIS and


doc'd changes from refs #28518 in release notes.

Backport of 8869142a4d5b069c61781c0e4c5fdc971b017949 from master
}}}

--
Ticket URL: <https://code.djangoproject.com/ticket/28518#comment:8>

Django

unread,
Nov 6, 2017, 1:45:24 PM11/6/17
to django-...@googlegroups.com
#28518: improve performance of loading geometries from DB
-------------------------------------+-------------------------------------
Reporter: Sergey Fedoseev | Owner: Sergey
Type: | Fedoseev
Cleanup/optimization | Status: closed
Component: GIS | Version: master

Severity: Normal | Resolution: fixed
Keywords: | Triage Stage: Accepted
Has patch: 1 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 1

Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------

Comment (by Sergey Fedoseev):

[https://github.com/django/django/pull/9329 PR]

Before:
{{{
In [2]: %timeit for x in City.objects.all()[:1000]: pass
106 ms ± 802 µs per loop (mean ± std. dev. of 7 runs, 10 loops each)
}}}
After:
{{{
In [2]: %timeit for x in City.objects.all()[:1000]: pass
81.8 ms ± 595 µs per loop (mean ± std. dev. of 7 runs, 10 loops each)
}}}

--
Ticket URL: <https://code.djangoproject.com/ticket/28518#comment:9>

Django

unread,
Nov 7, 2017, 9:49:51 AM11/7/17
to django-...@googlegroups.com
#28518: improve performance of loading geometries from DB
-------------------------------------+-------------------------------------
Reporter: Sergey Fedoseev | Owner: Sergey
Type: | Fedoseev
Cleanup/optimization | Status: closed
Component: GIS | Version: master

Severity: Normal | Resolution: fixed
Keywords: | Triage Stage: Accepted
Has patch: 1 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 1

Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------

Comment (by Tim Graham <timograham@…>):

In [changeset:"a4f9ef4fe8048264c5d9e193e2ff79f735626c65" a4f9ef4]:
{{{
#!CommitTicketReference repository=""
revision="a4f9ef4fe8048264c5d9e193e2ff79f735626c65"
Refs #28518 -- Improved performance of assigning values to GeometryFields.
}}}

--
Ticket URL: <https://code.djangoproject.com/ticket/28518#comment:10>

Reply all
Reply to author
Forward
0 new messages