[Django] #29522: Serializers are hard to modify

17 views
Skip to first unread message

Django

unread,
Jun 24, 2018, 10:19:29 PM6/24/18
to django-...@googlegroups.com
#29522: Serializers are hard to modify
------------------------------------------------+------------------------
Reporter: Levi Cameron | Owner: nobody
Type: Cleanup/optimization | Status: new
Component: Core (Serialization) | Version: master
Severity: Normal | Keywords:
Triage Stage: Unreviewed | Has patch: 0
Needs documentation: 0 | Needs tests: 0
Patch needs improvement: 0 | Easy pickings: 0
UI/UX: 0 |
------------------------------------------------+------------------------
**Use case**

Three times now I've had need to modify the ORM serializers for project
use. In every case I've had to replicate large parts (if not all) of
`django.core.serializers.base` in order to change 1 or 2 lines because
certain calls to functions in `django.core.serializers.base` form the
serializers are hardcoded.

* Changing JSON serialization to output in alphabetical order (so that
`dumpdata` doesn't reorder every field each time you run it)
* Changing deserialization to use `_base_manager` instead of
`_default_manager` (due to extra constraints on a custom manager)
* Implementing fixes for #7202, #7350 before they were merged

**Proposal**
I propose that instead of calling the following functions directly, the
serializer classes are modified to call an instance method of the same
name that then calls the existing module-level functions. This would allow
the ability to more easily override just one aspect of serializer
functionality without having to replicate large swathes of code.

I am not proposing to move these functions into the python serializer
class directly because this may break compatibility with existing code
that depends on the existing functions.

* `django.core.serializers.base.build_instance`
* `django.core.serializers.base.deserializer_m2m_values`
* `django.core.serializers.base.deserializer_fk_values`
* `django.core.serializers.python._get_model` (given that this is already
an internal function, implementation can be pushed into the class
directly)

(It might also be nice if the `json` and `pyyaml` classes could also have
`PythonDeserializer` be made a class attribute but that would involve
turning the `Deserializer` function into a class and is not nearly as much
code to override these as the functions above)


If this sounds acceptable, I will submit a patch.

--
Ticket URL: <https://code.djangoproject.com/ticket/29522>
Django <https://code.djangoproject.com/>
The Web framework for perfectionists with deadlines.

Django

unread,
Jun 24, 2018, 10:20:57 PM6/24/18
to django-...@googlegroups.com
#29522: Serializers are hard to modify
-------------------------------------+-------------------------------------

Reporter: Levi Cameron | Owner: nobody
Type: | Status: new
Cleanup/optimization |
Component: Core | Version: master
(Serialization) |
Severity: Normal | Resolution:

Keywords: | Triage Stage:
| Unreviewed
Has patch: 0 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 0
Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------
Description changed by Levi Cameron:

Old description:

New description:

**Use case**

Three times now I've had need to modify the ORM serializers for project
use. In every case I've had to replicate large parts (if not all) of
`django.core.serializers.base` in order to change 1 or 2 lines because

certain calls to functions in `django.core.serializers.base` from the
serializers are hardcoded.

--

--
Ticket URL: <https://code.djangoproject.com/ticket/29522#comment:1>

Django

unread,
Jun 24, 2018, 10:26:57 PM6/24/18
to django-...@googlegroups.com
#29522: Serializers are hard to modify
-------------------------------------+-------------------------------------

Reporter: Levi Cameron | Owner: nobody
Type: | Status: new
Cleanup/optimization |
Component: Core | Version: master
(Serialization) |
Severity: Normal | Resolution:
Keywords: | Triage Stage:
| Unreviewed
Has patch: 0 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 0
Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------
Description changed by Levi Cameron:

Old description:

> **Use case**


>
> Three times now I've had need to modify the ORM serializers for project
> use. In every case I've had to replicate large parts (if not all) of
> `django.core.serializers.base` in order to change 1 or 2 lines because

> certain calls to functions in `django.core.serializers.base` from the

New description:

**Use case**

Three times now I've had need to modify the ORM serializers for project

use. In some cases I've had to replicate large parts (if not most) of


`django.core.serializers.base` in order to change 1 or 2 lines because

certain calls to functions in `django.core.serializers.base` from the
serializers are hardcoded.

--

--
Ticket URL: <https://code.djangoproject.com/ticket/29522#comment:2>

Django

unread,
Jun 24, 2018, 10:27:49 PM6/24/18
to django-...@googlegroups.com
#29522: Serializers are hard to modify
-------------------------------------+-------------------------------------

Reporter: Levi Cameron | Owner: nobody
Type: | Status: new
Cleanup/optimization |
Component: Core | Version: master
(Serialization) |
Severity: Normal | Resolution:
Keywords: | Triage Stage:
| Unreviewed
Has patch: 0 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 0
Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------
Description changed by Levi Cameron:

Old description:

> **Use case**


>
> Three times now I've had need to modify the ORM serializers for project

> use. In some cases I've had to replicate large parts (if not most) of


> `django.core.serializers.base` in order to change 1 or 2 lines because

> certain calls to functions in `django.core.serializers.base` from the

New description:

**Use case**

Three times now I've had need to modify the ORM serializers for project

use. In some cases I've had to replicate large parts (if not most) of
`django.core.serializers.python` in order to change 1 or 2 lines because
certain calls to functions in `django.core.serializers.base` from the
serializers are hardcoded.

--

--
Ticket URL: <https://code.djangoproject.com/ticket/29522#comment:3>

Django

unread,
Jul 11, 2018, 3:12:40 AM7/11/18
to django-...@googlegroups.com
#29522: Serializers are hard to modify
--------------------------------------+------------------------------------

Reporter: Levi Cameron | Owner: nobody
Type: Cleanup/optimization | Status: new
Component: Core (Serialization) | Version: master
Severity: Normal | Resolution:
Keywords: | Triage Stage: Accepted

Has patch: 0 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 0
Easy pickings: 0 | UI/UX: 0
--------------------------------------+------------------------------------
Changes (by Carlton Gibson):

* stage: Unreviewed => Accepted


Comment:

This sounds reasonable to me. My main thought would be to make sure the
new hooks a properly documented etc. But yes, good idea.

--
Ticket URL: <https://code.djangoproject.com/ticket/29522#comment:4>

Django

unread,
Jul 11, 2018, 3:13:12 AM7/11/18
to django-...@googlegroups.com
#29522: Make Serializers easier to modify
--------------------------------------+------------------------------------

Reporter: Levi Cameron | Owner: nobody
Type: Cleanup/optimization | Status: new
Component: Core (Serialization) | Version: master
Severity: Normal | Resolution:
Keywords: | Triage Stage: Accepted
Has patch: 0 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 0
Easy pickings: 0 | UI/UX: 0
--------------------------------------+------------------------------------

--
Ticket URL: <https://code.djangoproject.com/ticket/29522#comment:5>

Django

unread,
Jul 15, 2018, 7:37:19 AM7/15/18
to django-...@googlegroups.com
#29522: Make Serializers easier to modify
--------------------------------------+------------------------------------
Reporter: Levi Cameron | Owner: nobody
Type: Cleanup/optimization | Status: new
Component: Core (Serialization) | Version: master
Severity: Normal | Resolution:
Keywords: | Triage Stage: Accepted
Has patch: 0 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 0
Easy pickings: 0 | UI/UX: 0
--------------------------------------+------------------------------------
Changes (by Herbert Fortes):

* cc: Herbert Fortes (added)


--
Ticket URL: <https://code.djangoproject.com/ticket/29522#comment:6>

Django

unread,
Apr 13, 2019, 4:52:30 AM4/13/19
to django-...@googlegroups.com
#29522: Make Serializers easier to modify
-------------------------------------+-------------------------------------
Reporter: Levi Cameron | Owner: Emad
Type: | Mokhtar
Cleanup/optimization | Status: assigned

Component: Core | Version: master
(Serialization) |
Severity: Normal | Resolution:
Keywords: | Triage Stage: Accepted
Has patch: 0 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 0
Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------
Changes (by Emad Mokhtar):

* owner: nobody => Emad Mokhtar
* status: new => assigned


--
Ticket URL: <https://code.djangoproject.com/ticket/29522#comment:7>

Django

unread,
Apr 13, 2019, 8:26:27 AM4/13/19
to django-...@googlegroups.com
#29522: Make Serializers easier to modify
-------------------------------------+-------------------------------------
Reporter: Levi Cameron | Owner: Emad
Type: | Mokhtar
Cleanup/optimization | Status: assigned
Component: Core | Version: master
(Serialization) |
Severity: Normal | Resolution:
Keywords: | Triage Stage: Accepted
Has patch: 0 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 0
Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------
Changes (by Ian Foote):

* cc: Ian Foote (added)


--
Ticket URL: <https://code.djangoproject.com/ticket/29522#comment:8>

Django

unread,
Apr 13, 2019, 10:20:27 AM4/13/19
to django-...@googlegroups.com
#29522: Make Serializers easier to modify
-------------------------------------+-------------------------------------
Reporter: Levi Cameron | Owner: Emad
Type: | Mokhtar
Cleanup/optimization | Status: assigned
Component: Core | Version: master
(Serialization) |
Severity: Normal | Resolution:
Keywords: | Triage Stage: Accepted
Has patch: 0 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 0
Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------

Comment (by Emad Mokhtar):

[PR created](https://github.com/EmadMokhtar/django/tree/ticket_29522)

--
Ticket URL: <https://code.djangoproject.com/ticket/29522#comment:9>

Django

unread,
Apr 14, 2019, 7:04:49 AM4/14/19
to django-...@googlegroups.com
#29522: Make Serializers easier to modify
-------------------------------------+-------------------------------------
Reporter: Levi Cameron | Owner: Emad
Type: | Mokhtar
Cleanup/optimization | Status: assigned
Component: Core | Version: master
(Serialization) |
Severity: Normal | Resolution:
Keywords: | Triage Stage: Accepted
Has patch: 1 | Needs documentation: 0

Needs tests: 0 | Patch needs improvement: 0
Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------
Changes (by Ian Foote):

* has_patch: 0 => 1


--
Ticket URL: <https://code.djangoproject.com/ticket/29522#comment:10>

Django

unread,
Apr 19, 2019, 7:20:07 AM4/19/19
to django-...@googlegroups.com
#29522: Make Serializers easier to modify.

-------------------------------------+-------------------------------------
Reporter: Levi Cameron | Owner: Emad
Type: | Mokhtar
Cleanup/optimization | Status: assigned
Component: Core | Version: master
(Serialization) |
Severity: Normal | Resolution:
Keywords: | Triage Stage: Accepted
Has patch: 1 | Needs documentation: 0
Needs tests: 1 | Patch needs improvement: 1

Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------
Changes (by felixxm):

* needs_better_patch: 0 => 1
* needs_tests: 0 => 1


--
Ticket URL: <https://code.djangoproject.com/ticket/29522#comment:11>

Django

unread,
Mar 8, 2024, 3:06:04 AMMar 8
to django-...@googlegroups.com
#29522: Make Serializers easier to modify.
--------------------------------------+------------------------------------
Reporter: Levi Cameron | Owner: (none)
Type: Cleanup/optimization | Status: new
Component: Core (Serialization) | Version: dev
Severity: Normal | Resolution:
Keywords: | Triage Stage: Accepted
Has patch: 1 | Needs documentation: 0
Needs tests: 1 | Patch needs improvement: 1
Easy pickings: 0 | UI/UX: 0
--------------------------------------+------------------------------------
Changes (by Mariusz Felisiak):

* owner: Emad Mokhtar => (none)
* status: assigned => new

--
Ticket URL: <https://code.djangoproject.com/ticket/29522#comment:12>

Django

unread,
Mar 18, 2024, 2:47:13 AMMar 18
to django-...@googlegroups.com
#29522: Make Serializers easier to modify.
--------------------------------------+------------------------------------
Reporter: Levi Cameron | Owner: (none)
Type: Cleanup/optimization | Status: new
Component: Core (Serialization) | Version: dev
Severity: Normal | Resolution:
Keywords: | Triage Stage: Accepted
Has patch: 1 | Needs documentation: 0
Needs tests: 1 | Patch needs improvement: 1
Easy pickings: 0 | UI/UX: 0
--------------------------------------+------------------------------------
Changes (by Ülgen Sarıkavak):

* cc: Ülgen Sarıkavak (added)

--
Ticket URL: <https://code.djangoproject.com/ticket/29522#comment:13>
Reply all
Reply to author
Forward
0 new messages