BCE dates

39 views
Skip to first unread message

Eduards Skvireckis

unread,
Apr 13, 2021, 11:07:24 AM4/13/21
to OpenRefine
Hi,

How can I represent BCE dates with OpenRefine to upload them to Wikidata afterward properly?
I use EDTF date format (same as ISO8601 in treating BCE dates, e.g., year 8 BCE, as -0007, etc.)
  • when I try to transform cell values to dates, OpenRefine doesn't take into account the "-" sign (-0459 --> 0459-01-01T01:00:00Z, etc.)
  • when I try to create Wikidata schema, in the preview I get:
    • 460Gregorian (when using string "-0459")
    • 1 January 459Gregorian (when using date format: 0459-01-01T01:00:00Z)
What would be the best way to represent BCE dates so both OpenRefine and Wikidata could understand them?

Eduards

Thad Guidry

unread,
Apr 13, 2021, 11:26:22 AM4/13/21
to openr...@googlegroups.com
What happens if you don't transform to a DATE datatype, but instead keep everything as TEXT datatype ?
(but still do your transforms etc., but finally storing the OpenRefine cell as TEXT or String)

Does it help or make a difference for Wikidata uploads?  I honestly do not know and would have to dive in to look at our code, but just quickly throwing this idea out there.



--
You received this message because you are subscribed to the Google Groups "OpenRefine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/90ae4c86-ce34-41f8-8bf8-a99d329c2c85n%40googlegroups.com.

Eduards Skvireckis

unread,
Apr 13, 2021, 12:27:58 PM4/13/21
to openr...@googlegroups.com
Thanks for getting back to me!

When I do that and keep all cell values as TEXT datatype, in the [Wikidata schema] "Preview" tab I still get " 460Gregorian"


Eduards Skvireckis


You received this message because you are subscribed to a topic in the Google Groups "OpenRefine" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/openrefine/nBLMNsq98k4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to openrefine+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/CAChbWaMUFx5idMCoDucL6gHrDMV40JyQVAPPbxR%3DcmYfSXy6SQ%40mail.gmail.com.

Jevon, Graham

unread,
Apr 13, 2021, 1:12:21 PM4/13/21
to openr...@googlegroups.com

This may be irrelevant, given you’re uploading, but I seem to remember that the same problem occurs when data goes the other way. During reconciliation, BCE dates in wikidata populate in OpenRefine as CE dates. I could be misremembering and that issue could have been resolved since I last used wikidata reconciliation on BCE dates, but I’m pretty sure that was a problem I previously encountered.


 
******************************************************************************************************************
Experience the British Library online at www.bl.uk
The British Library’s latest Annual Report and Accounts : www.bl.uk/aboutus/annrep/index.html
Help the British Library conserve the world's knowledge. Adopt a Book. www.bl.uk/adoptabook
The Library's St Pancras site is WiFi - enabled
*****************************************************************************************************************
The information contained in this e-mail is confidential and may be legally privileged. It is intended for the addressee(s) only. If you are not the intended recipient, please delete this e-mail and notify the postm...@bl.uk : The contents of this e-mail must not be disclosed or copied without the sender's consent.
The statements and opinions expressed in this message are those of the author and do not necessarily reflect those of the British Library. The British Library does not take any responsibility for the views of the author.
*****************************************************************************************************************
Think before you print

Antonin Delpeuch (lists)

unread,
Apr 14, 2021, 4:58:25 PM4/14/21
to openr...@googlegroups.com
Hi Eduards,

We added support for dates with custom calendars some time ago. The
syntax is described here:
https://www.wikidata.org/wiki/Wikidata:Tools/OpenRefine/Editing/Schema_alignment#Dates

As Thad mentions, it's easiest to keep dates in text format when you
want to upload them to Wikidata: that lets you control the precision better.

Let me know if it helps!

Best,
Antonin

On 13/04/2021 17:07, Eduards Skvireckis wrote:
> Hi,
>
> How can I represent BCE dates with OpenRefine to upload them to Wikidata
> afterward properly?
> I use EDTF date format (same as ISO8601 in treating BCE dates, e.g.,
> year 8 BCE, as -0007, etc.)
>
> * when I try to transform cell values to dates, OpenRefine doesn't
> take into account the "-" sign (-0459 --> 0459-01-01T01:00:00Z, etc.)
> * when I try to create Wikidata schema, in the preview I get:
> o 460Gregorian (when using string "-0459")
> o 1 January 459Gregorian (when using date format:
> 0459-01-01T01:00:00Z)
>
> What would be the best way to represent BCE dates so both OpenRefine and
> Wikidata could understand them?
>
> Eduards
>
> --
> You received this message because you are subscribed to the Google
> Groups "OpenRefine" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to openrefine+...@googlegroups.com
> <mailto:openrefine+...@googlegroups.com>.
> <https://groups.google.com/d/msgid/openrefine/90ae4c86-ce34-41f8-8bf8-a99d329c2c85n%40googlegroups.com?utm_medium=email&utm_source=footer>.

Antonin Delpeuch (lists)

unread,
Apr 14, 2021, 8:11:05 PM4/14/21
to openr...@googlegroups.com
Hmm obviously I was too quick off the ball here - I don't think we have
support for negative year values yet. We could open an issue about it.

Antonin

Eduards Skvireckis

unread,
Apr 15, 2021, 9:23:55 AM4/15/21
to OpenRefine
Hi, Antonin,

Thank you for opening an issue about it! 

Eduards

Reply all
Reply to author
Forward
0 new messages