API search by lastUpdateTime

16 views
Skip to first unread message

paul.da...@gmail.com

unread,
Apr 4, 2019, 7:49:50 PM4/4/19
to Dataverse Users Community
I was wondering if it is possible to API search based on when a dataset was last updated or released? Ideally I would like to search for all datasets that were released/updated after a given date. Does that functionality exist, and if so, how do I do that?

Thanks,

Paul

Philip Durbin

unread,
Apr 4, 2019, 8:15:21 PM4/4/19
to dataverse...@googlegroups.com
Yes, but it's not documented. Please let me know if you the answer in https://github.com/IQSS/dataverse/issues/2291 helps and if you think we should document this please open a fresh issue.

Thanks,

Phil

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.
To post to this group, send email to dataverse...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataverse-community/5c27862b-c895-4a4e-aaa2-192ed5d4cbdd%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


--

paul.da...@gmail.com

unread,
Apr 5, 2019, 6:51:17 PM4/5/19
to Dataverse Users Community
Unfortunately, that seems to be searching based on Publication Date, which seems to only be the first time the Dataset is published. I'm trying to access all datasets that have been added or modified in a given range. It's the modified ones that seem like they may be the trickiest.

Thanks,

Paul

On Thursday, April 4, 2019 at 5:15:21 PM UTC-7, Philip Durbin wrote:
Yes, but it's not documented. Please let me know if you the answer in https://github.com/IQSS/dataverse/issues/2291 helps and if you think we should document this please open a fresh issue.

Thanks,

Phil

On Thu, Apr 4, 2019 at 7:49 PM <paul.d...@gmail.com> wrote:
I was wondering if it is possible to API search based on when a dataset was last updated or released? Ideally I would like to search for all datasets that were released/updated after a given date. Does that functionality exist, and if so, how do I do that?

Thanks,

Paul

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-community+unsub...@googlegroups.com.

Philip Durbin

unread,
Apr 5, 2019, 7:13:09 PM4/5/19
to dataverse...@googlegroups.com
I see. If "dateSort" isn't giving you what you want and you want to use the Search API, I'm afraid you'll have to open a GitHub issue to add "modificationDate". Below is a dump of what's currently indexed in Solr, the search engine powering search in Dataverse.

My other thought is that you *might* be able to get modification date from OAI-PMH but I'm not very familiar with that standard.

If you're interested in the rule on publication dates and other dates, please see the "Dataverse 4.0 Dates (Creation Date, Publication Date, etc.) and Sorting" doc at https://docs.google.com/document/d/1DWsEqT8KfheKZmMB3n_VhJpl9nIxiUjai_AIQPAjiyA/edit?usp=sharing and please feel free to join the conversation about dates in the "Creating a better understanding of DV's Dates Fields" thread at https://groups.google.com/d/msg/dataverse-community/n4I-bn1ukyQ/HWnt3FsSAgAJ

I hope this helps,

Phil

{
  "_version_": 1630015422185078800,
  "parentName": "Spruce",
  "parentId": "8",
  "subtreePaths": [
    "/7",
    "/7/8"
  ],
  "title": "Spruce Goose",
  "nameSort": "Spruce Goose",
  "depositor": "Spruce, Sabrina",
  "dsDescriptionValue": [
    "What the Spruce Goose was really made of."
  ],
  "datasetContactName": [
    "Sabrina Spruce"
  ],
  "authorName_ss": [
    "Spruce, Sabrina"
  ],
  "authorName": [
    "Spruce, Sabrina"
  ],
  "citationHtml": "Spruce, Sabrina, 2019, \"Spruce Goose\", <a href=\"https://doi.org/10.5072/FK2/3FOB4S\" target=\"_blank\">https://doi.org/10.5072/FK2/3FOB4S</a>, Root, V1",
  "citation": "Spruce, Sabrina, 2019, \"Spruce Goose\", https://doi.org/10.5072/FK2/3FOB4S, Root, V1",
  "identifierOfDataverse": "spruce",
  "dvObjectType": "datasets",
  "persistentUrl": "https://doi.org/10.5072/FK2/3FOB4S",
  "dsPersistentId": "doi:10.5072/FK2/3FOB4S",
  "identifier": "doi:10.5072/FK2/3FOB4S",
  "dataverseVersionIndexedBy_s": "4.12",
  "entityId": 10,
  "id": "dataset_10",
  "dvName": "Spruce",
  "dateSort": "2019-04-05T22:37:23.079Z",
  "publicationStatus": [
    "Published"
  ],
  "publicationDate": "2019",
  "dsPublicationDate": "2019",
  "isHarvested": false,
  "metadataSource": "Root",
  "datasetVersionId": 1
}


On Fri, Apr 5, 2019 at 6:51 PM <paul.da...@gmail.com> wrote:
Unfortunately, that seems to be searching based on Publication Date, which seems to only be the first time the Dataset is published. I'm trying to access all datasets that have been added or modified in a given range. It's the modified ones that seem like they may be the trickiest.

Thanks,

Paul

On Thursday, April 4, 2019 at 5:15:21 PM UTC-7, Philip Durbin wrote:
Yes, but it's not documented. Please let me know if you the answer in https://github.com/IQSS/dataverse/issues/2291 helps and if you think we should document this please open a fresh issue.

Thanks,

Phil

On Thu, Apr 4, 2019 at 7:49 PM <paul.d...@gmail.com> wrote:
I was wondering if it is possible to API search based on when a dataset was last updated or released? Ideally I would like to search for all datasets that were released/updated after a given date. Does that functionality exist, and if so, how do I do that?

Thanks,

Paul

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.

To post to this group, send email to dataverse...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages