Limit rows for API calls

Parthasarathi Mukhopadhyay

unread,

Jul 17, 2021, 9:06:13 AM7/17/21

to openr...@googlegroups.com

Dear all

As you know, free API calls for many data sources are limited by time frame (daily, hourly, monthly) and the API we are interested here limits API for free as 1000 calls per day (in 24 hrs and possibly through IP authentication).

The question is that we are not getting any suitable way in OR version 3.4.1 or 3.5 Beta to select the first thousand rows for the API call on day 1, next thousand calls on day 2 and so on except manually STARing thousand rows and then selecting STARed rows (painful :( ).

Is there any way out to select a set of rows by numbers (say first 100, next 100 and so on)?

Best regards

-----------------------------------------------------------------------
Parthasarathi Mukhopadhyay
Professor, Department of Library and Information Science,

University of Kalyani, Kalyani - 741 235 (WB), India
-----------------------------------------------------------------------

Jevon, Graham

unread,

Jul 17, 2021, 9:18:52 AM7/17/21

to openr...@googlegroups.com

Hi Parthasarathi

Could you add a new column using the expression: row.index+1

That would number rows from 1 to x

Then you could use a numeric facet on that column to select rows 1-1000 today

Tomorrow you could select rows 1001-2000

And so on

Best wishes

Graham

--
You received this message because you are subscribed to the Google Groups "OpenRefine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openrefine+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/CAGM_5uar%3Dgx15Die7GP-Ee7zZD-qtcZoCgwb2-vv6GwvpxZUqw%40mail.gmail.com.

******************************************************************************************************************

Experience the British Library online at www.bl.uk

The British Library’s latest Annual Report and Accounts : www.bl.uk/aboutus/annrep/index.html

Help the British Library conserve the world's knowledge. Adopt a Book. www.bl.uk/adoptabook

The Library's St Pancras site is WiFi - enabled

*****************************************************************************************************************

The information contained in this e-mail is confidential and may be legally privileged. It is intended for the addressee(s) only. If you are not the intended recipient, please delete this e-mail and notify the postm...@bl.uk : The contents of this e-mail must not be disclosed or copied without the sender's consent.

The statements and opinions expressed in this message are those of the author and do not necessarily reflect those of the British Library. The British Library does not take any responsibility for the views of the author.

*****************************************************************************************************************

Think before you print

Parthasarathi Mukhopadhyay

unread,

Jul 17, 2021, 9:31:46 AM7/17/21

to openr...@googlegroups.com

Thanks Jevon.

This solution is working like a charm. :)

Thanks a ton.

Best regards

To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/CWXP265MB2951CAE09D7B600B5CC0B3DB82109%40CWXP265MB2951.GBRP265.PROD.OUTLOOK.COM.

Thad Guidry

unread,

Jul 17, 2021, 10:53:49 AM7/17/21

to openr...@googlegroups.com

Thanks Jevon,

This is often asked, so I've tried to add a small mention into our Docs

https://github.com/OpenRefine/OpenRefine/pull/4062/files

Thad

https://www.linkedin.com/in/thadguidry/

https://calendly.com/thadguidry/

To view this discussion on the web visit https://groups.google.com/d/msgid/openrefine/CAGM_5uZ7XEYsvc8%2B14Ukn01EsqNzvDQgr%2By6LEsfZMw-OFC2CA%40mail.gmail.com.