Custom REST Connection / Source with different pagination and field configs

[David Rinell]

Hi,

I am working with a custom REST api source and I am having issues with how to configure the resources / endpoints / fields to make this work.

Question 1 - Pagination of results - appears to use the cursor method for pagination but the field for the next page of results is a complete URL - is there a way to make this work with the page iterator or do i have to custom code this?

Question 2 - Fields / Field Template - the fields in the response are in the "data" element.  How do I set up a template or compound field or ???  to make this work?

Example response from the endpoint:

{

  "data": [
    {
      "id": "43",
      "reference_number": "WMWRF33519TW73378",
      "make": "MINI",
      "model": "COOPER S",
      "year": "2006",
      "hours": 4279,
      "odometer": 4279,
      "created_at": "2014-04-01T19:00:00.000Z",
      "updated_at": "2024-10-08T09:41:00.000Z",
      "extended_data": {
        "stock_number": "AB12354"
      }
    }
  ],
  "paging": {
    "per_page": 25,
    "next_url": "http://api.record360.com/v3/units?page=eyJwYWdlX251bWJlciI6MywidmFsdWVzIjp7ImlkIjo0NX19&per_page=25"
  }
}