Retrieving providers data take too long

[mehdi.al...@gmail.com]

Hi Dear Sentilo Team 

We have  about 150k sensors (not physical)  in a provider , when we are retrieving sensor's data from the platform it returns HTTP 500 code due to the socket timeout , I increase  the  connection timeout  to 10 minutes in the class RESTClientImpl of sentilo-common and compile the sentilo again.  The query takes about 5 minutes to run and return a 140 MB result and this problem is solved, but we are planning to increase those sensors  10 times. I think it will take 10 time or  more to retrieving those load.  

I think this problem related to the implementation of sentilo catalog in class ApiController.java 

Do you have any suggestion to get the better performance for such a query?

Thank you 

Mehdi

[Sentilo IO]

Hi Mehdi,

We're not sure wich request are you talking about:

Retrieving the list of sensors of a provider through the catalog service ?

Or retrieving the data of a provider through the data service ?

Thanks,

[mehdi.al...@gmail.com]

sorry I had to mention that , 

Retrieving sensor data from catalog service.

[Sentilo IO]

Hi Mehdi,

Until now we don't have an use case with this huge amount of sensors... even less in one provider. 

We suggest to separate them in different providers, wich could be good not only for performance but for organizational reasons.

We cannot make any performance enhance in this matter right now, but if you can make them by your own we will be very glad to evaluate them in order to add them to next releases.

Regards,

Sentilo Team.

[mehdi.al...@gmail.com]

Thank you for the response , 

We are working on that, We will let you know if we get better performance 

Regards
Mehdi