we have about one hundred sensor nodes (will be added even more in the future) to collect the environmental parameters, such as temp, humidity and air concentration. The sensor nodes will send the data with a interval of about 10s. And we need to read the data from database to show it in our own system, eg. from time A to time B; from time A till now... I've learned cassandra and Oracle NoSQL, is there any one could give me some suggestions. Thanks a lot.
Hi,
OrientDB it's very fast on time series by defining an index on the time
property and executing range queries like. Supports an enhanced version of
SQL.
Create the database, schema and index:
> create database local:/temp/test admin admin local
> create class SensorData
> create property SensorData.time datetime
> create index time_series on ( SensorData ) notunique
Insert some data:
> insert into SensorData (time, description) values ( '2010-01-01
10:10:00.000', 'this is just a description')
Now extract data:
> select from SensorData where time between '2010-01-01 10:10:00.000' and
'2010-01-01 10:20:00.000'
Lvc@
On 8 May 2012 10:17, Macho Che <chewei...@gmail.com> wrote:
> we have about one hundred sensor nodes (will be added even more in the
> future) to collect the environmental parameters, such as temp, humidity and
> air concentration. The sensor nodes will send the data with a interval of
> about 10s. And we need to read the data from database to show it in our own
> system, eg. from time A to time B; from time A till now...
> I've learned cassandra and Oracle NoSQL, is there any one could give me
> some suggestions.
> Thanks a lot.
> --
> You received this message because you are subscribed to the Google Groups
> "NOSQL" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/nosql-discussion/-/tf5bysvphYoJ.
> To post to this group, send email to nosql-discussion@googlegroups.com.
> To unsubscribe from this group, send email to
> nosql-discussion+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/nosql-discussion?hl=en.
You should have a look at opentsdb (http://opentsdb.net/): a time series
database on top on hbase.
However, given the volumes you mention you could as well consider a pure
sql solution.
On Tue, May 8, 2012 at 10:17 AM, Macho Che <chewei...@gmail.com> wrote:
> we have about one hundred sensor nodes (will be added even more in the
> future) to collect the environmental parameters, such as temp, humidity and
> air concentration. The sensor nodes will send the data with a interval of
> about 10s. And we need to read the data from database to show it in our own
> system, eg. from time A to time B; from time A till now...
> I've learned cassandra and Oracle NoSQL, is there any one could give me
> some suggestions.
> Thanks a lot.
> --
> You received this message because you are subscribed to the Google Groups
> "NOSQL" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/nosql-discussion/-/tf5bysvphYoJ.
> To post to this group, send email to nosql-discussion@googlegroups.com.
> To unsubscribe from this group, send email to
> nosql-discussion+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/nosql-discussion?hl=en.
Have you considered using a SaaS like Librato Metrics<https://metrics.librato.com/>? Provides storage, visualization, dashboards, alerting, etc. for time series data "as a Service". Full disclosure: I work at Librato.
On Tuesday, May 8, 2012 1:17:29 AM UTC-7, Macho Che wrote:
> we have about one hundred sensor nodes (will be added even more in the > future) to collect the environmental parameters, such as temp, humidity and > air concentration. The sensor nodes will send the data with a interval of > about 10s. And we need to read the data from database to show it in our own > system, eg. from time A to time B; from time A till now... > I've learned cassandra and Oracle NoSQL, is there any one could give me > some suggestions. > Thanks a lot.
On Tue, May 8, 2012 at 1:17 PM, Macho Che <chewei...@gmail.com> wrote:
> we have about one hundred sensor nodes (will be added even more in the
> future) to collect the environmental parameters, such as temp, humidity
and
> air concentration. The sensor nodes will send the data with a interval of
> about 10s. And we need to read the data from database to show it in our
own
> system, eg. from time A to time B; from time A till now...
> I've learned cassandra and Oracle NoSQL, is there any one could give me
some
> suggestions.
> Thanks a lot.
> --
> You received this message because you are subscribed to the Google Groups
> "NOSQL" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/nosql-discussion/-/tf5bysvphYoJ.
> To post to this group, send email to nosql-discussion@googlegroups.com.
> To unsubscribe from this group, send email to
> nosql-discussion+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/nosql-discussion?hl=en.
Thanks, actually we don't need the database to provide visualization and alerting, we do these in our own system. Here what we most considered is the increasing dataset hour by hour, day by day, as well as the fast reading of the data.
On Thursday, May 10, 2012 5:35:03 AM UTC+8, Fred van den Bosch wrote:
> Have you considered using a SaaS like Librato Metrics<https://metrics.librato.com/>? > Provides storage, visualization, dashboards, alerting, etc. for time series > data "as a Service". Full disclosure: I work at Librato.
> Best,
> Fred
> On Tuesday, May 8, 2012 1:17:29 AM UTC-7, Macho Che wrote:
>> we have about one hundred sensor nodes (will be added even more in the >> future) to collect the environmental parameters, such as temp, humidity and >> air concentration. The sensor nodes will send the data with a interval of >> about 10s. And we need to read the data from database to show it in our own >> system, eg. from time A to time B; from time A till now... >> I've learned cassandra and Oracle NoSQL, is there any one could give me >> some suggestions. >> Thanks a lot.
On Wednesday, May 9, 2012 12:45:08 AM UTC+8, Nicolas Liochon wrote:
> Hi,
> You should have a look at opentsdb (http://opentsdb.net/): a time series > database on top on hbase. > However, given the volumes you mention you could as well consider a pure > sql solution.
> N.
> On Tue, May 8, 2012 at 10:17 AM, Macho Che <chewei...@gmail.com> wrote:
>> we have about one hundred sensor nodes (will be added even more in the >> future) to collect the environmental parameters, such as temp, humidity and >> air concentration. The sensor nodes will send the data with a interval of >> about 10s. And we need to read the data from database to show it in our own >> system, eg. from time A to time B; from time A till now... >> I've learned cassandra and Oracle NoSQL, is there any one could give me >> some suggestions. >> Thanks a lot.
>> -- >> You received this message because you are subscribed to the Google Groups >> "NOSQL" group. >> To view this discussion on the web visit >> https://groups.google.com/d/msg/nosql-discussion/-/tf5bysvphYoJ. >> To post to this group, send email to nosql-discussion@googlegroups.com. >> To unsubscribe from this group, send email to >> nosql-discussion+unsubscribe@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/nosql-discussion?hl=en.
On Wednesday, May 9, 2012 12:45:08 AM UTC+8, Nicolas Liochon wrote:
> Hi,
> You should have a look at opentsdb (http://opentsdb.net/): a time series
> database on top on hbase.
> However, given the volumes you mention you could as well consider a pure
> sql solution.
> N.
> On Tue, May 8, 2012 at 10:17 AM, Macho Che <chewei...@gmail.com> wrote:
>> we have about one hundred sensor nodes (will be added even more in the
>> future) to collect the environmental parameters, such as temp, humidity and
>> air concentration. The sensor nodes will send the data with a interval of
>> about 10s. And we need to read the data from database to show it in our own
>> system, eg. from time A to time B; from time A till now...
>> I've learned cassandra and Oracle NoSQL, is there any one could give me
>> some suggestions.
>> Thanks a lot.
>> --
>> You received this message because you are subscribed to the Google Groups
>> "NOSQL" group.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msg/nosql-discussion/-/tf5bysvphYoJ.
>> To post to this group, send email to nosql-discussion@googlegroups.com.
>> To unsubscribe from this group, send email to
>> nosql-discussion+unsubscribe@googlegroups.com.
>> For more options, visit this group at
>> http://groups.google.com/group/nosql-discussion?hl=en.
On Thursday, May 10, 2012 10:18:41 AM UTC+8, Amandeep wrote:
> What is the expected throughput and the expected volume right now and what > are your projections for the future?
> On May 9, 2012, at 7:15 PM, Macho Che <chewei...@gmail.com> wrote:
> thanks, I wonder if a pure sql solution could meet the scalability because > the data set is increasing very quickly.
> On Wednesday, May 9, 2012 12:45:08 AM UTC+8, Nicolas Liochon wrote:
>> Hi,
>> You should have a look at opentsdb (http://opentsdb.net/): a time series >> database on top on hbase. >> However, given the volumes you mention you could as well consider a pure >> sql solution.
>> N.
>> On Tue, May 8, 2012 at 10:17 AM, Macho Che <chewei...@gmail.com> wrote:
>>> we have about one hundred sensor nodes (will be added even more in the >>> future) to collect the environmental parameters, such as temp, humidity and >>> air concentration. The sensor nodes will send the data with a interval of >>> about 10s. And we need to read the data from database to show it in our own >>> system, eg. from time A to time B; from time A till now... >>> I've learned cassandra and Oracle NoSQL, is there any one could give me >>> some suggestions. >>> Thanks a lot.
>>> -- >>> You received this message because you are subscribed to the Google >>> Groups "NOSQL" group. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msg/nosql-discussion/-/tf5bysvphYoJ. >>> To post to this group, send email to nosql-discussion@googlegroups.com. >>> To unsubscribe from this group, send email to >>> nosql-discussion+unsubscribe@googlegroups.com. >>> For more options, visit this group at >>> http://groups.google.com/group/nosql-discussion?hl=en.
>> -- > You received this message because you are subscribed to the Google Groups > "NOSQL" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/nosql-discussion/-/W2Mv9Y4og8cJ. > To post to this group, send email to nosql-discussion@googlegroups.com. > To unsubscribe from this group, send email to > nosql-discussion+unsubscribe@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/nosql-discussion?hl=en.
> Thanks, actually we don't need the database to provide visualization and
> alerting, we do these in our own system. Here what we most considered is the
> increasing dataset hour by hour, day by day, as well as the fast reading of
> the data.
> On Thursday, May 10, 2012 5:35:03 AM UTC+8, Fred van den Bosch wrote:
>> Hi,
>> Have you considered using a SaaS like Librato Metrics? Provides storage,
>> visualization, dashboards, alerting, etc. for time series data "as a
>> Service". Full disclosure: I work at Librato.
>> Best,
>> Fred
>> On Tuesday, May 8, 2012 1:17:29 AM UTC-7, Macho Che wrote:
>>> we have about one hundred sensor nodes (will be added even more in the
>>> future) to collect the environmental parameters, such as temp, humidity and
>>> air concentration. The sensor nodes will send the data with a interval of
>>> about 10s. And we need to read the data from database to show it in our own
>>> system, eg. from time A to time B; from time A till now...
>>> I've learned cassandra and Oracle NoSQL, is there any one could give me
>>> some suggestions.
>>> Thanks a lot.
> --
> You received this message because you are subscribed to the Google Groups
> "NOSQL" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/nosql-discussion/-/sHltX7NPpHwJ.
> To post to this group, send email to nosql-discussion@googlegroups.com.
> To unsubscribe from this group, send email to
> nosql-discussion+unsubscribe@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/nosql-discussion?hl=en.
> On Tue, May 8, 2012 at 1:17 PM, Macho Che <chewei...@gmail.com> wrote:
> > we have about one hundred sensor nodes (will be added even more in the
> > future) to collect the environmental parameters, such as temp, humidity
> and
> > air concentration. The sensor nodes will send the data with a interval of
> > about 10s.
100 sensor, every 10s => 10 transaction / second.
Why do you bother using NoSQL ? This is a typical job for MySQL !
BTW, if you desperately want to use a NoSQL DB, you should think ease of
use : a document DB (like MongoDB) would be my choice.
