Initial screen taking too long to load

[Daniel Almendra]

Klaubert,

On our environment (see details on the end of this email), Waf-fle's initial screen is taking too long (over 10 minutes) to load. In mysql, I see that the query is:

SELECT COUNT( events_messages.h_message_ruleId ) AS rule_count, events_messages.h_message_ruleId AS message_ruleId FROM date_range, events JOIN events_messages ON events.event_id = events_messages.event_id   WHERE 1  AND (events.a_date = date_range.a_date)  GROUP BY events_messages.h_message_ruleId ORDER BY rule_count DESC LIMIT 0 , 10 

Its state stays on "Copying to tmp table" for many minutes. I think this query is related to the dashboard graphic "Events action over time". 

The management screen is taking a few minutes to load too.

Is there a fix for these issues on a newer version of Waf-fle? Or this may be a configuration problem on our environment?

Environment details:

WAF-FLE Version: 0.6.0

APC Cache extension: Extension Loaded, enabled for PHP and turned On in WAF-FLE

APC Cache Timeout: 30 seconds

PHP version: 5.3.3

PHP Zend Version: 2.3.0

MySQL Version: 5.1.73

Database Name: waffle

Database Size: 159.38 GB

Number of sensors: 7

Number of events on DB: 14,884,924

Thanks in advance.

Daniel

[Klaubert Herr da Silveira]

Daniel,

This is a issue when the database get bigger, like yours.
The last issue that you mention, was addressed in last version. The slow  dashboard, I hope to address in next release, but I have no solution yet. I think that I'll need to make some index, or to rewrite the query... May be you can help me in test some options...

In next days I expect to work on this...

Best regards,

Klaubert

--
You received this message because you are subscribed to the Google Groups "waf-fle" group.
To unsubscribe from this group and stop receiving emails from it, send an email to waf-fle+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Daniel Almendra]

Klaubert,

Surely, I can help you test other options. Since the dashboard date range is filtered by default to the current day, I don't understand why this query specifically is taking so long. Isn't it also filtered to the current day? I didn't understand the query quite well yet, for that I must first understand the database a bit better, but I think it should be filtered, so that the total records in the database shouldn't matter... 

Thanks again.

Daniel

[ChuSoon]

Anyone tried convert to no-sql DB?

Will it get better performance?

Sent from my iPhone

[Klaubert Herr da Silveira]

ChuSoon,

I have investigated about this, but not sure if is needed or even if is an answer...
Any way, the effort to "convert" will be huge...

Klaubert

[Klaubert Herr da Silveira]

Daniel,

The dashboard filter for the day, but to make it flexible the query currently is not doing in the best performance, is this answer the we need to find out.

Klaubert