Account Options

  1. Sign in
The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Google Groups Home
« Groups Home
XtraDB Cluster and long running Business Intelligence queries
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  6 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
Alejandro Recarey  
View profile  
 More options Sep 11 2012, 11:01 am
From: Alejandro Recarey <alexreca...@gmail.com>
Date: Tue, 11 Sep 2012 08:01:13 -0700 (PDT)
Local: Tues, Sep 11 2012 11:01 am
Subject: XtraDB Cluster and long running Business Intelligence queries

Thanks for the release of XtraDB Cluster, it really hits the sweetspot for
a lot of aplications like mine, where High Availability and data
consistency are very important, and the amount of data is not huge.

I am planning on migrating my companies infrastructure to an XtraDB cluster
architecture, but have a question on how best to deal with heavy and long
running Business Intelligence queries. If I have a 3 node cluster, three
options come to mind.

1) Create a 3 node XtraDB cluster. With HA proxy, distribute all queries to
all nodes. However, a BI query might tie up a node, and then that node
would exhibit increased latency when answering more importante OLTP queries.

2) Create a 3 node XtraDB cluster. With HA proxy, distribute OLTP queries
to 2 nodes and have the third only take BI queries. However, as the
replication is synchronous, won't this slow down the masters if tables are
blocked and the cluster commit takes time?

3) The other idea is to have a 2 node cluster, and a third node with
normal, asynchronous MySQL replication and a cluster arbiter to simulate a
third node. In this case, if the third node has only BI queries and it is
blocked, it will not affect the galera cluster, and BI queries and data can
lag behind the production servers without a real issue. However, it does
seem to have some extra management and headaches.

Are my assumptions correct? Any recommendations on what strategy to use?


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Justin Swanhart  
View profile  
 More options Sep 11 2012, 1:56 pm
From: Justin Swanhart <greenl...@gmail.com>
Date: Tue, 11 Sep 2012 10:56:47 -0700
Local: Tues, Sep 11 2012 1:56 pm
Subject: Re: XtraDB Cluster and long running Business Intelligence queries
Hi,

As long as you are using InnoDB tables, then readers won't block
writers, that is, writes on node A won't be blocked by reads on node
A, B or C.

I'd suggest that you use a three node cluster, use HA proxy to direct
OLTP read/writes to one or two nodes and BI requests to the third
node.  The BI workload likely has a different working set from the
OLTP workload, which is why I suggest you send BI queries to a
dedicated node.

--Justin

On Tue, Sep 11, 2012 at 8:01 AM, Alejandro Recarey


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Jay Janssen  
View profile  
 More options Sep 11 2012, 2:07 pm
From: Jay Janssen <jay.jans...@percona.com>
Date: Tue, 11 Sep 2012 14:07:35 -0400
Local: Tues, Sep 11 2012 2:07 pm
Subject: Re: XtraDB Cluster and long running Business Intelligence queries

My only concern would be long running queries on the third node gathering enough row locks to trigger the situation described here:  http://www.mysqlperformanceblog.com/2012/08/17/percona-xtradb-cluster...

On Sep 11, 2012, at 1:56 PM, Justin Swanhart <greenl...@gmail.com> wrote:

> As long as you are using InnoDB tables, then readers won't block
> writers, that is, writes on node A won't be blocked by reads on node
> A, B or C.

> I'd suggest that you use a three node cluster, use HA proxy to direct
> OLTP read/writes to one or two nodes and BI requests to the third
> node.  The BI workload likely has a different working set from the
> OLTP workload, which is why I suggest you send BI queries to a
> dedicated node.

> --Justin

Jay Janssen, Senior MySQL Consultant, Percona Inc.
http://about.me/jay.janssen
Percona Live in NYC Oct 1-2nd: http://www.percona.com/live/nyc-2012/

 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Danillo Souza  
View profile  
 More options Sep 12 2012, 8:40 am
From: Danillo Souza <danillo...@gmail.com>
Date: Wed, 12 Sep 2012 09:40:18 -0300
Local: Wed, Sep 12 2012 8:40 am
Subject: Re: XtraDB Cluster and long running Business Intelligence queries
Alejandro,

have you tried to use columnar database for BI propose?

I think you gonna get a better performance with it.

Danillo Souza

2012/9/11 Jay Janssen <jay.jans...@percona.com>:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Alejandro Recarey  
View profile  
 More options Sep 13 2012, 5:08 pm
From: Alejandro Recarey <a...@cyberfonica.com>
Date: Thu, 13 Sep 2012 14:08:20 -0700 (PDT)
Local: Thurs, Sep 13 2012 5:08 pm
Subject: Re: XtraDB Cluster and long running Business Intelligence queries

Thanks for the replies guys!

Justin, thanks for the advice.

Jay, thanks for pointing that blog post, definitely good reading, I think I
can get around those issues.

Danilo, while I am familiar with and use some NoSQL solutions, neither my
query load or my stored data is large enough lo make the extra investment
in maintenence worth it. MySQL should meet my needs.


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Danillo Souza  
View profile  
 More options Sep 13 2012, 9:39 pm
From: Danillo Souza <danillo...@gmail.com>
Date: Thu, 13 Sep 2012 22:39:36 -0300
Local: Thurs, Sep 13 2012 9:39 pm
Subject: Re: XtraDB Cluster and long running Business Intelligence queries
Hi Alejandro,

I meant InfiniDB, for example, It's free as far as you application is
small, It's MySQL with MySQL's syntax =]

I'm saying that because I had the same problem as yours, and the
easiest and faster way to solve it, was InfiniDB, you should try It.

Danillo Souza

2012/9/13 Alejandro Recarey <a...@cyberfonica.com>:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »