Account Options

  1. Sign in
The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Google Groups Home
« Groups Home
Database / System Admin
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  5 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
James Mills  
View profile  
 More options Jul 16 2012, 7:19 am
From: James Mills <ja...@jamesmills.co.uk>
Date: Mon, 16 Jul 2012 04:19:10 -0700 (PDT)
Local: Mon, Jul 16 2012 7:19 am
Subject: Database / System Admin

Hi guys.

I am currently working with a database which has a table with over 30
million rows in it. I have a couple of stored procedures (SP) that I am
trying to run on it. We have a virtual machine setup with multiple
processors, about 8GB of RAM and loads of disk space.

When I leave the SP to run eventually it fails and I get a message along
these lines 'Incorrect key file for...'. I have done research into this and
it looks like it is connected with either the innodb_buffer_pool_size or
space running out in the temporary file system.

I have set the innodb_buffer_pool_size to 6GB in the my.cnf file but I am
not 100% its getting updated. I have also looked at altering which folder
is being used for the temporary storage. I am still getting errors. At the
moment we are using Ubuntu 64bit on a Citrix XenServer virtual machine.

I am looking to connect with someone who would do a spot of consultancy for
me (through the company I work for, Thap Ltd.). Hopefully someone who is
experienced with working with large tables and who has had to setup/adjust
server settings like this in the past.

Thanks, James


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Alistair MacDonald  
View profile  
 More options Jul 16 2012, 7:43 am
From: Alistair MacDonald <alistair.macdon...@gmail.com>
Date: Mon, 16 Jul 2012 12:43:56 +0100
Local: Mon, Jul 16 2012 7:43 am
Subject: Re: [PHPNE] Database / System Admin
This sounds like the sort of thing the Smith Electric team could help
with. They have silly sized My SQL databases they work with. Perhaps
it is worth posting on the Super Monday's list.

  Alistair

On 16 July 2012 12:19, James Mills <ja...@jamesmills.co.uk> wrote:


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
cheeryfella  
View profile  
 More options Jul 17 2012, 11:44 am
From: cheeryfella <toonmari...@gmail.com>
Date: Tue, 17 Jul 2012 08:44:18 -0700 (PDT)
Local: Tues, Jul 17 2012 11:44 am
Subject: Re: Database / System Admin

Hey James,

What storage engine you using? does the procedure work on ALL the data or
can you split it up any? What indexes are in place and does the stored prod
use fields not indexed...


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
cheeryfella  
View profile  
 More options Jul 17 2012, 11:49 am
From: cheeryfella <toonmari...@gmail.com>
Date: Tue, 17 Jul 2012 08:49:51 -0700 (PDT)
Local: Tues, Jul 17 2012 11:49 am
Subject: Re: Database / System Admin

PS.

Awesome sysadmin guy says you may have to run REPAIR TABLE to rebuild
indexes...

Try quick repair 1st otherwise a full repair - this will lock table so if
this is in the wild it won't be readable for while...


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Sam Lambert  
View profile  
 More options Jul 17 2012, 12:03 pm
From: Sam Lambert <s...@ninjapanda.co.uk>
Date: Tue, 17 Jul 2012 17:03:43 +0100
Local: Tues, Jul 17 2012 12:03 pm
Subject: Re: [PHPNE] Re: Database / System Admin

Repair table will not work on InnoDB as it is not supported.

I assume James is using InnoDB as he mentions changing the  innodb_buffer_pool_size which will only effect InnoDB tables.

If you want to rebuild an index on an InnoDB table just issue: alter table <tablename> ENGINE=InnoDB;
This will lock your table for a while though and in this case is unlikely to make a difference.

James ->  I am at phpNE tonight if you want a chat about this issue.

Also we have an irc channel now on freenode called #phpNE so if anyone needs advice etc there are some really smart people hanging out in there and Jamie.

Sam


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »