GRA_*.log files of 1GB in size generated every 2 hours

[drakon...@gmail.com]

Hi,

I have a two node Galera cluster on dedicated servers directly connected by Ethernet cable.

For last three days, on one nodes Galera creates GRA_-.log files of 1GB approximately every 1,5-2 hours. These files would fill up empty space on drive within 2 days.

When analysing GRA log, I get nothing of sense. File start with this lines:

^[[H^[[J/*!50530 SET @@SESSION.PSEUDO_SLAVE_MODE=1*/;

/*!40019 SET @@session.max_insert_delayed_threads=0*/;

/*!50003 SET @OLD_COMPLETION_TYPE=@@COMPLETION_TYPE,COMPLETION_TYPE=0*/;

DELIMITER /*!*/;

# at 4

#140113 20:12:42 server id 3  end_log_pos 120 CRC32 0xe6f1f7fe  Start: binlog v 4, server v 5.6.15-log created 140113 20:12:42 at startup

ROLLBACK/*!*/;

BINLOG '

qjrUUg8DAAAAdAAAAHgAAAAAAAQANS42LjE1LWxvZwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA

AAAAAAAAAAAAAAAAAACqOtRSEzgNAAgAEgAEBAQEEgAAXAAEGggAAAAICAgCAAAACgoKGRkAAf73

8eY=

'/*!*/;

# at 120

#140113 20:12:43 server id 3  end_log_pos 143 CRC32 0x26e85337  Stop

# at 143

# at 198

# at 122361

# at 243307

# at 365544

# at 487720

# at 610183

# at 731254

# at 852426

# at 973691

# at 976022

# at 977672

# at 1100185

# at 1221486

...

...

and ends in similar fashion:

...

...

# at 1073147155

# at 1073269533

# at 1073390873

# at 1073513359

DELIMITER ;

# End of log file

ROLLBACK /* added by mysqlbinlog */;

/*!50003 SET COMPLETION_TYPE=@OLD_COMPLETION_TYPE*/;

/*!50530 SET @@SESSION.PSEUDO_SLAVE_MODE=0*/;

I tried yesterday to restart mysql on this node - it didn't help.

Today I performed SST transfer from other node - it didn't help.

This is mysql error log on affected node after SST transfer:

160131 16:47:55 [Note] WSREP: SST received: fecfb0b3-a600-11e4-9d0f-daca986a9906:302754409

160131 16:47:55 [Note] /usr/sbin/mysqld: ready for connections.

Version: '5.5.41-MariaDB-wsrep-log'  socket: '/var/lib/mysql/mysql.sock'  port: 3306  MariaDB Server, wsrep_25.11.r4026

160131 16:47:55 [Note] WSREP: 1.0 (rock): State transfer from 2.0 (carn) complete.

160131 16:47:55 [Note] WSREP: Shifting JOINER -> JOINED (TO: 302754472)

160131 16:47:55 [Note] WSREP: Member 1.0 (rock) synced with group.

160131 16:47:55 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 302754472)

160131 16:47:55 [Note] WSREP: Synchronized with group, ready for connections

160131 16:47:55 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.

160131 17:09:44 [Warning] WSREP: transaction size limit (1073741824) exceeded: 1073774592

160131 17:09:44 [ERROR] WSREP: rbr write fail, data_len: 0, 2

160131 17:27:29 [Warning] WSREP: transaction size limit (1073741824) exceeded: 1073774592

160131 17:27:29 [ERROR] WSREP: rbr write fail, data_len: 0, 2

160131 17:30:04 [Note] WSREP: Created page /var/lib/mysql/gcache.page.000000 of size 134217728 bytes

160131 18:05:23 [Note] WSREP: Created page /var/lib/mysql/gcache.page.000001 of size 134217728 bytes

160131 18:07:56 [Warning] WSREP: transaction size limit (1073741824) exceeded: 1073774592

160131 18:07:57 [ERROR] WSREP: rbr write fail, data_len: 0, 2

160131 18:47:17 [Note] WSREP: Created page /var/lib/mysql/gcache.page.000002 of size 134217728 bytes

160131 19:08:07 [Warning] WSREP: transaction size limit (1073741824) exceeded: 1073774592

160131 19:08:08 [ERROR] WSREP: rbr write fail, data_len: 0, 2

160131 19:14:01 [Note] WSREP: Deleted page /var/lib/mysql/gcache.page.000000

160131 19:15:35 [Note] WSREP: Created page /var/lib/mysql/gcache.page.000003 of size 134217728 bytes

160131 19:46:21 [Note] WSREP: Created page /var/lib/mysql/gcache.page.000004 of size 134217728 bytes

160131 19:55:10 [Note] WSREP: Deleted page /var/lib/mysql/gcache.page.000001

160131 20:08:08 [Warning] WSREP: transaction size limit (1073741824) exceeded: 1073774592

160131 20:08:09 [ERROR] WSREP: rbr write fail, data_len: 0, 2

160131 20:16:07 [Note] WSREP: Created page /var/lib/mysql/gcache.page.000005 of size 134217728 bytes

160131 20:22:31 [Note] WSREP: Deleted page /var/lib/mysql/gcache.page.000002

160131 20:26:43 [Warning] WSREP: transaction size limit (1073741824) exceeded: 1073774592

160131 20:26:44 [ERROR] WSREP: rbr write fail, data_len: 0, 2

160131 20:48:32 [Note] WSREP: Created page /var/lib/mysql/gcache.page.000006 of size 134217728 bytes

160131 20:52:45 [Note] WSREP: Deleted page /var/lib/mysql/gcache.page.000003

Can you please help?

[Frédéric Descamps]

Hi, 

As you can read in the log:

160131 20:26:43 [Warning] WSREP: transaction size limit (1073741824) exceeded: 1073774592

This means the transaction is bigger than then limit size defined in wsrep_max_ws_size (default 1G and can't exceed 2G).

You can delete those GRA files. 

Could you let me know the version ? (run just \s at mysql> prompt) 

Thank you

--
You received this message because you are subscribed to the Google Groups "codership" group.
To unsubscribe from this group and stop receiving emails from it, send an email to codership-tea...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.