mariadb 10.5 columstore install

[Van Dorsey]

Hi, I am probably jumping the gun here but I made it through the install of community 10.5 with the columnstore options following the instructions. It looks like all processes are running but I get the following error with this simple test. Anyone find a working recipe?

ubuntu server 18.04 following:

https://mariadb.com/docs/deploy/community-single-columnstore/#community-single-columnstore-post-install

CREATE TABLE orders (   orderkey INTEGER,    customer VARCHAR(45) ) ENGINE=ColumnStore;

causes this response:

ERROR 1815 (HY000): Internal error: CAL0009: IDB-2038: Failed to open file.  The DirectIO setting in Columnstore.xml may not be compatible with the file system.   

Van

[Todd Stoffel]

Can you try this?

sudo mcsSetConfig PrimitiveServers DirectIO "N"

sudo systemctl restart mariadb-columnstore

[Roland Noland]

This doesn't look right though b/c direct io benifits MCS io operations.

I wonder what is the filesystem you use?

Regards,

Roman

пт, 26 июн. 2020 г., 1:45 Van Dorsey <van.d...@gmail.com>:

--
You received this message because you are subscribed to the Google Groups "MariaDB ColumnStore" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mariadb-columns...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mariadb-columnstore/c763b588-0ff0-4d3e-b95c-4f9f29923aa4o%40googlegroups.com.

[Van Dorsey]

Todd,

That worked. Thank you. Any background on Why?

Roman,

Agreed. Wondering Why, The Filesystem is zfs for this test.

Van

[Jim Tommaney]

Hi Van, good to see your continued involvement.

Maybe related to version of zfs?  

https://github.com/openzfs/zfs/pull/7823

On Thursday, June 25, 2020 at 3:45:42 PM UTC-7, Van Dorsey wrote:

[Roland Noland]

Very good point indeed.

пт, 26 июн. 2020 г., 21:19 Jim Tommaney <james.t...@gmail.com>:

--
You received this message because you are subscribed to the Google Groups "MariaDB ColumnStore" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mariadb-columns...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/mariadb-columnstore/d4d557cc-5ec5-4b62-87ed-902d2fb92645o%40googlegroups.com.

[Frederick Lubbe]

Hi,

I have been working with MariaDB ColumnStore since the InfiniDB days. I tested many filesystem options and types over the last 7 years. I concluded that ext2 no journal works well but ext4 no journal or XFS no journal on a LVM (linear) works exceptionally well with the best I/O performance for the MariaDB CS PM's dbroots. 

Remember to set vfs_cache_pressure = 3 and swappiness = 5. This way column store takes most advantage of the storage subsystem whether its SSD or HDD. Took us almost 6 months to find the storage sweetspot. 

These are my experiences running a 6 node cluster (2 um's and 4 pm's) with 580TB of data. Biggest table at 18 billion rows and still run windowing aggregate queries under 10 secs on that table.

F

[Van Dorsey]

Frederick,

That is good to know. I have been here since InfiniDB as well. Jim built some good stuff here and Maria seems to be carrying on the tradition.

It looks like no more multi-node installs, at least with Community 10.5. Can anyone confirm if that is just for this version or is multi node columnstore off the roadmap for community?

Van

To view this discussion on the web visit https://groups.google.com/d/msgid/mariadb-columnstore/CA%2BQ2xBd9FJ2WkL8DMdOJdbOq9KKmxe-BbidjB9k3%3DSrEwCjX0A%40mail.gmail.com.

[Todd Stoffel]

For now multi-node is limited to the enterprise version.