Alluxio V1.8.1 : how to set glusterfs as underfs when GlusterFS is not co-located with Alluxio node

[miang...@gmail.com]

Hi,

     We use three machines to deploy Alluxio 1.8.1 release.  now we want to configure Alluxio with GlusterFS as the under storage system.  we have checked https://www.alluxio.org/docs/1.8/en/ufs/GlusterFS.html. but we cannot find how to configure if GlusterFS is not  co-located with Alluxio nodes.   we configure alluxio-site.properties as follows:

    But after  run "./bin/alluxio-start.sh all". we cannot found the UnderFS capacity in website "master:19999/home".  we check the master.log ,we found alluxio cluster cannot found glusterfs :

    

      If GlusterFS bricks are co-located with Alluxio nodes, we configure alluxio-site.properties with "alluxio.underfs.address =/mnt", alluxio can find GlusterFS bricks.  Now,  we are wondering how to configure Glusterfs as underfs when the  GlusterFS bricks is not  co-located with Alluxio nodes.

Another question is how to make sure the all the data write to alluxio will persist in underfs like GlusterFS .

Thanks 

Kevin

[Bin Fan]

hi Kevin,

for the first question, right now Alluxio only supports to connect to GlusterFS through local mount (co-located with Alluxio nodes).

Alluxio does not have a connector to connect to remote GlusterFS currently.

Here are tutorial to develop such a connector (link)

for the second question, overwrite property key

alluxio.user.file.writetype.default=CACHE_THROUGH

to enable sync write to Alluxio & UFS.

check here https://www.alluxio.org/docs/1.8/en/basic/Configuration-Settings.html#alluxio-shell-commands

for more details.

- Bin

[Frank Yu]

Hi kevin, 

have you solve this problem by implement a new connector or just use glusterfs as co-located with alluxio node? 

I have same situations ...

[Calvin Jia]

Hi Frank,

You can take a look at the glusterfs connector in Alluxio's extensions: https://github.com/Alluxio/alluxio-extensions/tree/master/underfs/glusterfs

Hope this helps,

Calvin

[Frank Yu]

Hi Calvin

thanks, I'll take a look. 

[Haoyuan Li]

Frank, is the problem resolved?

Best regards,

Haoyuan (HY)

powered by Alluxio | alluxio.io

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to alluxio-user...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/alluxio-users/9d2f67b0-46f4-4e30-9374-b35140df809c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.