Migrating Data OUT of Isilon

[Daniel Cornel]

Hi guys,

Im an avid Isilon user and have encountered a situation where we have about 4tb worth of data to migrate to a data domain filer for archive.  Im currently using robocopy, however im running into issues with nested ACL and Linux permission structures and am wondering if theres a way to retain this information.  Since I cant access all of it via an SMB share, im wondering if theres a better way to copy data than what I am using.  Data Domain doesn't appear to have any import tools to be able to pull the data instead.  Any advice towards a solution is awesome.  Even though its only 4tb, its millions of files. Recreating the structures permissions is the only thing we cant do.

[Blake Golliher]

Not to go too off on a tangent, but dealing with a very dense number of files, almost always sucks on NFS.  I've been moving apps to rest interface, and keeping UID's in a DB.  Most applications (in my experience) rarely need POSIX, and once you shuffle off that requirement, REST interfaces are extremely attractive.

Isilons object interface might be a way to go (I don't have any production experience with it yet).

-Blake

On Tue, Sep 17, 2013 at 12:27 PM, Jerry Uanino <jua...@gmail.com> wrote:

The "millions of small files" problem!  I'm sure we'd all be curious to know what you're moving it to as well.  Many of us encounter this as well....... are you moving it to Netapp or somewhere else?  Not trying to push one solution or the other but curious.

On Tue, Sep 17, 2013 at 3:24 PM, Daniel Cornel <aqua...@hotmail.com> wrote:

Hi guys,

Im an avid Isilon user and have encountered a situation where we have about 4tb worth of data to migrate to a data domain filer for archive.  Im currently using robocopy, however im running into issues with nested ACL and Linux permission structures and am wondering if theres a way to retain this information.  Since I cant access all of it via an SMB share, im wondering if theres a better way to copy data than what I am using.  Data Domain doesn't appear to have any import tools to be able to pull the data instead.  Any advice towards a solution is awesome.  Even though its only 4tb, its millions of files. Recreating the structures permissions is the only thing we cant do.

--
You received this message because you are subscribed to the Google Groups "Isilon Technical User Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isilon-user-gr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "Isilon Technical User Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isilon-user-gr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[Trinh Tran]

There is also a tool similar to robocopy called rich copy. You many
want to take a look at that as well.
Thanks,
Trinh Tran
Enterprise Storage Services

[Daniel Cornel]

Thank you, I will take a look

You received this message because you are subscribed to a topic in the

Google Groups "Isilon Technical User Group" group.

To unsubscribe from this topic, visit
https://groups.google.com/d/topic/isilon-user-group/dBIUi_o3w0A/unsubscribe.
To unsubscribe from this group and all its topics, send an email to

[Daniel Cornel]

I suppose what im looking for is a copy utility that can initiate the copy from within the Isilon, or reset file ownership on all files and subdirectories so that we can then move the data.

[Jerry Uanino]

The "millions of small files" problem!  I'm sure we'd all be curious to know what you're moving it to as well.  Many of us encounter this as well....... are you moving it to Netapp or somewhere else?  Not trying to push one solution or the other but curious.

On Tue, Sep 17, 2013 at 3:24 PM, Daniel Cornel <aqua...@hotmail.com> wrote:

Hi guys,

Im an avid Isilon user and have encountered a situation where we have about 4tb worth of data to migrate to a data domain filer for archive.  Im currently using robocopy, however im running into issues with nested ACL and Linux permission structures and am wondering if theres a way to retain this information.  Since I cant access all of it via an SMB share, im wondering if theres a better way to copy data than what I am using.  Data Domain doesn't appear to have any import tools to be able to pull the data instead.  Any advice towards a solution is awesome.  Even though its only 4tb, its millions of files. Recreating the structures permissions is the only thing we cant do.

--

[Daniel Cornel]

Thanks Jerry,

This is going to a Data Domain for archive until it can be deleted.

 

From: isilon-u...@googlegroups.com [mailto:isilon-u...@googlegroups.com] On Behalf Of Jerry Uanino
Sent: Tuesday, September 17, 2013 1:28 PM
To: isilon-u...@googlegroups.com
Subject: Re: Isilon-Users Migrating Data OUT of Isilon

 

The "millions of small files" problem!  I'm sure we'd all be curious to know what you're moving it to as well.  Many of us encounter this as well....... are you moving it to Netapp or somewhere else?  Not trying to push one solution or the other but curious.

--
You received this message because you are subscribed to a topic in the Google Groups "Isilon Technical User Group" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/isilon-user-group/dBIUi_o3w0A/unsubscribe.
To unsubscribe from this group and all its topics, send an email to isilon-user-gr...@googlegroups.com.

[Peter Serocka]

For efficiently resetting the file ownerships,

have a look at the PermissionRepair job type (isi job start --help, or Admin/Command Manual).

 

To keep all permissions, NDMP can be used over IP (no tape nor BA

nor Isilon license needed). The "star" variant of tar also can handle ACLs.

Packing the millions of files into a decent number of tar archives

before sending to DD can help anyway (unless is breaks dedupe).

-- Peter

--
You received this message because you are subscribed to the Google Groups "Isilon Technical User Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isilon-user-gr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Peter Serocka

CAS-MPG Partner Institute for Computational Biology (PICB)

Shanghai Institutes for Biological Sciences (SIBS)

Chinese Academy of Sciences (CAS)

320 Yue Yang Rd, Shanghai 200031, China

pser...@picb.ac.cn

[Matt Dey]

A little late to the party so you might have finished this up already.  If you looking for something that you can run right on the isilon node it self rsync is actually installed on Isilon nodes. 

[Jason Davis]

Shouldn't break DD dedupe provided that you don't compress with bzip or gzip :)

[Daniel Cornel]

rsync is exactly what I was looking for.  Im building the command and will copy back some results on both robocopy and rsync.

If you have one build please feel free to send it over :)

[Dan Pritts]

rsync -av --sparse --hard-links /ifs/ other-host:/destination-path

Note that the trailing / on the source filesystem is significant.  '/ifs/' means the same thing as if you'd said '/ifs/*'; it would copy every subdir of /ifs to other-host:/destination-path.  Just '/ifs' would copy everytihng to other-host:/destination-path/ifs

-a means sync pretty much everything - ownership, permissions, contents, etc.  sparse and hard links arre not included in -a so if you need them add them - if you don't, then skip them, they may slow it down slightly.  --hard-links will definitely make rsync on the sending side use more memory, probably a lot more memory. 

You can run mutliple jobs in parallel; the more you do the harder it will hit the underlying storage on both sides.  At some point this becomes counter productive, you might want to experiment if you are trying to speed this up as musch as possible.

One thing rsync *won't* copy is windows acls.  At least, not by default; maybe if you had a windows build of rsync and rsync'd windows to windows it would work. You might run into trouble with group ownership too.  

Be aware that running rsync on the isilon cluster should be a lot faster than running it on a NAS client with the filesystem mounted.  If you need windows acls you might consider first running rsync to transfer the data and then running something on windows (robocopy or ??) to fix up the permissions.

Daniel Cornel

September 30, 2013 9:08 AM

rsync is exactly what I was looking for.  Im building the command and will copy back some results on both robocopy and rsync.

If you have one build please feel free to send it over :)

On Friday, September 27, 2013 4:27:24 PM UTC-6, Matt Dey wrote:

--
You received this message because you are subscribed to the Google Groups "Isilon Technical User Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isilon-user-gr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Dan Pritts
ICPSR Computing & Network Services
University of Michigan
+1 (734)615-7362