Migration from Isilon to netapp

908 views
Skip to first unread message

SRK

unread,
Oct 28, 2020, 6:18:34 AM10/28/20
to Isilon Technical User Group
Can someone suggest me a best tool for migrate/copying the data from isilon to netapp (cluster mode) ?  Thanks in advance.

SRK

unread,
Oct 28, 2020, 6:28:21 AM10/28/20
to Isilon Technical User Group
it's NFS file system planning to migrate.

John Beranek - PA

unread,
Oct 28, 2020, 7:35:56 AM10/28/20
to Isilon Technical User Group
You could try isi_vol_copy but when we looked at it we ended up not using it as it couldn't do a "delta" sync, only incrementals.


Cheers,

John

John Beranek - PA

unread,
Oct 28, 2020, 7:40:13 AM10/28/20
to Isilon Technical User Group
Just realised you said Isilon->NetApp and not NetApp->Isilon. Can't say I've ever looked at it in that direction.

John

On Wednesday, 28 October 2020 at 10:28:21 UTC SRK wrote:

Paul Carrington

unread,
Oct 28, 2020, 7:41:43 AM10/28/20
to isilon-u...@googlegroups.com
I think rsync would be my tool of choice in this situation

--
You received this message because you are subscribed to the Google Groups "Isilon Technical User Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isilon-user-gr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/isilon-user-group/5187d857-2031-423d-bb0b-bc2709700b2dn%40googlegroups.com.

Anubhav Ahuja

unread,
Oct 28, 2020, 7:53:35 AM10/28/20
to isilon-u...@googlegroups.com
Dobiminer, but it is a licensed tool. 

--
You received this message because you are subscribed to the Google Groups "Isilon Technical User Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isilon-user-gr...@googlegroups.com.
--
Thanks and Regards
Anubhav Ahuja

Steven Kreuzer

unread,
Oct 28, 2020, 8:42:22 AM10/28/20
to isilon-u...@googlegroups.com
Take a look at XCP from NetApp. The software is free but requires you get a license from NetApp.


On Wed, Oct 28, 2020 at 6:18 AM SRK <sikri...@gmail.com> wrote:
Can someone suggest me a best tool for migrate/copying the data from isilon to netapp (cluster mode) ?  Thanks in advance.

--
You received this message because you are subscribed to the Google Groups "Isilon Technical User Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isilon-user-gr...@googlegroups.com.

Anurag Chandra

unread,
Oct 28, 2020, 9:50:43 AM10/28/20
to isilon-u...@googlegroups.com
Sad to see you move , did you have issues with Isilon or got a better deal with Netapp ?

Skylar Thompson

unread,
Oct 28, 2020, 11:00:22 AM10/28/20
to isilon-u...@googlegroups.com
Agreed, when we went Isilon->DDN/GPFS we used multiple rsync's running in
parallel. It took a while (had a few PB and ~350 million files) but got the
job done.
> > <https://groups.google.com/d/msgid/isilon-user-group/5187d857-2031-423d-bb0b-bc2709700b2dn%40googlegroups.com?utm_medium=email&utm_source=footer>
> > .
> >
>
> --
> You received this message because you are subscribed to the Google Groups "Isilon Technical User Group" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to isilon-user-gr...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/isilon-user-group/CALmzHC-v2m%2BkgOFvhvp%2BOGuROcNc4G78GqhW9DR5kXO1EcdSmQ%40mail.gmail.com.

--
Skylar

Saker Klippsten

unread,
Oct 28, 2020, 11:04:10 AM10/28/20
to isilon-u...@googlegroups.com
Check out this Chris Park who used to work for us created this. 



He also created Diskover which is a great way to manage and understand what is eating up your storage 




-S

On Oct 28, 2020, at 8:00 AM, Skylar Thompson <skylar....@gmail.com> wrote:

Agreed, when we went Isilon->DDN/GPFS we used multiple rsync's running in

Dan Pritts

unread,
Oct 28, 2020, 1:24:30 PM10/28/20
to isilon-u...@googlegroups.com
Yes, as long as you have standard *nix permissions (not using ACLs),
rsync is definitely the tool of choice.

As Skylar mentions you'll want to split things into subsets, since rsync
only runs through files serially.

should you ever have to do this with windows, robocopy is very robust
and the tool of choice. I think i like it better overall than rsync -
which is saying something.

Dan Pritts
ICPSR Computing & Network Services
> https://groups.google.com/d/msgid/isilon-user-group/20201028150016.segpor5kkymcwb6n%40arda.dhs.org.

SRK

unread,
Oct 28, 2020, 3:01:36 PM10/28/20
to Isilon Technical User Group
Thanks All for your suggestions and inputs.



I tried to use XCP, Since its live file system..during the copying getting read error out on recently modified files.
Anyone know how to over come this.

Steven Kreuzer

unread,
Oct 28, 2020, 4:09:08 PM10/28/20
to isilon-u...@googlegroups.com
Regardless of the tool you use, you may want to consider doing your syncs from a snapshot of the filesystem. If you have a large number of files and/or a high rate of change you are going to run into a bunch of issues like this.

Siva SRK

unread,
Oct 28, 2020, 4:35:37 PM10/28/20
to isilon-u...@googlegroups.com
Thanks Steven for the info, I got it and tried the sync from a isilon export snapshot. Got below error.
Have you seen this ?  I never mount a snapshot from isilon or do it need give permission to this path "/ifs/data/binary/.snapshot/binary_oct28"

command:
xcp copy -newid od_snapshot binary-host.xyz.com:/ifs/data/binary/.snapshot/binary_oct28  binary-host-new.xyz.com:/binary/binary
Error:
xcp: ERROR: mnt3 MOUNT binary-host.xyz.com tcp 300 mnt3 c0 '/ifs/data/binary/.snapshot/binary_oct28': mnt3 error 13: permission denied

Paul Carrington

unread,
Oct 28, 2020, 7:18:45 PM10/28/20
to isilon-u...@googlegroups.com
I've done a LOT of migrations (the other way, from netapp to isilon) and we just used rsync from the isilon end, specifying the source address as the full rsync path to the netapp, something like:


stg00040-1# rsync --verbose -r -a <FULL SOURCE PATH>  "<USERNAME ON DESTINATION DEVICE>@<FQDN OF DESTINATION DEVICE>:<FULL DESTINATION PATH>"  

I regularly use this to recover files from our secondary cluster when a recovery needs something that is no longer retained on the primary clusters snapshots.

So if you are on a cluster called 'SivaCluster' and you want to copy data from a folder '/ifs/important' to a netapp called 'SivaNetapp' using the root account for authentication to a destination like '/vol/Important' then you would want something like this:


SivaCluster-22# rsync --verbose -r -a /ifs/important  "ro...@SivaNetapp.Sivascompany.com:/vol/Important"

Its been a while since I used Netapp so the destination paths are no doubt different now.    

On the netapp you'd need to configure ssh to allow whichever isilon nodes need to connect. From memory its set options.ssh something or other - as I said its been years since i touched netapp.

Steven Kreuzer

unread,
Oct 28, 2020, 8:18:55 PM10/28/20
to isilon-u...@googlegroups.com
I assume you are running xcp as root? If so, does the export on the isilon have norootsquash set for the host you are running from?

It has been a while since I have worked with onefs, but I believe there is an option to hide the .snapshot directory from the client. Check to make sure that is not set

SRK

unread,
Oct 28, 2020, 9:19:11 PM10/28/20
to Isilon Technical User Group
Hi Paul,

Thanks for the information about Rsync,and I never used it before. Can you please let me know how RSYNC will handle the live file system "change of rate is high" ? 

SRK

unread,
Oct 28, 2020, 9:22:06 PM10/28/20
to Isilon Technical User Group
Hi Steven, The issue resolved with enabled the export level setting to all directories underneath the mount. "--all-dirs=true"

here is the setting 

isi nfs exports create --path=/ifs/old_mount  --all-dirs=true

Thanks

Jean-Baptiste Denis

unread,
Oct 29, 2020, 9:26:29 AM10/29/20
to isilon-u...@googlegroups.com
Hi,

You can also check fpart/fpsync (https://github.com/martymac/fpart) which have been battle tested by quite a lot of
people (look at the "They use Fpart or talk about it" section). You can view it as an efficient wrapper around multiple
rsync processes. It has been packaged by quite a few distributions.

Shameless plug, I wrote msrsync (https://github.com/jbd/msrsync/) as an exercise which rely only on python 2.6+ and
rsync (so that I can run it easily on RHEL6+ boxes). I would say it's less robust than fpart/fpsync but could do the job
for you.

Good luck with your migration.

Jean-Baptiste

On 10/29/20 2:22 AM, SRK wrote:
> Hi Steven, The issue resolved with enabled the export level setting to all directories underneath the mount.
> "--all-dirs=true"
>
> here is the setting
>
> isi nfs exports create --path=/ifs/old_mount  --all-dirs=true
>
> Thanks
> On Wednesday, October 28, 2020 at 5:18:55 PM UTC-7 Steven Kreuzer wrote:
>
> I assume you are running xcp as root? If so, does the export on the isilon have norootsquash set for the host you
> are running from?
>
> It has been a while since I have worked with onefs, but I believe there is an option to hide the .snapshot
> directory from the client. Check to make sure that is not set
>
> On Wed, Oct 28, 2020 at 4:35 PM Siva SRK <sikri...@gmail.com> wrote:
>
> Thanks Steven for the info, I got it and tried the sync from a isilon export snapshot. Got below error.
> Have you seen this ?  I never mount a snapshot from isilon or do it need give permission to this path
> "/ifs/data/binary/.snapshot/binary_oct28"
>
> *command:*
>
> xcp copy -newid od_snapshot binary-host.xyz.com
> <https://urldefense.com/v3/__http://binary-host.xyz.com__;!!JFdNOqOXpB6UZW0!6znU_vC_S9IS70t0Ymp9g5mLUH72v9PZsREeVGdwT-fja0JfZhKW-05l22pwG54m$>:/ifs/data/binary/.snapshot/binary_oct28
> binary-host-new.xyz.com
> <https://urldefense.com/v3/__http://binary-host-new.xyz.com__;!!JFdNOqOXpB6UZW0!6znU_vC_S9IS70t0Ymp9g5mLUH72v9PZsREeVGdwT-fja0JfZhKW-05l29r3JFWm$>:/binary/binary
>
> *Error:*
>
> xcp: ERROR: mnt3 MOUNT binary-host.xyz.com
> <https://urldefense.com/v3/__http://binary-host.xyz.com__;!!JFdNOqOXpB6UZW0!6znU_vC_S9IS70t0Ymp9g5mLUH72v9PZsREeVGdwT-fja0JfZhKW-05l22pwG54m$>
> tcp 300 mnt3 c0 '/ifs/data/binary/.snapshot/binary_oct28': mnt3 error 13: permission denied
>
>
> On Wed, Oct 28, 2020 at 1:09 PM Steven Kreuzer <skre...@freebsd.org> wrote:
>
> Regardless of the tool you use, you may want to consider doing your syncs from a snapshot of the filesystem.
> If you have a large number of files and/or a high rate of change you are going to run into a bunch of issues
> like this.
>
> On Wed, Oct 28, 2020 at 3:01 PM SRK <sikri...@gmail.com> wrote:
>
> Thanks All for your suggestions and inputs.
>
>
>
> I tried to use XCP, Since its live file system..during the copying getting read error out on recently
> modified files.
> Anyone know how to over come this.
>
> On Wednesday, October 28, 2020 at 5:42:22 AM UTC-7 Steven Kreuzer wrote:
>
> Take a look at XCP from NetApp. The software is free but requires you get a license from NetApp.
>
> https://xcp.netapp.com/
> <https://urldefense.com/v3/__https://xcp.netapp.com/__;!!JFdNOqOXpB6UZW0!6znU_vC_S9IS70t0Ymp9g5mLUH72v9PZsREeVGdwT-fja0JfZhKW-05l2yOFvTqr$>
>
> On Wed, Oct 28, 2020 at 6:18 AM SRK <sikri...@gmail.com> wrote:
>
> Can someone suggest me a best tool for migrate/copying the data from isilon to netapp (cluster
> mode) ?  Thanks in advance.
>
> --
>
> You received this message because you are subscribed to the Google Groups "Isilon Technical User
> Group" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> isilon-user-gr...@googlegroups.com.
>
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/isilon-user-group/8e068dd3-fa89-4fd0-a0db-aa6415fc9937n%40googlegroups.com
> <https://urldefense.com/v3/__https://groups.google.com/d/msgid/isilon-user-group/8e068dd3-fa89-4fd0-a0db-aa6415fc9937n*40googlegroups.com?utm_medium=email&utm_source=footer__;JQ!!JFdNOqOXpB6UZW0!6znU_vC_S9IS70t0Ymp9g5mLUH72v9PZsREeVGdwT-fja0JfZhKW-05l23Lx7b0s$>.
>
> --
> You received this message because you are subscribed to the Google Groups "Isilon Technical User Group"
> group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> isilon-user-gr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/isilon-user-group/8c139495-803c-4a19-b94e-72399dfeab47n%40googlegroups.com
> <https://urldefense.com/v3/__https://groups.google.com/d/msgid/isilon-user-group/8c139495-803c-4a19-b94e-72399dfeab47n*40googlegroups.com?utm_medium=email&utm_source=footer__;JQ!!JFdNOqOXpB6UZW0!6znU_vC_S9IS70t0Ymp9g5mLUH72v9PZsREeVGdwT-fja0JfZhKW-05l27PJqbsp$>.
>
> --
> You received this message because you are subscribed to the Google Groups "Isilon Technical User Group" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> isilon-user-gr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/isilon-user-group/CAFFB%2BpRMqmXEqx2G%3DNS3uJLNdUW%2BvBOrXLgp%2BnqSK5rCcc0M2A%40mail.gmail.com
> <https://urldefense.com/v3/__https://groups.google.com/d/msgid/isilon-user-group/CAFFB*2BpRMqmXEqx2G*3DNS3uJLNdUW*2BvBOrXLgp*2BnqSK5rCcc0M2A*40mail.gmail.com?utm_medium=email&utm_source=footer__;JSUlJSU!!JFdNOqOXpB6UZW0!6znU_vC_S9IS70t0Ymp9g5mLUH72v9PZsREeVGdwT-fja0JfZhKW-05l22Ilf-ku$>.
>
> --
> You received this message because you are subscribed to the Google Groups "Isilon Technical User Group" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> isilon-user-gr...@googlegroups.com.
>
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/isilon-user-group/CA%2BEY2NR1Wd6ZP-rX7zNYdZW6_FBKukNdAhRhCER1O0BLxVhz2w%40mail.gmail.com
> <https://urldefense.com/v3/__https://groups.google.com/d/msgid/isilon-user-group/CA*2BEY2NR1Wd6ZP-rX7zNYdZW6_FBKukNdAhRhCER1O0BLxVhz2w*40mail.gmail.com?utm_medium=email&utm_source=footer__;JSU!!JFdNOqOXpB6UZW0!6znU_vC_S9IS70t0Ymp9g5mLUH72v9PZsREeVGdwT-fja0JfZhKW-05l20cfKK9r$>.
>
> --
> You received this message because you are subscribed to the Google Groups "Isilon Technical User Group" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> isilon-user-gr...@googlegroups.com <mailto:isilon-user-gr...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/isilon-user-group/c54bee7e-f297-46ae-adfb-725e0391b4aan%40googlegroups.com
> <https://urldefense.com/v3/__https://groups.google.com/d/msgid/isilon-user-group/c54bee7e-f297-46ae-adfb-725e0391b4aan*40googlegroups.com?utm_medium=email&utm_source=footer__;JQ!!JFdNOqOXpB6UZW0!6znU_vC_S9IS70t0Ymp9g5mLUH72v9PZsREeVGdwT-fja0JfZhKW-05l20aAHHED$>.

Reply all
Reply to author
Forward
0 new messages