Running DIRAC pilot from CVMFS repository instead of locally extracted tar archive

[Nikolay Kutovskiy]

Dear all,,

I wonder if it's possible to run DIRAC pilot from CVMFS repository instead of locally extracted tar
archive copied from CVMFS repository?
I.e. instead of
1) copying diracos.X.tgz from CVMFS repository to local disk;
2) extracting downloaded tarball into some dir on local dir;
3) run DIRAC pilot from local dir

just run DIRAC pilot from CVMFS repository?

Best regards,
Nikolay.

[Federico Stagni]

Hi Nikolay,

TLDR: the simple answer to your question is "no, right now it's not possible".

Now, on a bit more elaborated answer: the "pilot" is a (few) script(s) whose role can be summarized in:

1) install DIRAC, or an extension of DIRAC

2) configure the DIRAC installation

3) try to match jobs, and then run them

In fact, I can make your question a bit more precise, I think it should be "can we install DIRAC (point 1 above) directly from CVMFS, without local copy"? Same answer as above of course, but it should be done, it's in fact on our radar.

Please let me know if I misunderstood you.

Cheers,

Federico

--
You received this message because you are subscribed to the Google Groups "diracgrid-forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to diracgrid-for...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/diracgrid-forum/108d6b85-ef7c-eb8d-63ac-87a868a0602a%40gmail.com.

[Nikolay Kutovskiy]

Hi Federico,

thank you for quick and informative reply!
Looking forward to have such feature in DIRAC production release then.

Best regards,
Nikolay.

Federico Stagni wrote on 22/09/2020 11:20:
> Hi Nikolay,
> TLDR: the simple answer to your question is "no, right now it's not possible".
>
> Now, on a bit more elaborated answer: the "pilot" is a (few) script(s) whose role can be summarized in:
> 1) install DIRAC, or an extension of DIRAC
> 2) configure the DIRAC installation
> 3) try to match jobs, and then run them
>
> In fact, I can make your question a bit more precise, I think it should be "can we install DIRAC
> (point 1 above) directly from CVMFS, without local copy"? Same answer as above of course, but it
> should be done, it's in fact on our radar.
> Please let me know if I misunderstood you.
>
> Cheers,
> Federico
>
>
> Il giorno mar 22 set 2020 alle ore 09:00 Nikolay Kutovskiy <nikolay....@gmail.com

> <mailto:nikolay....@gmail.com>> ha scritto:

>
> Dear all,,
>
> I wonder if it's possible to run DIRAC pilot from CVMFS repository instead of locally extracted tar
> archive copied from CVMFS repository?
> I.e. instead of
> 1) copying diracos.X.tgz from CVMFS repository to local disk;
> 2) extracting downloaded tarball into some dir on local dir;
> 3) run DIRAC pilot from local dir
>
> just run DIRAC pilot from CVMFS repository?
>
> Best regards,
> Nikolay.
>
> --
> You received this message because you are subscribed to the Google Groups "diracgrid-forum" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> diracgrid-for...@googlegroups.com

> <mailto:diracgrid-forum%2Bunsu...@googlegroups.com>.

> To view this discussion on the web visit
> https://groups.google.com/d/msgid/diracgrid-forum/108d6b85-ef7c-eb8d-63ac-87a868a0602a%40gmail.com.
>

> --
> You received this message because you are subscribed to the Google Groups "diracgrid-forum" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to

> diracgrid-for...@googlegroups.com <mailto:diracgrid-for...@googlegroups.com>.

> To view this discussion on the web visit

> https://groups.google.com/d/msgid/diracgrid-forum/CAPaK5JkLgw3XHUhQYQvTYVxipfYXxO7KXRbvtPvT%3DRbUxPE-vA%40mail.gmail.com
> <https://groups.google.com/d/msgid/diracgrid-forum/CAPaK5JkLgw3XHUhQYQvTYVxipfYXxO7KXRbvtPvT%3DRbUxPE-vA%40mail.gmail.com?utm_medium=email&utm_source=footer>.

[Nikita Balashov]

If I get it right, the issue in question is about distributing DIRACOS for the jobs, which gets extracted from the tarball by each of the job arriving at the node and creating excessive and probably unneeded load. And the suggestion is to just extract the DIRACOS tarball and ship this extracted content directly in a cvmfs repo while the installation script would just set the proper environment variables pointing to the DIRACOS inside that cvmfs repo, so all installation is just simplified to configuration. Is there any progress on the issue?

Thanks,

Nikita

вторник, 22 сентября 2020 г. в 13:11:25 UTC+3, nikolay....@gmail.com:

[Chris Burr]

Hi Nikita,

There is an GitHub issue about adding this functionality (though it hasn’t yet seen any activity):

https://github.com/DIRACGrid/Pilot/issues/166

Cheers,

Chris

To unsubscribe from this group and stop receiving emails from it, send an email to diracgrid-for...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/diracgrid-forum/8f758341-1efd-4caa-8401-867d98222655n%40googlegroups.com.