network access from projects

[William Stein]

Hi,

Unfortunately, due to malicious abuse of resources, most access *to*
the outside internet *from* a SageMathCloud projects will soon be
removed. This will restrict what is possible using SMC (e.g., wget
from a terminal, downloading files from the web, etc.). We will
have a very small whitelist, which may be the following:

- github
- bitbucket
- dropbox

If there is anything else you desperately need on such a whitelist,
let me know and we'll consider it.

Note: this is not at all a should-we or should-we-not discussion --
this is the way it will be.

Similar remarks apply to sagenb.org, the sage cell server, etc.

At some point later this summer, there will be another setting under
"quota", which will allow for more general network access for specific
projects (which I'll have to initially manually enable on a
per-project basis).

-- William


--
William Stein
Professor of Mathematics
University of Washington
http://wstein.org

[William Stein]

Is there a way to create a local mirror of all of pypi?

On Jun 19, 2014 11:43 AM, "Volker Braun" <vbrau...@gmail.com> wrote:

Just to point out the obvious, this will reduce the usefulness of "pip". Most, but not all, pip-installable packages are hosted on *.python.org.

--
You received this message because you are subscribed to the Google Groups "sage-devel" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sage-devel+...@googlegroups.com.
To post to this group, send email to sage-...@googlegroups.com.
Visit this group at http://groups.google.com/group/sage-devel.
For more options, visit https://groups.google.com/d/optout.

[William Stein]

On Thu, Jun 19, 2014 at 10:56 AM, William Stein <wst...@gmail.com> wrote:
> Hi,
>
> Unfortunately, due to malicious abuse of resources, most access *to*
> the outside internet *from* a SageMathCloud projects will soon be
> removed. This will restrict what is possible using SMC (e.g., wget

This block should now be in effect.

William

[Jorge A. Alfaro-Murillo]

William Stein <wst...@gmail.com> writes:

> Is there a way to create a local mirror of all of pypi?

Maybe with bandersnatch?

https://pypi.python.org/pypi/bandersnatch

Best,

Jorge.

[R. Andrew Ohana]

Some observations from this change:

1) The "From Internet" button in the +New tab is right now a complete lie, and gives un-user friendly error messages. Either you should remove this button (for now), or somehow make it bypass the whitelist.

2) You cannot ssh out (nor use any services that rely on ssh tunnels, e.g. sshfs).

3) It seems like only some of *.sagemath.org is whitelisted: you can download packages, but you cannot interact with the repository at git.sagemath.org.
3b) Because of 2, you cannot contribute to sage development.

4) It makes working on the distribution part of sage (whether reviewing, or upgrading packages) pretty much impossible at the moment.

At the very least 1 and 3 should be fixed ASAP (and not wait for this vague "quota" thing).

On Thu, Jun 19, 2014 at 10:56 AM, William Stein <wst...@gmail.com> wrote:

--
You received this message because you are subscribed to the Google Groups "sage-cloud" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sage-cloud+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/sage-cloud/CACLE5GABnqCSafd%3DmwDAkaKy18UepqxHnvnnQHJA77A5AgPYQg%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

--

Andrew

[William Stein]

On Thu, Jun 19, 2014 at 6:02 PM, R. Andrew Ohana <andrew...@gmail.com> wrote:
> Some observations from this change:
>
> 1) The "From Internet" button in the +New tab is right now a complete lie,
> and gives un-user friendly error messages. Either you should remove this
> button (for now), or somehow make it bypass the whitelist.
> 2) You cannot ssh out (nor use any services that rely on ssh tunnels, e.g.
> sshfs).
> 3) It seems like only some of *.sagemath.org is whitelisted: you can
> download packages, but you cannot interact with the repository at
> git.sagemath.org.
> 3b) Because of 2, you cannot contribute to sage development.
> 4) It makes working on the distribution part of sage (whether reviewing, or
> upgrading packages) pretty much impossible at the moment.

I've updated the whitelist to allow connections to git.sagemath.org,
so sage dev should be possible again.

-- William

> "sage-devel" group.

> To unsubscribe from this group and stop receiving emails from it, send an

> email to sage-devel+...@googlegroups.com.
> To post to this group, send email to sage-...@googlegroups.com.
> Visit this group at http://groups.google.com/group/sage-devel.
>

> For more options, visit https://groups.google.com/d/optout.



--

[Craig E Larson]

hi,

can you add washington.edu to the whitelist?

i use local copies of sage in my projects so i can add my own packages. i download them from:

http://boxen.math.washington.edu/home/sagemath/sage-mirror/linux/64bit/

thanks,

craig

[William Stein]

On Sun, Jun 22, 2014 at 1:26 AM, Craig E Larson <cla...@vcu.edu> wrote:
> hi,
>
> can you add washington.edu to the whitelist?

No.

> i use local copies of sage in my projects so i can add my own packages. i
> download them from:
>
> http://boxen.math.washington.edu/home/sagemath/sage-mirror/linux/64bit/

However, I've added boxen.math.washington.edu, so you can download
from the above url.

William

>
>
> thanks,
>
> craig

>
> --
> You received this message because you are subscribed to the Google Groups
> "sage-cloud" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to sage-cloud+...@googlegroups.com.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/sage-cloud/cb7ed634-1039-4e7d-8d1b-48891c9d1585%40googlegroups.com.

>
> For more options, visit https://groups.google.com/d/optout.

[Андрей Ширшов]

William, It seems for me white list should be placed on SMC site. For example in help page.

воскресенье, 22 июня 2014 г., 22:19:54 UTC+4 пользователь William Stein написал:

[Théo Zimmermann]

Hi,

Since it is now impossible to ssh from a project to a server we have access to, would it be possible, at least, to make the converse (ssh into a project) possible?

It was very convenient for me to be able to write some code on SageMathCloud and transmit it with scp to the server where it would be used.

Thanks,

[William Stein]

On Sat, Jun 28, 2014 at 2:32 PM, Théo Zimmermann <theo...@free.fr> wrote:
> Hi,
>
> Since it is now impossible to ssh from a project to a server we have access
> to, would it be possible, at least, to make the converse (ssh into a
> project) possible?

No, not at present.

> It was very convenient for me to be able to write some code on SageMathCloud
> and transmit it with scp to the server where it would be used.

We've now implemented the ability to make specific projects have
outgoing network access again.
Right now, this is done manually. If you send me a project id and
assertion that you won't use the
project for attacking other computers, then I can re-enable network
access for that project.

-- William

> --
> You received this message because you are subscribed to the Google Groups
> "sage-cloud" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to sage-cloud+...@googlegroups.com.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/sage-cloud/ab0e7dd2-4007-49ab-acc2-61785d3a92cb%40googlegroups.com.

>
> For more options, visit https://groups.google.com/d/optout.

[Théo Zimmermann]

Thanks for the answer.

My projects 7cb9baed-597d-452c-8846-5cc33d407d10 and 04e6d707-1809-4237-b5ac-521e97fb50ca would really benefit having network access again. At least towards cs.utexas.edu and tacc.utexas.edu. This won't be used for attacking other computers.

Le jeudi 19 juin 2014 19:57:04 UTC+2, William Stein a écrit :

[William Stein]

On Sat, Jun 28, 2014 at 2:55 PM, Théo Zimmermann <theo...@free.fr> wrote:
> Thanks for the answer.
> My projects 7cb9baed-597d-452c-8846-5cc33d407d10 and
> 04e6d707-1809-4237-b5ac-521e97fb50ca would really benefit having network
> access again. At least towards cs.utexas.edu and tacc.utexas.edu. This won't
> be used for attacking other computers.
>

Done -- both should now have full network access.

> --
> You received this message because you are subscribed to the Google Groups
> "sage-cloud" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to sage-cloud+...@googlegroups.com.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/sage-cloud/92c281cf-6ab2-4057-88f8-86c3e89ce965%40googlegroups.com.

>
> For more options, visit https://groups.google.com/d/optout.

[Ondřej Čertík]

Hi William,

Do you think you could enable a network access to my project:

b1cc51a6-c4a2-4281-98b4-a5c2b1dea21b


I won't attack any computers or misuse the account. I want to use the
account to test Hashdist, which downloads packages from the internet
(currently), specifically this PR from Volker Braun:

https://github.com/hashdist/hashdist/pull/262

Many thanks,
Ondrej

> To view this discussion on the web visit https://groups.google.com/d/msgid/sage-cloud/CACLE5GCq9Gr9SYceMPpGsVPAQfuHMMr_V%2Bdtixe37AbfQNnE8g%40mail.gmail.com.

[William Stein]

On Mon, Jun 30, 2014 at 12:06 PM, Ondřej Čertík <ondrej...@gmail.com> wrote:
> Hi William,
>
> Do you think you could enable a network access to my project:
>
> b1cc51a6-c4a2-4281-98b4-a5c2b1dea21b
>
>
> I won't attack any computers or misuse the account. I want to use the
> account to test Hashdist, which downloads packages from the internet
> (currently), specifically this PR from Volker Braun:
>
> https://github.com/hashdist/hashdist/pull/262

Done!

> To view this discussion on the web visit https://groups.google.com/d/msgid/sage-cloud/CADDwiVCB4J3b1k803qjVcLBE_kB8ijH8E0O16-%2BfbmVMf8XpJg%40mail.gmail.com.

[Ondřej Čertík]

On Mon, Jun 30, 2014 at 2:16 PM, William Stein <wst...@gmail.com> wrote:
> On Mon, Jun 30, 2014 at 12:06 PM, Ondřej Čertík <ondrej...@gmail.com> wrote:
>> Hi William,
>>
>> Do you think you could enable a network access to my project:
>>
>> b1cc51a6-c4a2-4281-98b4-a5c2b1dea21b
>>
>>
>> I won't attack any computers or misuse the account. I want to use the
>> account to test Hashdist, which downloads packages from the internet
>> (currently), specifically this PR from Volker Braun:
>>
>> https://github.com/hashdist/hashdist/pull/262
>
> Done!

It works, thanks!

Ondrej

[Morteza Milani]

Hi William,

Do you think you can enable network access for my project with id "eda0377d-48b9-456f-8ddf-b8add11febf6" ?

I work on protein structures and I usually need to download protein data files from rcsb.org. They are small files not more than a couple of megabytes.

Thank you.

[William Stein]

On Mon, Jun 30, 2014 at 10:18 PM, Morteza Milani <firebo...@gmail.com> wrote:
> Hi William,
>
> Do you think you can enable network access for my project with id "eda0377d-48b9-456f-8ddf-b8add11febf6" ?

Done.

> I work on protein structures and I usually need to download protein data files from rcsb.org.

Cool.

> --
> You received this message because you are subscribed to the Google Groups "sage-cloud" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to sage-cloud+...@googlegroups.com.

> To view this discussion on the web visit https://groups.google.com/d/msgid/sage-cloud/f291e1e3-ecec-4844-82ef-8d691cc88a54%40googlegroups.com.

> For more options, visit https://groups.google.com/d/optout.

[William Stein]

On Thu, Jul 3, 2014 at 6:51 AM, Emmanuel Charpentier
<emanuel.c...@gmail.com> wrote:
> Some access to CRAN might be useful to statisticians misguided enough to use
> sage from their accounts ? Alternative : az local CRAN mirror (but that's
> large and unwidely...).

Can you send me a specific hostname or hostnames?

>
> For biologists : genome/proteome banks ?
>
> --
> Emmanuel Charpentier

> --
> You received this message because you are subscribed to the Google Groups

> "sage-devel" group.

> To unsubscribe from this group and stop receiving emails from it, send an

> email to sage-devel+...@googlegroups.com.
> To post to this group, send email to sage-...@googlegroups.com.
> Visit this group at http://groups.google.com/group/sage-devel.

> For more options, visit https://groups.google.com/d/optout.