Disabling Tachyon on Windows

[Sriram N]

Just downloaded the latest zip binary and started spark-notebook on windows and I got

[warn] application - Start local micro tachyon

Oops, cannot start the server.

java.lang.IllegalArgumentException: No Under File System Factory found for: C:\Users\username\AppData\Local\Temp\Tachyon2264619589931210924U1445812

I believe this is a Spark issue on Windows? (same thing happens there as well)

I changed the setting in application.conf to false as below with no effect (assume that it is either not working or the conf is not being read)

 # If `enabled` is absent or set to false, tachyon support will be disabled

  # If `url` is set, then the local in-memory tachyon won't start

  tachyon {

    enabled = false 

    # url = "tachyon://example.com:18998"

    # baseDir = "/spark-storage-dir" # default to '/share'

  }

}

I will try the binary on Ubuntu and see how it goes.

[andy petrella]

Hello,

This is disabled by default in master and next distro -- lot of problem with Window and this is only for testing (local cluster)

So far, you're right you need to update this conf, but you also need to ask the binary to load the file:

```

./bin/spark-notebook -Dconfig.file=".\conf\application.conf"

```

should work or you inline the change

```

./bin/spark-notebook -Dmanager.tachyon.enabled=false

```

Sry for the inconvenient thingy with that.

cheers

PS: yep I still recommend using whatever linux distro when using spark or something that uses spark

--
You received this message because you are subscribed to the Google Groups "spark-notebook-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to spark-notebook-...@googlegroups.com.
To post to this group, send email to spark-not...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/spark-notebook-user/7a9cf447-60ed-4ddb-a5ed-365ddeb86b73%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

andy

[Sriram N]

That worked!  Look forward to exploring this interface.

./bin/spark-notebook -Dconfig.file=./conf/application.conf

On Sunday, October 25, 2015 at 6:42:37 PM UTC-4, andy petrella wrote:

Hello,

This is disabled by default in master and next distro -- lot of problem with Window and this is only for testing (local cluster)

So far, you're right you need to update this conf, but you also need to ask the binary to load the file:

```

./bin/spark-notebook -Dconfig.file=".\conf\application.conf"

```

should work or you inline the change

```

./bin/spark-notebook -Dmanager.tachyon.enabled=false

```

Sry for the inconvenient thingy with that.

cheers

PS: yep I still recommend using whatever linux distro when using spark or something that uses spark

On Sun, Oct 25, 2015 at 11:37 PM Sriram N <impl...@gmail.com> wrote:

Just downloaded the latest zip binary and started spark-notebook on windows and I got

[warn] application - Start local micro tachyon

Oops, cannot start the server.

java.lang.IllegalArgumentException: No Under File System Factory found for: C:\Users\username\AppData\Local\Temp\Tachyon2264619589931210924U1445812

I believe this is a Spark issue on Windows? (same thing happens there as well)

I changed the setting in application.conf to false as below with no effect (assume that it is either not working or the conf is not being read)

 # If `enabled` is absent or set to false, tachyon support will be disabled

  # If `url` is set, then the local in-memory tachyon won't start

  tachyon {

    enabled = false 

    # url = "tachyon://example.com:18998"

    # baseDir = "/spark-storage-dir" # default to '/share'

  }

}

I will try the binary on Ubuntu and see how it goes.

andy